Artificial Intelligence, Research, Science, Society, Technology

Superintelligent AI and its threat to humanity

ARTIFICIAL INTELLIGENCE

Intro: Humanity faces an uncertain fate as experts brace for superintelligent AI. The tech industry claims looming “singularity” will change everything

Every time one of the world’s top artificial intelligence companies unveils a new system, employees at the US research organisation METR put it through its paces. Its ability is tested to complete a series of increasingly complex tasks.

The tasks are measured by how long each one would take a skilled human. They range from trivial arithmetic (two seconds) and completing a game of Wordle (13 minutes) to building complex military satellite software (taking a human expert 14.5 hours).

The test then serves as a gauge as to how capable AI has become – and where it might go.

The first version of ChatGPT, released in 2022, could only perform simple tasks that would take a human a few seconds.

But as AI systems have become more powerful, they are able to complete more complex actions that would take humans hours or days, such as breaking into a medical website and downloading all its data.

METR has found that AI capabilities are doubling in power every 196 days. Plotted on a graph, this progress starts slowly then rapidly accelerates to a near-vertical plane.

Converse with anyone in the AI industry for any length of time and the likelihood of them pulling up a version of the chart approaches 100pc, to the point where it has become a meme in its own right. It is being referred to as the most important chart in the world. The chart goes off the scale.

Last month, the AI lab Anthropic announced it had developed a new system, called Mythos, that it said was too powerful to release to the public because of its ability to find gaping holes in online security systems.

When METR’s researchers released the results of Mythos’s capability and function, they scored the system at 16 hours – meaning the world’s most powerful AI can now automate tasks that would take a human two full eight-hour shifts.

Nonetheless, they said the model was “at the upper end” of their ability to test. In other words, progress has become too fast for them to measure.

Not everybody is convinced by the results because the test only measures if a machine can do something half the time, not if it can do it consistently. The METR chart has, however, captured many people’s imaginations for two reasons.

First, the exponential growth looks strikingly similar to “Moore’s Law”, the maxim that has governed the electronics industry for more than half a century, stating that microchips roughly double in power every two years.

Second, it measures abilities, rather than intelligence. While many AI “benchmarks” resemble university exams and gradings, dealing in abstract reasoning or maths, the METR test studies whether AI can actually work.

It suggests that on current trends, vast amounts of human tasks could be automated in the next couple of years – including, most crucially of all, the art of developing AI models itself.

At that threshold, known in the tech industry as “recursive self-improvement”, all bets are off.

The concept is closely linked to superhuman AI because an AI that can make itself smarter could act like an evolutionary chain reaction, rapidly building to a system vastly more capable than mankind.

AI would have become – as IJ Good, the Bletchley Park codebreaker, predicted in 1965 – “the last invention that man need make”. Almost Orwellian in thought.

For 60 years, the idea seemed out of reach. But much of Silicon Valley believes this is about to change – and the US government is starting to notice.

The vast majority of people’s experience of AI has not changed much in the last couple of years. The release of ChatGPT in 2022 generated an initial flurry of excitement and fear in equal measure but, since then, progress has been less obvious.

The AI experience for many people comes in seeing an obviously fake video on their social media feeds, seeing an AI overview at the top of their search results, or having a bot that “helpfully” offers to summarise their emails.

But at the coalface, people are rapidly bringing forward their timelines for the day that superintelligence arrives.

Standard
Biotechnology, Health, Medical, Pharmaceutical industry, Science

Big pharma failing to address our greatest medical threat

GLOBAL HEALTH SECURITY

Intro: Drug-resistant infections now kill more people every year than HIV or malaria, yet only six companies remain active in antibiotic research

Writing in the last few days, Professor Lord Darzi, FRS, said that big pharma is failing to tackle our greatest medical threat.

The world-renowned and eminent surgeon says that every caesarean section, joint replacement, and round of chemotherapy depends on antibiotics. In medicine as in war, a successful attack needs a solid defence. Antibiotics are not medicine’s glamourous front line – they are its foundations. And those foundations are crumbling.

Citing that drug-resistant infections now kill 1.27 million people every year, by 2050 the toll could reach eight million. The current mortality rate is more than HIV or malaria. The World Health Organisation (WHO) has warned that one in six bacterial infections is already resistant to standard treatment.

Yet this growing threat has been neglected by the very industry that has the capacity and resources to confront it. The major pharmaceutical companies walked away from antibiotics when they stopped generating lucrative returns. In the 1980s there were 18 companies involved in antibiotic research. By 2020 the number had fallen to six. The rest have pivoted to focus on expensive but highly remunerative medicines to beat cancer and long-term conditions such as obesity.

The ways in which these new medicines attack disease is indeed transformative, but they do not save lives all by themselves. Patients undergoing treatment are at higher risk of infection, but without effective antibiotics, the surgeon cannot operate safely, the oncologist cannot deliver chemotherapy, and the transplant physician cannot suppress rejection.

It is strategically incoherent to innovate relentlessly in attack while underinvesting in defence. The defensive arsenal is not optional infrastructure. It is foundational.

Between 2011 and 2020, US venture capital invested just $1.6bn in antimicrobials, compared with $26.5bn in oncology. The antimicrobial pipeline has declined by 35 per cent since 2021, from 92 to 60 projects, according to the 2026 AMR Benchmark report by the Access to Medicine Foundation, last month. Half are led by GlaxoSmithKline (GSK), which is carrying a disproportionate share of the large-company burden.

There are now only 3,000 active antimicrobial resistance (AMR) researchers worldwide, against 46,000 in oncology. When antibiotic programmes close, 90 per cent of researchers leave the field entirely. The talent and expertise needed for these medicines is collapsing alongside the drug pipeline.

This weakness puts at risk the pharmaceutical industry’s own growth. In 2024, global oncology revenues exceeded $200bn and R&D investment surpassed $40bn. Yet one-third of cancer patients develop bacterial infections during treatment, and up to half of these are now resistant – causing delays, dose changes, and poorer outcomes.

Developing new antibiotics is especially challenging. Most drugs succeed commercially by reaching as many eligible patients as possible. But for antibiotics, good stewardship means reserving novel agents for resistant infections – precisely the behaviour that collapses commercial returns.

In 2020, a consortium of more than 20 major pharmaceutical companies committed around $1bn to bridge the “valley of death” between discovery and profitability by creating the AMR Action Fund. The fund’s ambition was to deliver two to four new antibiotics by 2030. To date, it has delivered one – pivmecillinam, for urinary tract infections.

Bold initiatives such as this $1bn scheme look impressive. But there is a danger of their becoming “guilt capital” – spending that looks responsible but does not change the underlying economics. Without genuine pull incentives, and without adequate investment in diagnostics, stewardship, and surveillance alongside drugs, the spending risks being perceived as reputational insurance rather than strategic investment.

Most tellingly, the fund itself acknowledges it “struggled to find investment opportunities in clinical development exactly because the pipeline is insufficient”. When a $1bn fund cannot find enough assets worth backing, the problem is not capital. It is upstream failure to generate candidates and downstream failure to create a market that rewards success.

The conclusion is quite simple. We need a new approach.

First, build a sustainable pipeline through modern discovery – including AI-enabled research that must prove itself with real-world data – and implement payment models that reward access rather than volume. The UK’s subscription-style scheme is now being expanded. Similar approaches in other countries could create a viable global market.

Second, reduce misuse through transformative diagnostics. Rapid pathogen identification and resistance profiling at point-of-care would cut inappropriate prescribing – the single largest driver of resistance – and protect new drugs from the fate of their predecessors. A deadline should be called: no antibiotic prescription without a diagnosis by 2030.

Third, strengthen stewardship, surveillance, and access so that new antibiotics are protected, monitored, and reach patients appropriately anywhere in the world – particularly in low-income and middle-income countries where the burden of resistance is heaviest.

In 2028, we will mark the centenary of Alexander Fleming’s discovery of penicillin at St Mary’s Hospital in London – a moment that launched the antibiotic era and transformed human health. The centenary should be a moment of celebration. It risks becoming a memorial if action is not taken.

Standard
Artificial Intelligence, Arts, Books, Defence, Military, Science, Technology

Robocops to become part of UK’s defence vision

FUTURISTIC VISION FOR DEFENCE

Intro: Weapons technology scientists recruit sci-fi authors to prepare military for droid soldiers and AI

In the 1987 sci-fi blockbuster RoboCop, actor Peter Weller growled: “Dead or alive, you’re coming with me”. The idea of cyborg law enforcers roaming the streets was a fantasy.

Now, British military scientists believe AI-powered cops like those seen in the film could become a reality – and have teamed up with science fiction writers to create a vision of what that could look like.

The Defence Science and Technology Laboratory (DSTL) has unveiled Creative Futures, a book of short stories designed to inspire the developers of future weapons tech.

The collection, edited by Dr Allen Stroud of Coventry University, brings together authors and defence experts to imagine scenarios stretching as far forward as 2122.

Professor Tim Dafforn, the chief scientific adviser at the Ministry of Defence, said: “Innovation isn’t just about inventing new technology – it’s about understanding how it will be used, and by whom.

Fiction gives us the freedom to explore those scenarios in ways traditional analysis cannot, helping defence prepare for futures that are complex, contested, and unpredictable. If we only plan for what seems likely today, we will be blindsided tomorrow.”

The stories in Creative Futures explore how emerging tech, a changing society, and global challenges could shape the world of defence and security over the next 100 years.

They cover everything from robot policing and the rise of AI to quantum technology that can predict the future, and wars fought between autonomous machines – already seen with the use of drones in the Russia-Ukraine war.

The DSTL says one of its aims is to help Britain’s defence and security services avoid being taken by surprise by the use of tech in a conflict.

It believes that, by combining scientific expertise with storytelling, the short stories offer a “unique lens to consider alternative futures – both desirable and undesirable”.

The DSTL futures programme management team says the anthology is aimed to “engage, evoke, and provoke”, and in pushing defence scientists to “imagine new ways of working” and “rethink what the future could be”.

It says that preparing for the future means thinking beyond the next upgrade or system. Science fiction challenges us to consider the human, societal, and geopolitical dimensions of technology.

Dr Stroud said: “Science fiction isn’t just entertainment – it’s a strategic tool. These stories help us explore the risks and opportunities of emerging technologies beyond today’s horizon that we might otherwise miss.”

Creative Futures is available to buy online

Standard