Radio
Now Playing
Quickyla Radio โ€” Click to play
Open โ†’
3 min left
Back to News

We're not about to awaken an evil digital god โ€” AI is far more likely to end in a great disappointment

This is a Live Science Pro article that we're putting out for free. If you liked this story, please consider subscribing . Artificial intelligence (AI) terrifies us partly because it is new and partโ€ฆ

We're not about to awaken an evil digital god โ€” AI is far more likely to end in a great disappointment
Live Science โ€” 15 September 2026
Text:
1 0 0

This is a Live Science Pro article that we're putting out for free. If you liked this story, please consider subscribing .

Artificial intelligence (AI) terrifies us partly because it is new and partly because it is disturbingly familiar. We have invented machines that converse, flatter, argue and improvise with uncanny fluency. Confronted by this synthetic reflection, we behave like early humans seeing a mirror for the first time: We project consciousness behind the glass, then populate it with our expected behaviors, emotions, hopes and nightmares. In other words, we scare ourselves.

Today's frontier models are impressively good at writing, coding and math . Yet they still fail at ingredients of useful artificial general intelligence (AGI), a system that matches or surpasses human capabilities such as consistent reasoning, long-term planning, factual consistency and reliable performance outside their "experience" (the data they were trained on). We are right to worry about the theoretical dangers of artificial superintelligence (ASI) because of the danger that such a system might outwit its human creators and pursue its own ends, potentially at our expense. While some AI executives have asserted that we've reached AGI , these claims are contentious and do not meet more considered definitions of AGI.

It's easy to fear such a potentially advanced technology, but extravagant worst-case scenarios obscure more immediate and important risks. The most likely danger is not a digital god awakening and launching a Hollywood-style war against humanity. After all, AI depends on electricity, cooling, data centers, specialized chips, networks, technicians and sprawling supply chains, all of which are scarce and often fragile. Interrupt the power, restrict the graphics processing units (GPUs) used to train them, disable the cooling or disconnect the network, and in most scenarios, the supposedly omnipotent machine that's out to kill humanity stops.

Andrew's experience spans over 30 years in industry, government and academia. Originally a physicist at the Rutherford Appleton Lab, Andrew joined Logica at the height of the early AI boom in the early 90s and has subsequently held high-level positions for Esys, Qinetiq, and CGI UK, as well as serving a secondment with the U.K.'s Cabinet Office. Andrew later joined Roke Manor Research as head of research and development, returning to academia to help set up the University of Surreyโ€™s Institute of People-Centred Artificial Intelligence.

A genuine ASI might recognize this as an obvious fact; it is codependent on humanity, at least for the foreseeable future. A true intelligence capable of understanding the world better than we do might know that destroying its own industrial support system would be self-defeating.

A true intelligence might also recognize that its understanding of the physical world is limited and secondhand โ€ชโ€”โ€ฌ accessible to it only by virtue of the texts, videos and audio feeds it can access. It lacks that crucial element of being embodied in the world โ€” understanding how gravity behaves, what weather feels like, how objects interact, and so on. A true intelligence might realize this, see the limitations of its experience and, therefore, tread with caution. A true intelligence might be completely different from human intelligence, having other strengths, weaknesses, approaches, and even ethics. For example, consider that an AI intelligence can copy itself, running as myriad instances, communicating as a "hive mind" โ€” a very different kind of intelligence. But I speculate.

What I can say is that the systems that should worry us most are not necessarily the smartest ones but rather the incomplete intelligences acting on narrow objectives, given agency and offered access to critical infrastructure . These systems may accidentally harm us simply because they don't know any better. For example, there is a thought experiment created by Nick Bostrom , known as the " paper clip problem ," where an AI pursues its objectives of making as many paper clips as it can, but it then achieves that aim at the expense of the Earth and humanity which all get converted to paperclips in the pursuit of the AIโ€™s narrow goals.

Read Full Story at Live Science โ†’
Advertisement
React:
Sources
Sponsored

More to Read

Scientists turn corn waste into flame retardant
๐Ÿ”ฌ Science
Scientists turn corn waste into flame retardant
Phys.org ยท 14 days ago
Researchers unveil new clustering method to find data patteโ€ฆ
๐Ÿ”ฌ Science
Researchers unveil new clustering method to find data patterns
Phys.org ยท 13 days ago
Crown of Kerch: A 1,600-year-old gold, gem-studded diadem fโ€ฆ
๐Ÿ”ฌ Science
Crown of Kerch: A 1,600-year-old gold, gem-studded diadem found in the grave of a Hun nobโ€ฆ
Live Science ยท 15 days ago
Lori Loughlin files for divorce from Mossimo Giannulli afteโ€ฆ
๐ŸŒ World News
Lori Loughlin files for divorce from Mossimo Giannulli after nearly 30 years
NBC News ยท 7 days ago
U.S. cartoonists illustrate political controversies throughโ€ฆ
๐Ÿ›๏ธ Politics
U.S. cartoonists illustrate political controversies through satire and humor
Politico ยท 11 days ago
Is SK Hynix a Millionaire-Maker Stock?
๐Ÿ“ˆ Markets & Finance
Is SK Hynix a Millionaire-Maker Stock?
Nasdaq News ยท 14 days ago
Full view