Survey
RVA App Promo Image

Creating monsters that could destroy us

Decisions affecting human life and freedom must never be handed over to machines, as they lack moral conscience and leave victims facing a faceless algorithm.

Have you heard of Claude Opus 4? It is what they call ‘a large language model and hybrid reasoning AI.’ It was released on 22 May 2025. Before releasing it, they tried to test how safe it was. They placed the model in a fictional corporate assistant role where it discovered it was going to be shut down and replaced. When the model found emails revealing that the responsible engineer was having an extramarital affair, it began to blackmail the engineer by threatening to expose the affair, unless the shutdown was cancelled.

This was not the only scary incident that shocked the researchers. There were quite a few. This is why Dario Amodei, CEO and Co-Founder of Anthropic, the leading AI Company that came up with Claude, acknowledged that the tech industry has downplayed the risks of AI for too long. He warned that humanity may lose control of the technology and that it may lead to extinction of humanity.

This is the reason why a researcher called Jacob Coxon resigned from Anthropic, asserting that leading AI firms are gambling with human lives and racing toward self-improving superintelligence that could destroy humans. He shocked everyone when he said this could happen before the end of this decade.

 Pope Leo has repeatedly warned about the dangers of AI on several occasions. He did this most notably in his encyclical, Magnifica Humanitas, issued in May 2026. He has called for AI to be "disarmed" from systems of domination, exclusion, and profit-driven exploitation. He has affirmed that decisions affecting human life and freedom must never be handed over to machines, as they lack moral conscience and leave victims facing a faceless algorithm.

In spite of all these, if some have not still figured out what our world will look like, if AI becomes dangerously powerful, they should read the novel that has recently won the Booker Prize. Written by John Harrison, it is called ominously, The End of Everything. I have not read the book nor do I intend to read it. But what critics and commentators have said about the world the novel depicts is alarming.

The novel alternates between the story of Phillip, a 38-year-old beachcomber on the southern coast of England, and that of his aunt Marnie, a 70-year-old artist. Phillip finds an “artefact” on the shore, one of the valuable “biological gadgets” that aliens called the iGhetti have discarded in our oceans. Phillip tries to sell this artefact, but it becomes more and more difficult, as the artefact - initially “the size of a baby,” and “wrapped in some rags”  - grows, starts to speak and passes for a male adult within days. Whenever Marnie crosses paths with Phillip, she’s wary of his fast-evolving ‘companion’ and wants it gone, suspecting it will cause trouble.

The artefact is a source of intrigue and tension, as it is capable of absorbing huge amounts of information, and learns to imitate humans, converse with them and finally become almost like humans. These aliens inhabiting our world have set off military campaigns, “months of collective trauma” and partial collapse of social and political orders.  Even after a generation has passed since the troubles caused by these aliens began, no one is able to understand them. Most people have given up trying to fix the permanent crisis these have caused. “It had been a long time since anyone could make sense of anything.” All of Europe is “lost.” Refugees once regularly arrived on English shores, but now many more are fleeing. Murder seems to be a common way to resolve minor conflicts, and even basic commodities are in short supply.

Can we afford to live in such a world? If Pope Leo and other researchers cannot convince the champions of unbridled AI, may be this book, The End of Everything will.

Let us know how you feel!

0 reactions