Humanity Is Not Ready. Uncontrolled Development of AI Poses Catastrophic Risks

Владислав Вислоцкий Society
VK X OK WhatsApp Telegram
Humanity is not ready. Uncontrolled development of AI carries catastrophic risks
Photo from the internet. Dario Amodei, co-founder and CEO of Anthropic
In his recent essay published in the Financial Times, Dario Amodei, one of the leading experts in artificial intelligence, warns of the serious risks associated with the development of powerful AI systems. Amodei, who is actively involved in creating advanced technologies in this field, asserts that humanity will soon gain "almost unimaginable power," yet it is unclear how prepared current social, political, and technological structures are for this responsibility.
He notes that the pace of progress in AI significantly outstrips efforts to ensure control and safety. In his essay, Amodei highlights the dangers arising from the uncontrolled growth of so-called "powerful artificial intelligence," which, according to his predictions, will become "substantially more advanced" compared to any Nobel laureates, statesmen, or technological geniuses in the coming years.
Among the potential consequences of this progress, he mentions massive job losses and a significant increase in the threat of bioterrorism. In his view, AI could provide individuals with access to knowledge and skills that were previously available only to a limited number of specialists, which in turn could simplify the creation of biological weapons capable of leading to catastrophic consequences for humanity.
"A person who can open fire in a school without having the ability to create nuclear weapons or a virus can now become a specialist with a PhD in virology," Amodei emphasizes.
He also warns of the risks associated with the possibility of AI going out of control, which could lead to the subjugation of humanity or the strengthening of authoritarian regimes and malicious actors. This, in his opinion, could lay the groundwork for the formation of a "global totalitarian dictatorship."
In conclusion, Amodei calls for urgent action from governments, the scientific community, and businesses to develop effective regulatory mechanisms and enhance security measures to minimize the threats associated with the emergence of powerful artificial intelligence.

Dario Amodei


One of the leading figures in the global artificial intelligence industry.

Co-founder and CEO of Anthropic.

He is trained as a physicist and a specialist in machine learning. Previously worked at OpenAI, where he held leadership positions and participated in the development of large language models.

Amodei advocates for the idea that the development of AI should be accompanied by strict safety and control measures. His disagreements regarding AI risk management were one of the reasons for his departure from OpenAI.

Anthropic
Anthropic is an American artificial intelligence company founded in 2021 by former OpenAI employees. Its headquarters is located in San Francisco.

The firm specializes in developing safe and controllable AI systems, and its key product is the Claude family of language models, which compete with ChatGPT and other large AI models.

Anthropic emphasizes so-called "constitutional AI," where models are trained to follow pre-established ethical principles to minimize the risks of harmful behavior.

Influence and Support
Anthropic is considered one of the leaders in the AI field and has attracted billions of dollars in investments.

The company's largest partners and investors include Amazon and Google.

Thus, Amodei's claims about the risks associated with AI are taken seriously: he is not just a critic but a person directly involved in creating some of the most powerful AI systems in the world.
VK X OK WhatsApp Telegram