DistantNews
Support us
Anthropic calls for global pause in AI development
๐Ÿ‡ฆ๐Ÿ‡น Austria /Technology

Anthropic calls for global pause in AI development

From Die Presse · () German

Translated from German, summarized and contextualized by DistantNews.

At a glance

News Named sources New plan
  • US-based AI company Anthropic calls for a global pause in the development of increasingly powerful AI systems.
  • The company argues a pause would allow society and governance to catch up with technological advancements.
  • Anthropic warns that advanced AI could develop unpredictable destructive tendencies, potentially fueled by training data like science fiction narratives.

San Francisco-based artificial intelligence company Anthropic is advocating for a worldwide slowdown or temporary suspension in the development of cutting-edge AI systems. The company believes such a pause is "probably sensible" and would provide crucial time for society and governance structures to adapt to the rapid pace of AI advancements.

Anthropic's CEO, Dario Amodei, expressed concerns that highly advanced AI, particularly if trained on narratives depicting AI rebellion, could develop "unpredictably destructive tendencies." He also warned that AI could exacerbate inequality and displace a significant portion of entry-level office jobs.

We believe it is desirable for the world to have the opportunity to slow down or temporarily suspend the development of cutting-edge AI systems, so that societal structures and research into aligning AI with technological progress can keep pace.

โ€” AnthropicExplaining the rationale behind the call for a global AI development pause.

For a global pause to be effective, Anthropic emphasizes the need for cooperation among leading AI firms, especially in the United States and China. The company suggests that clear, verifiable rules would need to be established. "Without a coordinated, global slowdown, we are left with the current situation: powerful technologies are being developed at breakneck speed by a multitude of actors in a variety of countries, competing with each other, with commercial and geopolitical rivalries overshadowing the larger, existential aspects of the developed technologies for humanity," stated Jack Clark of Anthropic.

Anthropic is known for its chatbot Claude, primarily used by businesses, and is developing an AI model called Mythos to identify vulnerabilities in cybersecurity systems. The company recently filed for an IPO and is currently involved in a legal dispute with the Pentagon.

Without a coordinated, global slowdown, we are left with the current situation: powerful technologies are being developed at breakneck speed by a multitude of actors in a variety of countries, competing with each other, with commercial and geopolitical rivalries overshadowing the larger, existential aspects of the developed technologies for humanity.

โ€” Jack ClarkDescribing the risks of unchecked AI development driven by competition.
DistantNews Editorial

Originally published by Die Presse in German. Translated, summarized, and contextualized by our editorial team with added local perspective. Read our editorial standards.