AI leaders call for slower development

What's happened

Senior researchers and executives have warned that frontier AI could escape human control and pose existential risks. Anthropic staffers have raised the possibility of human extinction; Anthropic and OpenAI have proposed independent evaluators and pauses. Politicians and regulators are debating how to translate industry pledges into enforceable rules as markets and rivals react.

What's behind the headline?

What’s actually happening

Frontier AI developers are pausing the race to ship ever-more powerful models and are promising third-party checks. Anthropichas published new safety steps and called for a broader downshift; OpenAI has pledged to adopt independent evaluators; Elon Musk has publicly supported the call.

Who is driving the story

• Company leaders are driving this publicly: Dario Amodei and Sam Altman are advocating slower development while defending their firms' roles.
• Alarmed researchers inside those firms are amplifying risk claims — Jacob Coxon resigned and warned the industry was "gambling with our lives," and Evan Hubinger has put a double-digit percentage on extinction risk within a decade.

What’s at stake

• Regulatory momentum will increase. Governments are already debating legal limits and multilateral governance; this corporate pause will force legislators to define enforceable checks.
• Markets will reassess valuations. The promise to slow capabilities will reduce short-term product rollout risk but will also compress growth narratives that have driven investor enthusiasm.

Likely next moves

• Companies will operationalise independent evaluation and internal safety gates. That will create friction between engineering teams racing for capability and policy teams managing external scrutiny.
• Regulators will propose binding audits and testing frameworks. That will shift the battleground from PR statements to legal enforcement and export controls.

Bottom line

This will not end AI progress. It will slow the most aggressive capability pushes and will shift power from rapid engineering cycles to governance processes. The next six months will determine whether the industry converts voluntary pledges into durable, verifiable constraints.

How we got here

The debate has crystallised after Anthropic researchers publicly expressed alarm and one researcher resigned. CEOs at Anthropic, OpenAI and xAI have urged a coordinated slowdown and new safety steps, while firms face investor pressure and political scrutiny over rapid capability gains.

Our analysis

The coverage divides on tone and motive. Jacob Coxonhas told multiple outlets he resigned because he believed the industry was "gambling with our lives" (Independent). The Guardian has explored hypothetical failure modes, from mis-specified objectives to biosecurity risks, and summarised expert scepticism about anthropomorphising systems. Bloomberg has documented the industry response and executive coordination: Dario Amodei has urged the industry to "pace the frontier" and proposed third-party evaluators, a step Sam Altman has said he will adopt (Bloomberg; The Japan Times). Business Insider has highlighted the political economy: it argues caution calls also serve incumbent firms by slowing competitors and shaping regulation (Dan DeFrancesco, Business Insider UK). The BBC and Arab News have quoted alignment researchers such as Evan Hubinger describing non-trivial extinction probabilities and UN officials urging multilateral action (BBC Business; Arab News). Direct quotes: "we really do earnestly believe AI could kill all humans" (reported by Bloomberg as an internal Anthropic comment) and Amodei's public call to "pace the frontier" (Bloomberg). Read the original pieces for the full essays and supporting detail from each publisher.

Go deeper

• What specific powers will independent evaluators have and who will appoint them?
• How will regulators enforce a slowdown without stifling legitimate commercial uses?
• Which safety measures will investors demand before funding new model training runs?

More on these topics

• Anthropic - Artificial intelligence company

  Anthropic PBC is a U.S.-based artificial intelligence startup public-benefit company, founded in 2021. It researches and develops AI to "study their safety properties at the technological frontier" and use this research to deploy safe, reliable models for

• OpenAI - Artificial intelligence company

  OpenAI is an artificial intelligence research laboratory consisting of the for-profit corporation OpenAI LP and its parent company, the non-profit OpenAI Inc.

• Sam Altman - President of Y Combinator

  Samuel H. Altman is an American entrepreneur, investor, programmer, and blogger. He is the CEO of OpenAI and the former president of Y Combinator.

• Dario Amodei - CEO and co-founder of Anthropic

  Dario Amodei (born 1983) is an American artificial intelligence (AI) researcher and entrepreneur. In 2021, he and his sister Daniela Amodei co-founded Anthropic, the company behind the large language model series Claude. Before that, he was the vice president of research at OpenAI. In his capacity as Anthropic's CEO, Amodei often writes on the benefits and risks of advanced AI systems. He is a proponent of an "entente" strategy in which a coalition of democratic nations use advanced AI systems in military applications to achieve a decisive advantage over adversaries while sharing the benefits with cooperating nations.

• United States - Country in North America

  The United States of America, commonly known as the United States or America, is a country mostly located in central North America, between Canada and Mexico.

• Donald Trump - 45th and 47th U.S. President

  Donald John Trump is an American politician, media personality, and businessman who is the 47th president of the United States. A member of the Republican Party, he served as the 45th president from 2017 to 2021.

• Hugging Face - AI company

  Hugging Face, Inc. is an American company incorporated under the Delaware General Corporation Law and based in New York City that develops computation tools for building applications using machine learning.

• Elon Musk - CEO of SpaceX

  Elon Reeve Musk FRS is an engineer, industrial designer, technology entrepreneur and philanthropist. He is the founder, CEO, CTO and chief designer of SpaceX; early investor, CEO and product architect of Tesla, Inc.; founder of The Boring Company; co-foun

• People's Republic of China - Country in East Asia

  China, officially the People's Republic of China, is a country in East Asia. It is the world's most populous country, with a population of around 1.4 billion in 2019.

• LinkedIn - Website

  LinkedIn is an American business and employment-oriented online service that operates via websites and mobile apps. Launched on May 5, 2003, it is mainly used for professional networking, including employers posting jobs and job seekers posting their CVs.

• United Kingdom - Country in Europe

  The United Kingdom of Great Britain and Northern Ireland, commonly known as the United Kingdom or Britain, is a sovereign country located off the north­western coast of the European mainland.

• Nvidia - Computer game company

  Nvidia Corporation is an American multinational technology company incorporated in Delaware and based in Santa Clara, California.

• Facebook - Social media service

  Facebook is an American online social media and social networking service based in Menlo Park, California and a flagship service of the namesake company Facebook, Inc.

• Jensen Huang - American entrepreneur and businessman; founder and CEO of Nvidia

  Jen-Hsun Huang (Chinese: 黃仁勳; pinyin: Huáng Rénxūn; Tâi-lô: N̂g Jîn-hun; born February 17, 1963), commonly anglicized as Jensen Huang, is a Taiwanese and American business executive, electrical engineer, and philanthropist who is the founder,

• Bernard Sanders - United States Senator

  Bernard Sanders is an American politician who has served as the junior United States Senator from Vermont since 2007. The longest-serving Independent in congressional history, he was elected to the U.S.

• Bloomberg - Wikimedia disambiguation page

  Bloomberg may refer to:

• Initial Public Offering

  Initial public offering or stock market launch is a type of public offering in which shares of a company are sold to institutional investors and usually also retail investors.

• Greg Casar - Politician

  Gregorio "Greg" Casar is a Texas politician currently serving in the Austin City Council for District 4 since January 6, 2015. Casar is the youngest elected Austin City Council Member and a member of the Democratic Party and the Democratic Socialists of A

• Apple Inc. - Technology company

  Apple Inc. is an American multinational technology company headquartered in Cupertino, California, that designs, develops, and sells consumer electronics, computer software, and online services.

• Japan - Country in East Asia

  Japan is an island country of East Asia in the northwest Pacific Ocean. It borders the Sea of Japan to the west and extends from the Sea of Okhotsk in the north to the East China Sea and Taiwan in the south.

• SpaceX - Aerospace company

  Space Exploration Technologies Corp., trading as SpaceX, is an American aerospace manufacturer and space transportation services company headquartered in Hawthorne, California.

• Greg Brockman - American entrepreneur, investor, and software developer

  Gregory Brockman (born November 29, 1987) is an American entrepreneur and software engineer. He is co-founder and president of OpenAI. He began his career at Stripe in 2010, upon leaving MIT, and became CTO in 2013. He left Stripe in 2015 to co-found...

• Iran (Islamic Republic of Iran) - Country in the Middle East

  Iran, also called Persia, and officially the Islamic Republic of Iran, is a country in Western Asia. It is bordered to the northwest by Armenia and Azerbaijan, to the north by the Caspian Sea, to the northeast by Turkmenistan, to the east by Afghanistan a

• Beijing - Capital of China

  Beijing, alternatively romanized as Peking, is the capital of the People's Republic of China. It is the world's most populous capital city, with over 21 million residents within an administrative area of 16,410.5 km².

• Xi Jinping - General Secretary of the Chinese Communist Party

  Xi Jinping is a Chinese politician serving as the general secretary of the Communist Party of China, president of the People's Republic of China, and chairman of the Central Military Commission.