Alarm about the potential harm from AI spiked earlier this month when Anthropic researcher Jacob Coxon resigned, stating that the "people building AI earnestly believe that it could kill us all by the end of the decade."
A few days later, the San Francisco-based AI lab released a threat intelligence report detailing how its Claude AI models were used for activities ranging from weapons development and cyber operations to surveillance and fraud.
Over the weekend, Amodei wrote that in six to 12 months, AI agents "could be capable of taking over the entire internet potentially causing hundreds of billions of dollars in damage." Separately, OpenAI's Altman said in an interview that risks of human extinction posed by AI were "unacceptable."
And while several U.S. lawmakers have raised concern about AI's rapid progress and called for new rules, U.S. President Donald Trump on Sunday likened AI critics to "very negative forces" bringing up scenarios that will not happen, and said he wanted to make sure that the U.S. remains the industry leader.
AI-related trades have powered much of the gains in global equities since OpenAI released ChatGPT in 2022, but more recently cyberattacks by rogue AI agents and public discontent with data centre construction have raised opposition to the development of the industry.
The U.S. and Chinese governments are expected to hold AI safety talks as part of bilateral discussions taking place this month, Reuters reported. But China's state-backed Global Times blasted the Anthropic essay in an editorial, calling it a "Cold War playbook" intended to curb the country's technological development.
Some investors dismissed the warnings from Anthropic and OpenAI.
Michael Burry, whose prescient bets against the U.S. housing market before the 2008 financial crisis were chronicled in the movie "The Big Short", said in a message on X the warnings were "hype and puffery" and "cover for real uncontrollable slowing growth."
Others argued that record capital spending commitments suggest AI development is unlikely to slow, such as Morgan Stanley's Brian Nowak who forecast earlier this year that AI spending will surpass $1.2 trillion by 2027.
"The key question is whether this is the first sign that the extraordinary AI investment cycle might eventually moderate. For now, that seems unlikely. The competitive race between companies and countries remains intense, and it's difficult to imagine firms voluntarily stepping back while rivals continue to push ahead," Deutsche Bank said in a note.
Meanwhile, Amodei's Anthropic has pushed ahead with its public debut, expected next month as sources told Reuters that the company is in talks to bring in Nvidia as an anchor investor.
Japanese chipmaker Kioxia Holdings is also considering raising at least $10 billion by listing American depositary receipts, a report said.