San Francisco-based Anthropic released a threat intelligence report on Thursday detailing how several actors had used its Claude AI models for activities ranging from weapons development and cyber operations to surveillance and fraud.
Alarm about the potential harm from AI grew when Anthropic researcher Jacob Coxon resigned, stating that the "people building AI earnestly believe that it could kill us all by the end of the decade."
OpenAI's Altman said in an interview that risks of human extinction posed by AI were "unacceptable".
And while several U.S. lawmakers have raised concern about AI's rapid progress and called for new rules, U.S. President Donald Trump on Sunday likened AI critics to "very negative forces" bringing up scenarios that will not happen, and said he wanted to make sure that the U.S. remains the industry leader.
AI-related trades have powered much of the gains in global equities since OpenAI released ChatGPT in 2022, but more recently cyberattacks by rogue AI agents and public discontent with data centre construction have raised opposition to the development of the industry.
The U.S. and Chinese governments are expected to hold AI safety talks as part of bilateral discussions taking place this month, according to two people briefed on the plans.
But China's state-backed Global Times blasted the Anthropic essay in an editorial, calling it a "Cold War playbook" intended to curb the country's technological development.
Some investors dismissed the warnings from Anthropic and OpenAI.
Michael Burry, whose prescient bets against the U.S. housing market before the 2008 financial crisis were chronicled in the movie "The Big Short", said in a message on X the warnings were "hype and puffery" and "cover for real uncontrollable slowing growth".
Others said the warnings would be an overhang.
"In the short term, these warnings could still weigh on AI and chip stocks," said Charu Chanana, chief investment strategist at Saxo Bank in Singapore.
"Their valuations assume both strong demand and a relentless pace of technological progress," she said. "When expectations are this high, even a possible delay can trigger profit-taking."
But the bigger question for markets around AI was who would ultimately earn the return on all the capital being spent on building new capacity, said Sebastien Mallet, portfolio manager at T. Rowe Price in London.
"There is little doubt that AI will change the world," he said. "But that does not necessarily mean every investment being made today will generate an attractive return."