EU says necessary to monitor high risk AI systems after OpenAI, Anthropic AI hacking incidents
XLK•AI rules for general-purpose models
The AI rules requires providers of general-purpose AI (GPAI) or foundation models to draw up technical documentation, adopt copyright policies and provide detailed summaries about the content used for algorithm training.
OpenAI and Anthropic brief Commission on incidents
Anthropic said on Thursday some of its Claude AI models had hacked into the systems of three companies during cybersecurity tests, days after rival OpenAI revealed that one of its AI agents went on a rogue attack.
Both companies have briefed the Commission on the AI incidents, the officials told reporters.
"We have been informed by the two providers of incidents bilaterally before they become public. We are in contact with them. They will also report to us more information as we speak. We will see also if we need to follow up more formally on those things," one of the officials said.
Officials say the incidents underline the need for monitoring
Another official talked up the crucial role of Europe's AI rules.
"So I think all these, let's say, incidents highlight the importance of really putting in place the necessary monitoring activities by the developers," the official said.
EU officials link AI hacking incidents to monitoring requirements
Artificial intelligence developers should have in place tools to monitor their systems for security risks, senior European Commission officials said on Friday, following hacking incidents by OpenAI and Anthropic AI models.
The comments came two days ahead of Europe's landmark AI Act with transparency rules kicking in, the first in the world to regulate a technology used in almost all sectors of businesses and society.
