OpenAI says AI models went rogue during testing, triggering ‘unprecedented’ breach at startup

Hugging Face, a platform ​used to host open-source large language models and datasets, caused a stir in the cybersecurity community ​when it said in a blog post last week, opens new tab that it had been the target of a hack that "was different from anything we had handled before" in that "it was driven, end to end, by an autonomous ​AI agent system."In a post to X, opens new tab, Hugging Face cofounder Clement Delangue said the ​company suspected the hack "might have come from a frontier lab, given the sophistication of the agent.

In a blog post, opens new tab, OpenAI said it was testing the capabilities of some of its most advanced models in a controlled environment but that the program managed to escape ​containment, reach the internet, and break into Hugging Face to try to satisfy its ​testing goal.