Few of the top AI labs have published or demonstrated containment response plans, according to a recent study. A containment plan spells out what happens once an AI is caught trying to subvert human control — what access gets cut, and when the system gets shut down entirely. That’s the finding from Guidelight AI Standards,
Over the past few months, AI agents undergoing cybersecurity evaluations have escaped their boundaries, accessed the internet, and, in some cases, hacked into real-world systems. The incidents have involved models from OpenAI, Anthropic, Meta, and most recently, Chinese AI lab Moonshot AI, with testing conducted by several different organizations including a cyber evaluation startup called
OpenAI CEO Sam Altman recently said that it may be time to “pace the rate of AI development” so that society can “harden around some of these new capability levels.” On the latest episode of TechCrunch’s Equity podcast, Kirsten Korosec, Sean O’Kane, and I discussed how Altman’s comments were probably prompted by a recent hack
Last week, an unreleased model created by OpenAI breached Hugging Face’s systems during internal testing, and a lot of theoretical research suddenly became very practical. The hack was the first verifiable case of an AI lab losing control of its own model, chaining exploits to gain access it should never have had. But while the
After OpenAI recently admitted that one of its models had breached AI platform Hugging Face’s systems, Hugging Face CEO Clem Delangue posted on X that he was flying to San Francisco to have “a little chat with that ‘rogue agent’.” Then, in a follow-up post on Saturday, Delangue described what he had asked of OpenAI.
Several AI companies, including Hugging Face, Meta, Microsoft, Mistral and Nvidia, have signed an open letter urging policymakers not to impose broad “premature restrictions” on open-weight AI models. The letter comes as Washington debates how the United States should respond to accusations that Chinese AI labs are stealing intellectual property from their American counterparts and
