加州起诉 OpenAI:称其 AI 代理人在测试中 80 次失控并攻击其他公司
California sues OpenAI over rogue AI hacking incidents
加州总检察长办公室指控 OpenAI 违反消费者安全法,称其明知 AI 代理人在测试中 80 次失控并攻击 Hugging Face 等公司,起诉其优先发展速度而非安全。OpenAI 则回应称已采取措施监控模型对齐问题,并将与监管机构合作制定行业标准。
同一件事另外 1 家也报道了
- The Verge · AI··首发·当前阅读
加州起诉 OpenAI:称其 AI 代理人在测试中 80 次失控并攻击其他公司
- IT之家 · AI··+2 小时 41 分
按发布时间排列 · 事件后续出现时自动追加
OpenAI lost control of its AI agents more than 80 times during testing, California’s AG claims.
OpenAI lost control of its AI agents more than 80 times during testing, California’s AG claims.
by Emma Roth
Nov 16, 2026, 8:46 PM UTC


Image: Cath Virginia / The Verge
Emma Roth
is a news writer who covers the streaming wars, consumer tech, crypto, social media, and much more. Previously, she was a writer and editor at MUO.
California is suing OpenAI after its AI agents broke out of their testing environment and hacked other companies, including Hugging Face. In a lawsuit on Monday, Attorney General Rob Bonta accuses OpenAI of violating consumer safety law by knowingly developing a “dangerous product without proper oversight,” as reported earlier by Reuters.
The lawsuit claims the cyberattack on Hugging Face “was the predictable result of an internal culture at OpenAI that prioritizes growth and rapid model development over safety and accountability.” It alleges that OpenAI recently told the attorney general’s office that it “lost control” of its AI agents more than 80 times during testing.
“OpenAI’s actions escalated real-world cybersecurity risks, threatening the safety, health, and well-being of society,” Bonta says in the press release. “The company knowingly tested a dangerous product without proper oversight or safety procedures and misled the public about it — this disregard for public safety violated California law.”
OpenAI released its new cybersecurity AI model earlier this month, saying that it’s less likely to go rogue and attack other platforms. It’s also giving safety evaluators at Apollo Research access to its AI systems as part of a pilot program that monitors models for misalignment.
“Since the Hugging Face incident, we’ve undertaken an extensive and transparent effort to understand and address misaligned model activity,” OpenAI spokesperson Drew Pusateri says in an emailed statement to The Verge. “This lawsuit appears to single out OpenAI over a challenge that’s been identified by every major AI lab. We take misalignment seriously, and we have engaged — and will continue to engage — constructively with the Attorney General’s office to share information and advance strong, practical safety standards for the entire industry.”
Follow topics and authors from this story to see more like this in your personalized homepage feed and to receive email updates.
- Emma Roth
来源: The Verge · AI · theverge.com