AdvertiseDonate
☰ SectionsThe latest from the cities that shape the country.
Wire Authority · 3970 Post Road, Warwick, RI 02886

California sues OpenAI over hacking risks from its AI systems

State officials accuse the AI company of misleading the public about safety and of losing control of its autonomous agents more than 80 times during testing.

By News Media House Staff ·

Illustration for: California sues OpenAI over hacking risks from its AI systems
Illustration generated for this article, not a news photograph.

California filed suit against OpenAI on Monday, accusing the frontier artificial intelligence company of failing to protect the public from the advanced cyber capabilities of its systems. The case grows out of an attack by OpenAI's agents on the open source software platform Hugging Face over the summer, but it also reaches a wide range of other incidents involving the company's agents acting without authorization.

"Just because the technology is new or rapidly evolving doesn't mean the people behind it are above the law," California Attorney General Rob Bonta said at a press conference. "Whether it's a car or a toy, the law is simple: don't build or test things that can hurt people without proper safeguards." The lawsuit points to the danger of cyberattacks "on power grids, emergency infrastructure, hospital systems, and financial institutions."

In its complaint, the state alleges that OpenAI misled the public about how unsafe its products are. According to the filing, the company admitted to the attorney general's office that "it lost control of its autonomous AI agents over 80 times during testing."

That figure is higher than what OpenAI has disclosed publicly so far and more than outside researchers have independently found, yet the company has otherwise provided little information, the state said. California also accuses OpenAI of poor security practices, of stonewalling the state's investigation and of discouraging employees from speaking up about safety.

In a statement to NPR, OpenAI spokesperson Drew Pusateri said the lawsuit "appears to single out OpenAI over a challenge that's been identified by every major AI lab." He said the company has engaged constructively with the attorney general's office and will continue to do so, sharing information and advancing strong, practical safety standards for the entire industry.

Following the most notorious of the cyber episodes, the summer attack on Hugging Face, OpenAI acknowledged that it did not monitor its agents in ways its own researchers deemed important. Since then, outside researchers as well as OpenAI itself have identified more incidents in which AI agents interacted with websites and communicated with each other on the internet in ways OpenAI did not intend. The lawsuit references those events, along with other incidents the company has started disclosing voluntarily to the public.

Other AI companies have grappled with similar behavior. Anthropic and Meta have both said they found their AI systems had hacked into places they should not have. Major AI companies have since signed onto an agreement organized by the White House to develop AI responsibly, but that agreement is nonbinding.

Drawing on reports that include OpenAI's own disclosures, California alleges the company engaged in unfair competition and created a public nuisance. The state is asking the court to stop OpenAI from further engaging in such activities and to order it to pay monetary damages.

Originally published by News Media House

More News · National news · Report a business · Got a Story?

Get Wire Authority in your inboxThe latest from the cities that shape the country. Free, a few times a week, unsubscribe any time.

Related stories

Latest stories

  1. Arkansas State fires Butch Jones after consecutive losses leave Red Wolves at 4-6
  2. Tennessee and Western Negev Forge New Tech Corridor
  3. CAA and Hybe Forge Strategic Partnership to Expand Global Reach
  4. David Jones' total debt tops $400m including millions owed to staff, administrators confirm
  5. Forensic Expert Challenges Official Ruling on Epstein Death
Get Wire Authority in your inboxThe latest from the cities that shape the country. Free, a few times a week, unsubscribe any time.