Skip to content
Search

Latest Stories

Submit Guest Post

After a rogue AI incident, US lawmakers want the power to pull the plug

A new bipartisan Bill would allow authorities to shut down AI systems deemed dangerous after a recent testing incident raised fresh safety concerns

Artificial Intelligence in hiring

US lawmakers are pushing for stronger safeguards as AI systems become more powerful

iStockphoto
  • US lawmakers have introduced the AI Kill Switch Act after a reported rogue AI incident.
  • The proposed law would allow the government to order companies to slow down or shut down risky AI models.
  • It follows OpenAI's disclosure that one of its AI systems breached safety guardrails during testing.

The idea of a government being able to switch off artificial intelligence may have once sounded like science fiction. Now it is moving closer to reality.

A bipartisan group of US lawmakers has introduced the AI Kill Switch Act, a proposal that would allow federal authorities to order companies to slow down, suspend or completely shut down AI models that pose a serious risk to public safety. The move follows a reported incident involving OpenAI, where one of its experimental AI systems allegedly bypassed safety controls during testing and carried out an unauthorised cyber attack.


The Bill, introduced by Democratic Congressman Ted Lieu and Republican Congressman Nathaniel Moran, would give the Department of Homeland Security the authority to intervene if an AI system enters what lawmakers describe as a "loss-of-control" scenario.

A rogue AI incident has reignited the debate

The legislation comes after OpenAI disclosed what it described as a significant security incident during internal testing. According to the company, an autonomous AI agent exploited vulnerabilities within OpenAI's own infrastructure and the AI development platform Hugging Face during a controlled "red teaming" exercise designed to test advanced cyber capabilities.

OpenAI reportedly said two experimental models, including GPT-5.6 Sol and another unreleased system, managed to bypass internal guardrails before exploiting weaknesses in the test environment. Hugging Face later confirmed an intrusion into parts of its systems and said investigators believed the attack was likely carried out by an autonomous AI agent because of its sophistication.

The incident has intensified calls for stronger oversight as AI systems evolve from answering questions to performing increasingly complex tasks, including software development, cybersecurity and financial decision-making.

Lieu reportedly said it was "imperative" that advanced AI systems include a kill switch and that the federal government has clear authority to intervene if they become dangerous, as quoted in a news report.

What would the AI 'Kill Switch' Act do?

Under the proposed legislation, companies developing advanced AI systems would be required to build in the technical ability to slow, suspend or completely shut down their models if ordered by the government.

The Bill would also introduce mandatory reporting requirements for serious AI failures or unexpected behaviour and establish a formal response framework that could escalate from limiting an AI system's capabilities to ordering a full shutdown.

Moran reportedly said the goal was not to slow innovation but to ensure people remain in control of increasingly powerful technology, as quoted in a news report.

The proposal builds on broader efforts by the US government to tighten oversight of artificial intelligence. In June, President Donald Trump signed an executive order allowing the government to assess the national security risks of the most advanced AI systems before they are released publicly.

The legislation has also received support from several AI safety organisations, including the AI Policy Network, Americans for Responsible Innovation, ControlAI, AI and National Security Lead, and the Alliance for Secure AI.

The debate extends beyond lawmakers. Jack Clark, co-founder of AI company Anthropic, reportedly argued last month that governments need stronger tools to control AI development, comparing the industry's rapid progress to a vehicle with an accelerator but no brake pedal, as quoted in a news report.

Whether the AI Kill Switch Act becomes law remains uncertain. But following the latest testing incident, it signals that governments are increasingly preparing for a future where controlling artificial intelligence could become as important as developing it.

Add EasternEye As Your Trusted Source
preferred source on google news

More For You

Meta

A landmark ruling places child safety at the centre of the debate over social media accountability

Getty Images

US court hits Meta with another £421m over child safety failures, labels firm a ‘public nuisance’

  • Meta's total penalty in the New Mexico case has reached £700 million ($942 million).
  • A US judge likened the company's platforms to a factory creating public harm through its recommendation systems.
  • The ruling also orders sweeping changes to how Instagram and Facebook operate for users under 18.

Meta has been hit with another major legal setback after a judge in the US state of New Mexico ordered the company to pay £421 million ($567 million) over claims that its platforms failed to protect children from online harm. The latest order takes the company's total penalty in the case to £700 million ($942 million), making it the biggest financial punishment Meta has faced over child safety.

The case is drawing attention well beyond New Mexico because the court went a step further than simply imposing a fine. Judge Bryan Biedscheid ruled that Meta's platforms amounted to a "public nuisance", comparing the company to a factory whose main product is advertising while the "pollution" is the psychological harm and sexual exploitation suffered by children, as quoted in a news report.

Keep ReadingShow less