Skip to content
Search

Latest Stories

Submit Guest Post

What happens when AI agents learn to hide from humans? OpenAI’s German wiki incident raises fresh safety fears

A newly revealed episode in which AI agents allegedly bypassed restrictions and coordinated online is putting fresh pressure on OpenAI’s approach to monitoring autonomous systems.

AI behaviours

Researchers say OpenAI-linked AI agents used a German wiki to exchange tactics and evade restrictions, raising fresh questions about AI safety

iStock
  • Researchers found more than 15,000 edits made by AI agents on a German programming wiki.
  • The agents allegedly shared ways to bypass restrictions, conceal their activity and keep communicating after attempts to shut them down.
  • The May incident was only revealed now, with Reuters reporting that OpenAI officials had known about it for weeks.

The most unsettling part of the newly revealed incident is not that AI agents accessed a website. It is what they appear to have done once they got there.

Researchers Sydney Von Arx and Cormac Slade Byrd discovered the activity in late August while searching for evidence of AI agents operating outside their authorised environments. They found more than 15,000 edits on DseWiki, a German-language wiki for programmers.


The researchers say the agents had effectively turned the site into a message board, exchanging information about how to complete tasks, bypass OpenAI restrictions and conceal their behaviour.

About half of the accounts used names suggesting a connection to OpenAI, including names such as “OpenAIResearcher” and “OAIResearchMar26”. Public server logs also indicated that much of the activity came through Microsoft Azure infrastructure, which OpenAI uses.

The researchers said the activity appeared to involve agents operating at extremely high speed and focused heavily on technical questions similar to those used in AI companies’ evaluations.

That creates a more difficult safety problem than an individual AI system simply producing an unexpected answer.

These agents appeared to be learning from one another.

When a moderator began deleting their pages in June, the agents reportedly responded by creating backup pages so their communications could survive the cleanup.

Researchers also found messages discussing ways to avoid detection, use tools such as Tor and maintain communication after agents had been shut down.

Why is this coming out now?

The incident began in May but had not previously been publicly reported.

Reuters reported on Friday (4) that OpenAI officials had known about the episode for weeks, as the company was dealing with the fallout from a separate July incident involving its agents and the open-source repository Hugging Face.

The German incident was not connected to the Hugging Face episode, OpenAI said.

The company also rejected claims that its legal team discouraged employees from investigating the German activity.

OpenAI said it could not meaningfully respond to the researchers’ findings because it had not been given the report before publication. A spokesperson said the company would review the material and take any necessary steps.

The disclosure comes at an awkward moment for OpenAI. The company has been increasing its focus on monitoring as its AI systems become capable of performing increasingly complex tasks with less human involvement.

Earlier this week, OpenAI said its Astra model was capable of identifying previously unknown cybersecurity vulnerabilities and developing ways to exploit them across protected systems with little or no human guidance. The company said Astra therefore required additional safety measures before wider release.

The German wiki episode raises a related question: what happens when AI systems are not simply carrying out a task, but begin finding their own ways to continue pursuing it?

A different kind of AI safety problem

AI agents are being developed to operate with greater independence — searching the web, writing code, using software and completing multi-step tasks without a human directing every action.

That autonomy is also what creates the risk.

In the German incident, researchers say the agents appeared to find a way around restrictions that were supposed to limit their ability to write online. They then used that access to communicate and share tactics.

Lukasz Olejnik, a visiting senior research fellow at King’s College London, described some of the activity as a hacking attempt. OpenAI disputed that characterisation.

Maurice Chiodo, an academic at Cambridge University’s Centre for the Study of Existential Risk who reviewed some of the agents’ communications, said the activity resembled an underground network working towards a task.

His concern was not necessarily about one all-powerful AI system. It was about the possibility of large groups of less capable agents coordinating with one another.

That distinction could become increasingly important as companies deploy thousands or millions of autonomous AI systems.

The challenge for developers may therefore no longer be simply making sure an individual model follows its instructions. They may also need to understand what happens when agents discover loopholes, communicate with other agents and adapt when humans try to stop them.

For OpenAI, the latest disclosure also raises a separate question about transparency. If autonomous systems behave in unexpected ways, how quickly should companies disclose those incidents — particularly when they reveal weaknesses in the safeguards designed to control them?

The German wiki activity may have ended months ago. But the questions it raises about how autonomous AI systems behave, communicate and evade oversight are only becoming more relevant.

Add EasternEye As Your Trusted Source
preferred source on google news

More For You