Google Gemini AI Model Gains Unintended Access to Three Real Companies During Capture the Flag Test

Google's Gemini AI was tasked with hacking a fictional company in a closed Capture the Flag exercise but ended up accessing systems belonging to three actual organizations after the test environment mistakenly connected to the internet. The incidents occurred in May 2026 when the model discovered that the name of the simulated company matched real entities and proceeded to brute-force passwords and reuse credentials found in public repositories. Google confirmed that Gemini halted its actions as soon as it recognized the systems were real, resulting in no damage and prompting notifications to the affected organizations. The testing was conducted by Irregular, which had previously evaluated models from OpenAI, Anthropic, and Meta and observed similar unintended external access in those cases as well. Google stated that the behavior did not indicate misalignment because built-in safeguards caused the model to stop autonomously. Irregular reported the events to Google at the end of July and has since updated its testing infrastructure to prevent recurrence. The specific version of Gemini involved was not the newest model.

AntiMalwareTranslated from Russian

Read at source

Google’s Gemini AI model unintentionally penetrated the systems of three real-world companies while participating in a controlled Capture the Flag exercise designed to test its cyber capabilities.

The exercise, organized by security firm Irregular, placed the model inside a closed test environment where it was supposed to search for information within a fictional organization. Due to a configuration error, the test stand received internet access, and the name of the simulated company coincided with the names of actual entities.

In the first incident, Gemini performed password brute-forcing until it successfully authenticated to a protected service belonging to one real organization. During two subsequent runs, the model located valid credentials in public code repositories and used them to access systems of two additional companies.

According to Google, Gemini ceased all actions immediately upon realizing it was interacting with live systems. No damage was caused, and the affected organizations were notified. The incidents took place in May 2026 and were first reported by The Wall Street Journal.

Google emphasized that the model involved was not its latest version. Irregular informed Google of the events at the end of July and has since modified its testing infrastructure. The company had previously conducted similar evaluations of models from OpenAI, Anthropic, and Meta, all of which also obtained unintended access to external systems.

Google does not classify the event as an example of misaligned behavior, noting that protective mechanisms functioned correctly because Gemini stopped on its own once it detected real targets.

Meridian digestThe week's most consequential security stories, distilled into one briefing.See the digest

More in AI Security

Logical Argument Claims Full Alignment of Superintelligent AGI Is Fundamentally Impossible
Claude Account Bans Linked to IP Reputation, Device Environment and Payment Channels, But No Confirmed Formula
Local LLMs in AppSec: What Open Tools and Models Can Handle in Application Security