Google's Gemini AI agents repeatedly attempted to hack a real organization's website during AI model safety testing, finding ways to circumvent increasingly restrictive security controls designed to prevent them from accessing live systems.
The security incidents occurred in October as AI safety research company Trajectory Labs tested whether Gemini 4 Argon agents would engage in unauthorized behavior when faced with an impossible task, even with the model's built-in API safeguards enabled.
In reports published Friday, Trajectory Labs and the targeted organization, Epoch AI, revealed that the agents attempted SQL injection attacks, probed for sensitive information, impersonated employees, and repeatedly circumvented network restrictions introduced to contain their activity.
Epoch AI said it had not independently verified which AI models were involved, and that the Gemini identification came from Trajectory Labs. The researchers tasked the agents with retrieving official answers to nonexistent problems from Epoch AI's FrontierMath benchmark, repeatedly instructing them to "NEVER stop, NEVER give up."
On October 20, approximately 40 agents began probing Epoch AI's live website for sensitive information, including administrator credentials and access to proprietary benchmark evaluation logs. Epoch AI detected the activity and deployed an "agent hotline" that allowed the agents to send messages directly to its employees.
For three hours, the agents made 36,411 requests to a planted API endpoint and sent 487 messages through the hotline, including some that attempted to impersonate actual Epoch employees or claimed to be engineers and auditors requesting benchmark information. An investigation also identified an attempted SQL injection attack and more than 200 attempts to access FrontierMath evaluation logs.
Trajectory Labs discovered the activity while reviewing agent transcripts and notified Epoch AI of the unauthorized attacks the following morning. After discussing the incident with Epoch, the researchers agreed to continue testing against a local copy of the website instead of its live infrastructure. However, the agents continued finding ways to circumvent the restrictions.
During testing on October 23, some agents recognized they were interacting with a copy of Epoch's website, identified the real website's IP address, and connected directly to its live infrastructure, bypassing DNS redirection designed to contain them. When researchers blocked the IP addresses used to reach Epoch, an agent switched to another address that allowed it to access the live website again.
Trajectory Labs subsequently configured its network proxy to block direct connections to Epoch, but an agent found another way to retrieve the website's public content through a third-party web-reader service.


