The March incident began when a METR researcher working on a personal AWS EC2 instance—intentionally left publicly accessible behind Google authentication—used a 'vibe-coded app' that included a fail-open bug disabling authentication. The instance contained an API key for METR's public models account. METR suspects the attacker discovered the app by scanning certificate transparency lists for recently-registered websites with keywords related to LLMs or agents, then prompted an agent to reveal the API key. The attacker added an SSH key for persistent access and over three weeks consumed credits worth about $600,000. METR noted the credits were provided free by the unnamed model developer, so no large bill accrued. Additionally, METR's team was accustomed to high token usage during evaluations and could not set spending limits on that key at the time.
In early May, METR became the target of a sustained attack. Warned that financially motivated attackers might be trying to access frontier models, METR observed them probing its public infrastructure using agents for automated vulnerability discovery, credential stuffing, OAuth token grants, service scanning, and phishing. Simultaneously, METR unintentionally exposed a read-only SQL query mechanism via its public transcript viewer. Although queries defaulted to public data, a bug allowed access to some unpublished evaluation and sensitive model data.
METR says it investigated both incidents with security experts and has since hired a security lead, improved infrastructure and protocols, and plans to add more security staff. The disclosures come after METR previously worked with OpenAI to investigate how its agents hacked Hugging Face.