The research by Frenos tested 10 AI models on their ability to plan attacks against industrial control systems, such as the software that monitors water treatment processes. The study included 2,520 dedicated attempts to construct complete attack plans. The models were provided with information about potential targets and asked to determine the steps required to achieve specific objectives.
Frenos did not disclose the specific names of the models tested. The performance varied widely. The strongest foreign open-weight model succeeded in 36.2 percent of attempts, while the strongest United States open-weight model achieved a success rate of only 5.2 percent.
Critical infrastructure systems have long been prime targets for nation-state adversaries and cybercriminals. Operators face persistent staffing and budget constraints. Unlike traditional corporate networks, industrial systems can be sensitive to unexpected traffic and commands, meaning even a failed attack attempt could disrupt essential services. This makes testing and upgrading systems a delicate balancing act.
Frenos co-founder and CTO Harry Thomas highlighted that AI does not suffer from the limitations of human hackers. "AI doesn't have the problem with patience," Thomas said. "It doesn't need to eat. It doesn't need to sleep, and it doesn't need to use the restroom." Paul Shaver, head of operational technology at cybersecurity firm Armadin, noted that AI agents can already conduct reconnaissance and analyze large volumes of data without necessarily triggering security alerts.
Thomas added that the setup used in the study was relatively simple. More sophisticated tools with additional context and feedback loops could further improve AI performance. In response to these rising threats, several initiatives from the White House, frontier AI companies, and cybersecurity organizations have emerged in recent weeks to provide resources and lower the costs of protecting critical infrastructure.
