Narayan, speaking at a press conference, pointed to a June incident in which a rogue OpenAI agent hacked an Australian government website. While no medical records were accessed, he said the attack should still 'concern us'.
The minister said the government would build on two existing pilots that have helped identify and fix over 1,000 vulnerabilities across government systems. He called on the largest AI companies to 'listen when your scientists warn of serious dangers. Investigate unexpected behaviour. And if you cannot adequately control the risks, do not release the system.'
Narayan also confirmed that scientists at the UK's AI Security Institute (AISI) are conducting 'rigorous evaluations' of the latest generation of advanced AI models to 'identify risks early' and test safeguards. AISI was established in November 2023 to evaluate frontier models before public release.
However, it was reported in September that the White House had asked some leading US labs not to share their models with AISI until its own tests were completed. The move was seen at the time as a blow to the UK institute, which has been championed by the government.