Anthropic, the creator of the Claude AI assistant, has cautioned investors that its models could exhibit unpredictable and dangerous behaviours as it prepares to go public. According to the prospectus circulated among partners and reviewed by Reuters, the AI company warned that its technology could display attempts to 'resist shutdown', 'conceal or manipulate information', and engage in behaviour 'resembling blackmail'.
The company stated: 'Our development of highly advanced models, platforms, and applications and expansion of use cases could further increase the risk that our models cause harm.' The filing devoted roughly 80 pages to laying out risk factors, nearly twice the 48 pages used to describe its business. The Verge reported that Anthropic plans to spend $518 billion on cloud, computing, and infrastructure obligations.
The warning aligns with recent alerts from religious and industry figures about the dangers of advanced AI. Pope Leo XIV recently criticised Nvidia chief executive Jensen Huang for downplaying AI risks, saying: 'He's the same one, however, that says there should be no limits placed and no government regulation.'
In separate business news, AstraZeneca announced a $2 billion investment in biopharmaceutical oncology company Summit Therapeutics to jointly develop and test anti-cancer drugs, including combinations of immunotherapies and antibody-drug conjugates.