In a blog post published on Wednesday, the AI company outlined concerns that smaller AI models—possibly by next year—may be able to autonomously self-replicate across a wide range of IoT devices. This capability could eventually enable computer worms that propagate without requiring human interaction and can infect unfamiliar devices.
Anthropic noted that an experiment it recently performed revealed significant challenges in building such an AI malware replicator, tempering the immediate risk. However, the findings still raise concerns about new forms of computer worms that are harder to stop.
“A replicator like this would be challenging to shut down, since there’s no centralized point to shut off—though it may be slow (with a doubling time of days),” the company wrote. “Unlike non-AI malware, it could also figure out unfamiliar devices on its own.”