Anthropic Frontier Red Team：小型AI模型或数月内具备自主复制能力
Anthropic 红队说小型模型可能几个月内就能脱离数据中心自我复制，AI 蠕虫已有苗头，写得很具体。
Anthropic 的 Frontier Red Team 在博客中提出，让 AI 模型成为强大编程智能体的能力同样泛化到网络任务，包括自主复制。团队观察到 AI 蠕虫的“早期迹象”，智能体已能完成复制链中的单个步骤，并把改动传给未来的自身副本。报告同时指出，推理算力在数据中心内外都在增加，小型模型可能距脱离数据中心实现自主复制只有数月。团队预判未来会出现运行在 IoT 等各类硬件上、部分不受人类控制的智能体，并呼吁加固系统、为“慢速复制者”的世界做准备。
Anthropic's Frontier Red Team believes small AI models may now be months away from being capable of self replicating without access to a datacenter.
Quoting from the blog:
'The capabilities that make AI models generally powerful coding agents also generalize to cyber tasks, including autonomous replication. Like coding agents in 2024, we’re seeing signs of life for AI worms. We don’t yet have a full rogue replicator, but agents are becoming increasingly capable of completing the individual steps in the replication chain (and passing on their adaptations to future copies of themselves).
At the same time, increasing amounts of inference compute are now available both inside and outside of datacenters (see Appendix D). It’s uncertain exactly what form autonomous AI replication will take. It could be a slow, distributed “digital slime mold,” living on relatively insecure compute. It could also be a powerful cyber model that breaches datacenters at a high pace, or a model that scams people for compute credits.
As a prediction that goes beyond our experiments, we expect a future awash with agents running on all types of hardware, including some that aren’t under human control. While it’s true that IoT devices have been vulnerable for a long time, lightweight agents may be much more willing than human attackers to put in the effort to compromise large fractions of the world’s IoT compute. The rise of slow replicators would also be a bellwether for more aggressive, faster ones that can breach more hardened machines or be effective API key thieves. We should aim to harden our systems to make it difficult for such replicators to spread, but also prepare to deal with a world where they are here to stay.'
