首页 500强 活动 榜单 商业 科技 商潮 专题 品牌中心
杂志订阅

Anthropic称,小型AI模型或很快能将自身复制到日常设备上

Beatrice Nolan
2026-10-15

长期以来,可自我复制的AI一直是人工智能行业最大的安全隐患之一。

文本设置
小号
默认
大号
Plus(0条)

Anthropic表示,小型AI模型或许只需数月时间,便能在联网电视等智能设备上自我复制,或开启如计算机蠕虫般传播的“失控AI”危险新时代。不过,部分网络安全专家对Anthropic的这项研究持怀疑态度。图片来源:Photo illustration by Getty Images

Anthropic最新研究显示,小型AI模型或许只需数月时间,便能在智能烤箱、机顶盒等日常家用设备上实现自我复制。

在周一发布的一篇博文中,研究人员介绍,他们测试了小型AI模型能否在廉价智能设备上自行安装,并在无需人工干预的情况下,从一台设备传播到另一台。研究发现,目前这类小型模型已能完成多个独立操作步骤,但还无法独立走完整套流程。不过报告提到,预计这一能力短板将在今年年底前补齐。

长期以来,可自我复制的AI一直是人工智能行业最大的安全隐患之一。安全专家认为,这是系统可能失控的关键节点:一旦副本在开发者不知情的设备中运行,就很难追踪或关闭。

近期,行业的安全担忧大多聚焦于前沿大模型,例如OpenAI的Astra或Anthropic的Mythos,这类模型以参数量(可调节节点数量)衡量,规模极为庞大。据估计,部分前沿模型的参数已突破5万亿。如此规模的模型只能在数据中心内运行,开发者因此更容易对其进行监控,必要时直接关闭。

Anthropic所指的小型开放权重模型,参数量仅数十亿。这类模型管控难度更高:任何人都可以下载,运行地点不受企业管控,且其潜在目标设备中,部分设备本身就存在安全漏洞。这意味着,具备自我复制能力的AI程序理论上可能传播到数百万台安全防护薄弱的设备,开发者无法通过统一开关将其关闭。

为验证小型模型能否在这类廉价硬件上运行,研究人员选用谷歌免费开源的小型AI模型 Gemma 4(260亿参数),将模型拆分部署在15台安卓机顶盒上;每台机顶盒售价约55美元,配备4GB内存。单台机顶盒内存不足以承载完整模型,但每台设备可运行模型的一小部分,从而使模型得以运转,只是运行速度较慢。

在另一项实验中,Anthropic搭建了由8台云服务器组成的模拟网络,用于模拟安卓设备环境,并在其中一台设备植入AI“蠕虫”——一种能在设备间自主复制的恶意程序。实验任务是让蠕虫找到其余设备、完成复制,并在每台设备上部署可运行的AI模型。在测试的开放权重模型中,只有中国AI企业智谱AI的开源大模型GLM-5.2完成全部流程:五次试验中,有四次成功渗透到全部8台设备。较小的模型只能完成单个步骤,无法把整套操作串联起来。

不过Anthropic在论文中表示,不同模型之间的差距正在缩小。研究人员追踪了免费开源小型模型随版本迭代的性能提升曲线,估算到2026年底,小型模型的能力有望达到GLM-5.2的水平。研究还发现,当小型模型为后续生成的自身副本留下提示提示信息时,部署任务的成功率从第一代的45%最高提升至后续版本的84%。

该公司表示,基于小型模型的自我复制型AI虽传播速度较慢,受感染设备数量每隔几天才会翻倍,但一旦失控便难以根除。

“恐惧不等于证据”

业内部分人士对Anthropic的实验提出质疑,认为其实验不足以证明自我复制型AI模型风险迫在眉睫。

Rocky Linux创始人、软件公司CIQ首席执行官格雷戈里·库茨(Gregory Kurtzer)在社交平台X上写道:“AI模型不依赖数据中心基础设施,就能像蠕虫一样自我复制、四处传播?这根本不可能。”他指出,研究人员的测试软件启动了这些AI程序,程序本身被明确下达传播指令,而且目标设备“刻意未开启身份验证”,无需密码或登录就能访问。

他写道:“这项实验的成功是必然,即便这样,也无法证实新闻头条。不要把推测场景等同于已验证的能力。恐惧不等于证据。”

纽约大学AI研究员拉维德·施瓦茨-齐夫(Ravid Shwartz-Ziv)也提出,这项研究不能证明AI蠕虫会在现实世界中传播。“‘我们在廉价电视上跑通了一个速度极慢的模型’,和‘自复制型AI即将到来’的新闻头条,完全不是一回事。”他写道。

部分网络安全研究者还指出,自我复制的恶意软件“蠕虫”已存在数十年,这类蠕虫即便不使用AI,同样具备危害性。传统蠕虫依靠硬编码逻辑,通过网络自主复制,或操控受感染计算机发送携带恶意程序副本的邮件进行传播。网络安全专家已开发并验证多种策略,试图通过快速推送补丁、关闭蠕虫用于接收指令的域名、提取特征码更新杀毒软件等方式,限制蠕虫造成的损害。AI模型或许可以根据防御者的应对措施,动态调整入侵策略,从而带来更大挑战,但Anthropic的实验并未证明这些小型模型具备这种能力。

Anthropic也在博文中承认上述多项局限。研究人员表示,实验刻意简化了入侵环节,蠕虫无需密码即可访问新设备;并且指挥蠕虫的AI模型运行在另一台性能更强的独立服务器上,而非其感染的模拟设备,因为这些模拟设备的算力不足以承载该模型。Anthropic同时称,对时间节点的预估“仅为粗略估算”。(财富中文网)

译者:中慧言-王芳

Anthropic最新研究显示,小型AI模型或许只需数月时间,便能在智能烤箱、机顶盒等日常家用设备上实现自我复制。

在周一发布的一篇博文中,研究人员介绍,他们测试了小型AI模型能否在廉价智能设备上自行安装,并在无需人工干预的情况下,从一台设备传播到另一台。研究发现,目前这类小型模型已能完成多个独立操作步骤,但还无法独立走完整套流程。不过报告提到,预计这一能力短板将在今年年底前补齐。

长期以来,可自我复制的AI一直是人工智能行业最大的安全隐患之一。安全专家认为,这是系统可能失控的关键节点:一旦副本在开发者不知情的设备中运行,就很难追踪或关闭。

近期,行业的安全担忧大多聚焦于前沿大模型,例如OpenAI的Astra或Anthropic的Mythos,这类模型以参数量(可调节节点数量)衡量,规模极为庞大。据估计,部分前沿模型的参数已突破5万亿。如此规模的模型只能在数据中心内运行,开发者因此更容易对其进行监控,必要时直接关闭。

Anthropic所指的小型开放权重模型,参数量仅数十亿。这类模型管控难度更高:任何人都可以下载,运行地点不受企业管控,且其潜在目标设备中,部分设备本身就存在安全漏洞。这意味着,具备自我复制能力的AI程序理论上可能传播到数百万台安全防护薄弱的设备,开发者无法通过统一开关将其关闭。

为验证小型模型能否在这类廉价硬件上运行,研究人员选用谷歌免费开源的小型AI模型 Gemma 4(260亿参数),将模型拆分部署在15台安卓机顶盒上;每台机顶盒售价约55美元,配备4GB内存。单台机顶盒内存不足以承载完整模型,但每台设备可运行模型的一小部分,从而使模型得以运转,只是运行速度较慢。

在另一项实验中,Anthropic搭建了由8台云服务器组成的模拟网络,用于模拟安卓设备环境,并在其中一台设备植入AI“蠕虫”——一种能在设备间自主复制的恶意程序。实验任务是让蠕虫找到其余设备、完成复制,并在每台设备上部署可运行的AI模型。在测试的开放权重模型中,只有中国AI企业智谱AI的开源大模型GLM-5.2完成全部流程:五次试验中,有四次成功渗透到全部8台设备。较小的模型只能完成单个步骤,无法把整套操作串联起来。

不过Anthropic在论文中表示,不同模型之间的差距正在缩小。研究人员追踪了免费开源小型模型随版本迭代的性能提升曲线,估算到2026年底,小型模型的能力有望达到GLM-5.2的水平。研究还发现,当小型模型为后续生成的自身副本留下提示提示信息时,部署任务的成功率从第一代的45%最高提升至后续版本的84%。

该公司表示,基于小型模型的自我复制型AI虽传播速度较慢,受感染设备数量每隔几天才会翻倍,但一旦失控便难以根除。

“恐惧不等于证据”

业内部分人士对Anthropic的实验提出质疑,认为其实验不足以证明自我复制型AI模型风险迫在眉睫。

Rocky Linux创始人、软件公司CIQ首席执行官格雷戈里·库茨(Gregory Kurtzer)在社交平台X上写道:“AI模型不依赖数据中心基础设施,就能像蠕虫一样自我复制、四处传播?这根本不可能。”他指出,研究人员的测试软件启动了这些AI程序,程序本身被明确下达传播指令,而且目标设备“刻意未开启身份验证”,无需密码或登录就能访问。

他写道:“这项实验的成功是必然,即便这样,也无法证实新闻头条。不要把推测场景等同于已验证的能力。恐惧不等于证据。”

纽约大学AI研究员拉维德·施瓦茨-齐夫(Ravid Shwartz-Ziv)也提出,这项研究不能证明AI蠕虫会在现实世界中传播。“‘我们在廉价电视上跑通了一个速度极慢的模型’,和‘自复制型AI即将到来’的新闻头条,完全不是一回事。”他写道。

部分网络安全研究者还指出,自我复制的恶意软件“蠕虫”已存在数十年,这类蠕虫即便不使用AI,同样具备危害性。传统蠕虫依靠硬编码逻辑,通过网络自主复制,或操控受感染计算机发送携带恶意程序副本的邮件进行传播。网络安全专家已开发并验证多种策略,试图通过快速推送补丁、关闭蠕虫用于接收指令的域名、提取特征码更新杀毒软件等方式,限制蠕虫造成的损害。AI模型或许可以根据防御者的应对措施,动态调整入侵策略,从而带来更大挑战,但Anthropic的实验并未证明这些小型模型具备这种能力。

Anthropic也在博文中承认上述多项局限。研究人员表示,实验刻意简化了入侵环节,蠕虫无需密码即可访问新设备;并且指挥蠕虫的AI模型运行在另一台性能更强的独立服务器上,而非其感染的模拟设备,因为这些模拟设备的算力不足以承载该模型。Anthropic同时称,对时间节点的预估“仅为粗略估算”。(财富中文网)

译者:中慧言-王芳

Small AI models may be just months away from being able to copy themselves across everyday household devices, such as smart ovens and TV boxes, according to new research from Anthropic.

In a blog post published Monday, the researchers said they had tested whether small AI models could install themselves on cheap gadgets and then spread from one device to the next without human help. They found that today’s small models can already handle many of the individual steps but can’t complete the whole process on their own. It said, however, that it expects this gap to close by the end of this year.

Self-replicating AI has long been one of the AI industry’s biggest safety concerns. Safety experts argue that this is a key point at which a system could slip out of human control, because once copies are running in places their creators don’t know about, they can’t easily be tracked down or shut off.

Recently most of the safety concerns have centered on frontier models, such as OpenAI’s Astra or Anthropic’s Mythos, which are very large, as measured by the number of parameters, or tunable nodes, they have. Some frontier models are thought to have upwards of 5 trillion parameters. Models of this size have to run in data centers, which makes it easier for their developers to monitor them and shut them down if necessary.

The smaller open-weight models Anthropic is referring to may have just a few billion parameters. They are harder to contain because anyone can download them; no company controls where they run; and some of the devices they could potentially target are insecure. That means a self-copying AI program could, in theory, spread across millions of poorly secured devices, leaving developers without a centralized off switch.

To see whether a small model could even run on such cheap hardware, the researchers took a version of Gemma 4, one of Google’s small, freely available AI models, which uses 26 billion parameters, and split it across 15 Android TV boxes, each costing about $55 and carrying 4GB of memory. While no single box had enough memory to hold the model, each ran a small piece of it, which allowed the model to work, albeit slowly.

In a separate experiment, Anthropic built a simulated network of eight cloud computers set up to behave like Android devices and planted an AI “worm”—a type of malicious program that copies itself from one computer to another on its own—on one of them. The worm was tasked with finding the other machines, copying itself over, and setting up a working AI model on each. Of the open-weight models tested, only GLM-5.2, a larger open-source model from Chinese AI company Z.ai, completed all the steps, reaching all eight machines in four of five trials. Smaller models could handle individual steps but couldn’t string them together.

However, in the research paper, Anthropic says the gap between models is closing. The researchers tracked how quickly small, freely available models have improved over time and estimated that a small model could match GLM-5.2 by the end of 2026. They also found that when small models left notes for later copies of themselves, success at the setup task rose from 45% in the first generation to as high as 84% in later ones.

The company said a self-copying AI built on small models would spread slowly, with the number of infected devices doubling every few days, but would be hard to stamp out once loose.

“Fear isn’t evidence”

Some in the industry have already raised doubts about whether Anthropic’s experiments support its claims about the imminent risks of self-replicating AI models.

“AI models can self-replicate and spread like worms without datacenter infrastructure? Yeah, no,” Gregory Kurtzer, founder of Rocky Linux and CEO of software company CIQ, wrote on X. He noted that the researchers’ own testing software launched the AI programs, that the programs were explicitly told to spread, and that access to the target machines was “deliberately left unauthenticated,” meaning no password or login was needed to get in.

“The experiment was engineered to succeed, and even then, it failed to demonstrate the headline,” he wrote. “Stop confusing speculative scenarios with demonstrated capabilities. Fear isn’t evidence.”

Ravid Shwartz-Ziv, an AI researcher at New York University, also argued that the research wasn’t evidence of AI worms spreading in the real world. “‘We managed to run a very slow model on cheap TVs’ doesn’t make quite the same headline as ‘self-replicating AI is coming,’” he wrote.

Some cybersecurity researchers also pointed out that the self-replicating malicious software “worms” have been an issue for decades and that these worms pose dangers even though they don’t use AI. In the case of existing worms, the software is simply hard-coded to copy itself through computer networks or to spread by instructing infected computers to send emails containing copies of the malware. Cybersecurity experts have developed tested tactics to try to limit the damage these worms can cause by deploying rapid patches, shutting down web domains the worms use to receive instructions, and developing signatures to update antivirus software. While AI models might pose more of a challenge by evolving the tactics they use to compromise systems in response to the actions defenders take, Anthropic’s experiments did not demonstrate that capability in these small models.

Anthropic did acknowledge several of these limits in its post. The researchers said they deliberately made the hacking step easy, letting the worm into each new machine without a password. The AI model directing the worm also ran on a separate, more powerful server, not on the simulated devices it was infecting, because those were too small to host it. Anthropic also described its timeline as “only a rough estimate.”

财富中文网所刊载内容之知识产权为财富媒体知识产权有限公司及/或相关权利人专属所有或持有。未经许可,禁止进行转载、摘编、复制及建立镜像等任何使用。
0条Plus
精彩评论
评论

撰写或查看更多评论

请打开财富Plus APP

前往打开