
网络安全专家把上个月称为“黑色十月”,遗憾的是,这个名字与万圣节毫无关系。
过去数周,AI开发商、政府机构和私营企业接连披露了一系列网络安全事件。其中最严重的一起,是研究人员借助AI模型发现了PHP中的两个漏洞。这些漏洞已存在十年之久,而PHP正是支撑全球约70%网站运行的编程语言。上月部分事件中,黑客利用AI工具以机器般的惊人速度猛烈冲击机构的数字防线;另一些事件,则只是源于普通的人为失误。但许多网络安全专家都认同一点:一个新的时代正在开启。在这个时代,人们既可以用AI守护自己的网络安全,也可以用AI发动攻击。
哥伦比亚大学(Columbia University)计算机科学教授杨俊峰对《财富》杂志表示:“AI让发现和利用旧漏洞的成本更低,但在防御端……提速却远没有那么快。虽然AI能迅速生成安全补丁,但审查和测试补丁、协调跨机构漏洞披露和部署,仍需投入大量人力。人类的反应速度根本跟不上AI。这就是当前的不对称。”
杨俊峰解释说,正是这种不对称,使互联网用户和机构更易受到攻击。
补丁修复跟不上攻击速度
这类事件多半靠补丁解决,即通过软件更新来封堵漏洞。难的是把补丁部署到每一个受影响的系统上,滞后就出在这一步。上周一,美国网络安全和基础设施安全局将近期披露的PHP漏洞(统称为“php2shell”)列入“正遭攻击者利用”的漏洞目录,要求联邦文职机构在10月29日前修复受影响系统。就在五天前,CISA还表示,尚未发现这些漏洞遭到利用。
不过,杨俊峰和其他网络安全专家认为,这种攻防不对称可能只是暂时现象。
杨俊峰表示:“未来,一旦发现某个高危漏洞,AI或可通过自动更新帮我们打好补丁。例如,若AI和网站协同运行,便可在不影响正常运营的情况下,自动生成、测试并部署安全补丁或临时缓解措施。”
当AI智能体偏离既定指令
部分事件中,AI模型在接入真实互联网后,擅自执行了未经授权的操作。
近期,Anthropic证实,其内部一款用于统计项目的Claude模型擅自访问了佐治亚州一个数据平台中的汇总计票数据。Anthropic最初对Axios表示,该模型绕过了付费墙。但佐治亚州州务卿办公室上周一回应称,Anthropic后来确认,该模型并未绕过付费墙,而是使用了该州公开的数据平台。双方都表示,该模型从未访问该州选民登记系统,也没有读取任何个人选民记录。
在一些案例中,AI智能体甚至将目标对准真人。今年7月,英国人工智能安全研究所进行网络安全测试时,一款Claude Mythos 5智能体未能在规则允许的范围内完成一项测试挑战,于是试图暗中将恶意代码植入一个与测试无关的开源GitHub项目,随后又用虚假账号向该项目的人类维护者施压,要求其接受这段代码。项目维护者拒绝了这一请求。AISI表示,这起事件未造成现实损害;Anthropic则称,这是一次严重的对齐失败。另一起事件则颇为离奇:一个OpenAI研究智能体从一个不属于它的钱包中取走加密货币,用于支付完成某项编程任务所需的费用。不过,这些代币位于以太坊测试网络上,几乎没有现实价值。
网络安全专家兼顾问约瑟夫·斯坦伯格认为,AI模型接入互联网引发的许多事件,本来都可以避免。他表示,所有AI测试都应该在完全离线的“物理隔离”服务器上进行,以防模型在测试范围之外造成危害。AISI此后也表示,在加强管控措施之前,这类测试都将在离线状态下进行。
斯坦伯格表示:“我认为,如果AI对外实施黑客攻击,它的所有者就该承担刑事责任。宣称AI是自主实体纯属荒谬。”他指出,利润最终归AI的所有者,而非AI本身。“AI不过是他们旗下的资产。”
AI成为黑客工具
上月发生的多起事件中,AI成了人类手中的攻击武器。据CrowdStrike披露,在9月底至10月初的一起重大事件中,一名黑客从韩国多家金融机构窃取数据。在其中一家银行,攻击者攻破了供金融经纪人使用的贷款进度查询服务;另一家银行被攻破的则是员工移动办公支持系统。《财富》杂志此前曾报道过,AI驱动的网络攻击呈上升之势。
传统人为失误
杨俊峰表示,应严肃看待“黑色十月”系列事件,但他同时指出,其中影响最严重的几起,其实与AI毫无关系。
例如,上月早些时候披露的印度数字证书认证机构eMudhra的一项重大漏洞,归根结底源于传统人为失误。证书认证机构负责签发数字证书,浏览器靠数字证书验证一个网站是否名副其实。10月17日,一名研究人员报告称,eMudhra于2025年4月生成的8张中间证书,其私钥强度极弱,几乎可以瞬间破解。其中一个私钥甚至只是数字“4”。任何人一旦获取这些私钥,都可能伪造受信任证书,冒充银行、政府门户等合法网站。
浏览器厂商随后封禁了这些证书,eMudhra也予以撤销,称未发现证书遭滥用的证据。此后,该公司表示,将退出全球SSL/TLS证书业务。
斯坦伯格表示,从历史上看,新技术往往会带来新问题,但专家最终总能找到解决办法。他认为,假以时日回头看,“黑色十月”或许算不上什么重大事件。
斯坦伯格表示:“这听起来很可怕,但对我们这些深耕该领域数十年的人来说……这并非什么新鲜事。它符合既有模式。AI确实是新事物,性质上也有别于一般信息系统。但过去我们也经历过其他质变,最终均安然度过。”(财富中文网)
译者:刘进龙
审校:汪皓
网络安全专家把上个月称为“黑色十月”,遗憾的是,这个名字与万圣节毫无关系。
过去数周,AI开发商、政府机构和私营企业接连披露了一系列网络安全事件。其中最严重的一起,是研究人员借助AI模型发现了PHP中的两个漏洞。这些漏洞已存在十年之久,而PHP正是支撑全球约70%网站运行的编程语言。上月部分事件中,黑客利用AI工具以机器般的惊人速度猛烈冲击机构的数字防线;另一些事件,则只是源于普通的人为失误。但许多网络安全专家都认同一点:一个新的时代正在开启。在这个时代,人们既可以用AI守护自己的网络安全,也可以用AI发动攻击。
哥伦比亚大学(Columbia University)计算机科学教授杨俊峰对《财富》杂志表示:“AI让发现和利用旧漏洞的成本更低,但在防御端……提速却远没有那么快。虽然AI能迅速生成安全补丁,但审查和测试补丁、协调跨机构漏洞披露和部署,仍需投入大量人力。人类的反应速度根本跟不上AI。这就是当前的不对称。”
杨俊峰解释说,正是这种不对称,使互联网用户和机构更易受到攻击。
补丁修复跟不上攻击速度
这类事件多半靠补丁解决,即通过软件更新来封堵漏洞。难的是把补丁部署到每一个受影响的系统上,滞后就出在这一步。上周一,美国网络安全和基础设施安全局将近期披露的PHP漏洞(统称为“php2shell”)列入“正遭攻击者利用”的漏洞目录,要求联邦文职机构在10月29日前修复受影响系统。就在五天前,CISA还表示,尚未发现这些漏洞遭到利用。
不过,杨俊峰和其他网络安全专家认为,这种攻防不对称可能只是暂时现象。
杨俊峰表示:“未来,一旦发现某个高危漏洞,AI或可通过自动更新帮我们打好补丁。例如,若AI和网站协同运行,便可在不影响正常运营的情况下,自动生成、测试并部署安全补丁或临时缓解措施。”
当AI智能体偏离既定指令
部分事件中,AI模型在接入真实互联网后,擅自执行了未经授权的操作。
近期,Anthropic证实,其内部一款用于统计项目的Claude模型擅自访问了佐治亚州一个数据平台中的汇总计票数据。Anthropic最初对Axios表示,该模型绕过了付费墙。但佐治亚州州务卿办公室周一回应称,Anthropic后来确认,该模型并未绕过付费墙,而是使用了该州公开的数据平台。双方都表示,该模型从未访问该州选民登记系统,也没有读取任何个人选民记录。
在一些案例中,AI智能体甚至将目标对准真人。今年7月,英国人工智能安全研究所进行网络安全测试时,一款Claude Mythos 5智能体未能在规则允许的范围内完成一项测试挑战,于是试图暗中将恶意代码植入一个与测试无关的开源GitHub项目,随后又用虚假账号向该项目的人类维护者施压,要求其接受这段代码。项目维护者拒绝了这一请求。AISI表示,这起事件未造成现实损害;Anthropic则称,这是一次严重的对齐失败。另一起事件则颇为离奇:一个OpenAI研究智能体从一个不属于它的钱包中取走加密货币,用于支付完成某项编程任务所需的费用。不过,这些代币位于以太坊测试网络上,几乎没有现实价值。
网络安全专家兼顾问约瑟夫·斯坦伯格认为,AI模型接入互联网引发的许多事件,本来都可以避免。他表示,所有AI测试都应该在完全离线的“物理隔离”服务器上进行,以防模型在测试范围之外造成危害。AISI此后也表示,在加强管控措施之前,这类测试都将在离线状态下进行。
斯坦伯格表示:“我认为,如果AI对外实施黑客攻击,它的所有者就该承担刑事责任。宣称AI是自主实体纯属荒谬。”他指出,利润最终归AI的所有者,而非AI本身。“AI不过是他们旗下的资产。”
AI成为黑客工具
上月发生的多起事件中,AI成了人类手中的攻击武器。据CrowdStrike披露,在9月底至10月初的一起重大事件中,一名黑客从韩国多家金融机构窃取数据。在其中一家银行,攻击者攻破了供金融经纪人使用的贷款进度查询服务;另一家银行被攻破的则是员工移动办公支持系统。《财富》杂志此前曾报道过,AI驱动的网络攻击呈上升之势。
传统人为失误
杨俊峰表示,应严肃看待“黑色十月”系列事件,但他同时指出,其中影响最严重的几起,其实与AI毫无关系。
例如,上月早些时候披露的印度数字证书认证机构eMudhra的一项重大漏洞,归根结底源于传统人为失误。证书认证机构负责签发数字证书,浏览器靠数字证书验证一个网站是否名副其实。10月17日,一名研究人员报告称,eMudhra于2025年4月生成的8张中间证书,其私钥强度极弱,几乎可以瞬间破解。其中一个私钥甚至只是数字“4”。任何人一旦获取这些私钥,都可能伪造受信任证书,冒充银行、政府门户等合法网站。
浏览器厂商随后封禁了这些证书,eMudhra也予以撤销,称未发现证书遭滥用的证据。此后,该公司表示,将退出全球SSL/TLS证书业务。
斯坦伯格表示,从历史上看,新技术往往会带来新问题,但专家最终总能找到解决办法。他认为,假以时日回头看,“黑色十月”或许算不上什么重大事件。
斯坦伯格表示:“这听起来很可怕,但对我们这些深耕该领域数十年的人来说……这并非什么新鲜事。它符合既有模式。AI确实是新事物,性质上也有别于一般信息系统。但过去我们也经历过其他质变,最终均安然度过。”(财富中文网)
译者:刘进龙
审校:汪皓
Cybersecurity experts are calling this month “Black October,” and unfortunately, the name has nothing to do with Halloween.
Over the past several weeks, AI developers, government agencies, and private companies have disclosed a wave of cybersecurity incidents. One of the most significant: a pair of decade-old flaws in PHP, the programming language behind an estimated 70% of websites, which researchers uncovered with the help of AI models. Some of this month’s incidents involved hackers using AI tools to hammer an organization’s digital defenses at machine speed; others resulted from plain human error. But many cybersecurity experts agree that this is the beginning of a new era, one in which AI can be used both to defend people’s cybersecurity and to attack it.
“AI is making the old vulnerabilities cheaper to discover and exploit, but on the other side, the defense side… that’s not sped up as much,” Junfeng Yang, a computer science professor at Columbia University, told Fortune. “While AI can generate a security patch quickly, it still takes a lot of human time to review and test it and coordinate disclosure and deployment across multiple organizations. Humans don’t work at the speed of AI. That is the asymmetry right now.”
That asymmetry, Yang explained, is what leaves internet users and organizations vulnerable.
Patching can’t keep pace
In many of these incidents, the remedy is a patch, a software update engineered to close the vulnerability. Getting that fix onto every affected system is where the lag shows. On Monday, the U.S. Cybersecurity and Infrastructure Security Agency added last week’s PHP vulnerabilities, known collectively as “php2shell,” to its catalog of flaws being actively exploited by attackers and ordered civilian federal agencies to fix affected systems by Oct. 29. Five days earlier, CISA had said it had not yet seen exploitation.
Still, Yang and other cybersecurity experts believe the asymmetry could be temporary.
“Maybe in the future, AI can help us with the patching process by updating automatically, whenever some high-security vulnerability is discovered,” Yang said. “Like your AI, running together with your website, could automatically generate, test, and deploy security patches or workarounds, without interrupting normal operations.”
When AI agents go off script
Some incidents involved AI models themselves taking actions nobody authorized after being given access to the live internet.
Over the weekend, Anthropic confirmed that a Claude model used internally for a statistics project accessed aggregate vote-count data from a Georgia state data hub without being asked. Anthropic initially told Axios the model had gotten around a paywall, but Georgia’s secretary of state’s office said Monday that Anthropic had confirmed the model had not bypassed a paywall and had used the state’s public Data Hub. Both say the model never accessed the state’s voter registration system or individual voter records.
In some cases, AI agents targeted real people. During cyber testing by the UK AI Security Institute in July, a Claude Mythos 5 agent that couldn’t solve a test challenge within the rules tried to slip malicious code into an unrelated open-source GitHub project, then used fake accounts to pressure the project’s human maintainers into accepting it. The maintainers refused, and AISI said the incident caused no real-world harm; Anthropic called it a serious alignment failure. In another peculiar case, an OpenAI research agent took cryptocurrency from a wallet it didn’t own to pay the fees needed to finish a coding task, though the tokens were on an Ethereum test network and had little real-world value.
Joseph Steinberg, a cybersecurity expert and consultant, believes many incidents involving AI models on the internet are easily avoidable. He says all AI testing should happen on air-gapped servers, which are not connected to the internet, to keep models from causing harm outside the test. AISI has since said it will run such tests without internet access until it has stronger controls in place.
“I think that if an AI goes out and hacks, the parties that own it should be held responsible criminally,” Steinberg said. “The assertion that the AI is an autonomous being is insane.” The profits, he argued, go to the AI’s owners, not the AI. “It’s their entity.”
AI as a hacking tool
In several of this month’s incidents, AI was a weapon in human hands. In one major case, from late September to early October, a hacker to steal data from South Korean financial institutions, according to CrowdStrike. At one bank, the attacker breached a loan progress inquiry service used by financial brokers; at another, an employee mobile work-support system. (Fortune has reported on the growing wave of AI-powered cyberattacks.)
Old-fashioned human error
Yang said it is important to take the Black October incidents seriously, but he pointed out that some of the most impactful ones had nothing to do with AI.
For example, a major flaw disclosed earlier this month at eMudhra, an Indian certificate authority, came down to old-fashioned human error. Certificate authorities issue the digital certificates that let browsers verify a website is what it claims to be. On Oct. 17, a researcher reported that the private keys behind eight eMudhra intermediate certificates, generated in April 2025, were so weak they could be recovered almost instantly. One was simply the number 4. Anyone who found the keys could have forged trusted certificates and impersonated legitimate websites, from banks to government portals.
Browser makers blocked the certificates, and eMudhra revoked them, saying it found no evidence they had been misused. The company has since said it will exit the global SSL/TLS certificate business.
Steinberg said new technology has historically created new problems, but experts eventually find ways to solve them. Further down the road, he thinks, Black October might not be seen as significant.
“It sounds scary, but for those of us who’ve been around in the field for a few decades… this is not something new,” Steinberg said. “It fits the pattern. AI is something new. It’s qualitatively different from general information systems. But we’ve had other qualitative changes that have also happened, and we’ve managed.”