Nathan Lambert:开源模型对网络防御的利大于弊
RLHF 那本书的作者 Nathan Lambert 出来唱反调,说开源模型是网络防御的帮手而不是灾难源头,安全圈的末日叙事被他逐条拆了。
Nathan Lambert 发文反驳围绕开源模型与网络攻击的宿命论式 AI 风险论调。他认为任何 AI 发展路径下网络攻击事件都会大量存在,开源权重并非决定性因素。他引用网络安全社区的判断:在未来 12 个月内,开源模型反而是支撑网络防御的重要力量。他的核心观点是,开源模型带来的攻防平衡比安全圈普遍讨论的要稳健。
The point of this is that the balance of having open models help with cyber defense, and the trajectory we’re on being well more fine than people think.
It’s not that open weights won’t be used in cyber attacks. All possible AI trajectories had many cyber incidents imo.
Like many things I do, I’m trying to challenge the fatalistic, largely ai doom / ai safety discourse around cyber and open models, because there’s a credible part of the cyber community that thinks open models are a big part of holding things together in the next 12 months.