Anthropic 安全草案拟以“致 50 人以上伤亡”作为模型发布拦截阈值
Anthropic 的安全法案把 50 人伤亡当红线,有人拿 1999 年基因治疗死一个就整顿十年的案例对比,风险文化差别很扎眼。
Anthropic 提交的 AI 安全法案草案把“造成超过 50 人死亡或重伤”设定为阻止模型发布的风险阈值。生物学家 Jake Wintermute 对比 1999 年基因治疗临床试验中 Jesse Gelsinger 一人死亡的案例:该试验所属研究所被解散,主导科学家被禁止从事临床工作 5 年,基因治疗领域经费和研究活动在此后十年大幅缩水。Wintermute 认为科技行业与生物技术行业的风险文化差异巨大,随着 AI 公司越来越多涉足生物医学研究,这种冲突难以避免。Gary Marcus 转发了这一讨论并质疑由企业自己掌控的“benefit fund”能否弥补相应责任。
if we give put enough stock in a “benefit fund” that we control, you won’t be too mad if a lot of people die on our watch, right? Jake Wintermute 🧬/acc @SynBio1 Anthropic's proposed AI safety bill sets "killing or seriously injuring more than 50 people" as the risk threshold for blocking the release of an AI model In contrast, when a single patient (Jesse Gelsinger) died in a gene therapy clinical trial in 1999: - The institute that ran the trial was dissolved - The senior scientist running the trial was banned from clinical work for 5 years - Gene therapy saw deep cuts in funding and research activity for a decade Tech and biotech have just profoundly different cultures of risk. As AI companies increasingly engage with biomedical research, a culture clash is inevitable politico.com/news/2026/10/1… 🔗 View Quoted Tweet 💬 1 🔄 1 ❤️ 5 👀 929 📊 1 ⚡