前Anthropic员工称AI十年内或致人类灭绝,引发担忧
Bryan Cantrill分享了自己年轻时的错误经历,提醒我们不要滥用专业知识引发公众恐慌,这个观点很实在。
前Anthropic员工Jacob Coxon确认,许多Anthropic研究员认为AI可能在十年内杀死人类。
Coxon提到“黑客攻击关键基础设施”和“灭绝级生物武器”等担忧,但未提供细节。Bryan Cantrill指出,这些说法缺乏专家支持,呼吁AI领域专家谨慎发声,避免引发不必要的恐慌。
The contagion of fear Bryan Cantrill responds to the tweet by former Anthropic employee Jacob Coxon confirming that many Anthropic researchers believe AI "could kill us all by the end of the decade". Bryan shares a story of his own youthful mistakes causing unjustified panic among less technical peers, and warns against doing the same: These ghoulish claims strike brazenly at the hearth, and given the obvious importance of AI, it is unsurprising that they have leapt into the mainstream, with people asking the natural question: how would that happen? The answers always rely on hand-wavy extrapolation into the future; for example, Jacob Coxon cites "hacking critical infrastructure" and "extinction-level bioweapons" without further elaboration. But Coxon is not an expert on critical infrastructure, nor on bioweapons — nor, for that matter, on extinction. [...] That said, we should not expect the public to understand LLMs, critical infrastructure, bioweapons, extinction biology, etc. — that burden must lie with those making the claim. The lesson that I learned (shamefully) decades ago is that domain experts, by way of their expertise, implicitly hold the public’s trust — and we must not abuse it. It is incumbent upon us to be circumspect in our claims — and maximally so when raising the alarm. Bryan talked about his doubts about the bioweapons concerns in the recent episode of Oxide and Friends that I joined. You can hear more of his thoughts on that starting at 51m44s in that episode. Here's 57m04s : I really think we need to be careful because it's so easy to be overcome with fear when we kind of make up these... it can give you biological weapons. Like, how? I mean, can we please have a biologist weigh in on this? Or can we have like someone who's got experience with bioweapons? [...] The bioweapon thing just gets under my fingernails because it leaves so much to the imagination that we insert with fear. Via Lobste.rs Tags: ai , anthropic , bryan-cantrill , ai-ethics
本条情报归属 AITOP「论文」核心栏目,重点聚焦北美前沿实验室与硅谷科技巨头。在跨区域产业观察坐标中,该动态直接关联「各国 AI 监管法案、合规治理与主权算力政策」研究主线,反映出当前技术演进与商业落地的最新风向。涉及核心实体与技术议题包括:Anthropic、Bryan-Cantrill、AI-ethics,读者可通过下方标签进入对应专题页查阅历史脉络与关联对比。
信源核验说明:本文原始线索采编自「Simon Willison’s Weblog」,经 AITOP 多维评分管线结构化提炼。截至目前,全网已有 9 家独立信源对该事件进行交叉印证与跟进报道(含 CNBC Indonesia Tech、arXiv: Anthropic、Decoder 等),属于近期高关注度行业信号。