行业89°

Anthropic IPO 文件披露内部担忧 AI 或存灭绝级风险

精选理由

Anthropic 把招股书写成了风险自白:内部承认 AI 可能有灭绝级风险,连保险公司都接不住,还警告 1300% 增速撑不住,这些措辞在 IPO 文件里很少见。

Anthropic 在 IPO 招股文件中告诉投资者,公司内部同样担心高级 AI 可能对人类构成灾难性或灭绝性风险,并称若缺乏足够的安全保障与监管措施,被滥用或高度自主运行的系统风险尤其突出。文件还警告,保险公司单独甚至整个行业都可能没有足够能力承保此类灾难性 AI 事故的损失。财务方面,Anthropic 提示其 1300% 的增长率不可持续,且无法保证营收会继续增长。文件同时指出,公司可能因模型造成的损害面临诉讼和监管行动,而合同保护与保险可能不足以覆盖。

原文 · rohanpaul_ai

In its IPO filing, Anthropic tells investors that people inside the company share the worry that advanced AI could pose catastrophic or existential risks to humanity.

In the same filing, it warns that its 1,300% growth rate won’t last and that it can’t promise revenue will keep growing at all.

> “In addition, with the scale of harm that could result from a catastrophic AI-related incident, no single insurer, and potentially the insurance industry in the aggregate, may have sufficient capacity or expertise to underwrite insurance commensurate with such exposure.”

> “Concerns have been raised both within our organization and by other researchers, regulators, policymakers, and industry participants that sufficiently advanced AI systems could, if not developed, deployed, and operated with appropriate safeguards, oversight, and security measures, pose catastrophic or existential risks to humanity, particularly if such systems were misused, replicated, weaponized, or allowed to operate with a high degree of autonomy.”

> “We may be exposed to liability, litigation, and regulatory action arising from harms associated with our AI models, and our contractual protections and insurance may be insufficient, any of which could adversely affect our business, financial condition, and results of operations.”

Anthropic IPO 文件披露内部担忧 AI 或存灭绝级风险|AI热报