模型多源确认93°

Anthropic 推出 Open Alignment 计划,邀请第三方评估者参与模型安全验证

精选理由

Anthropic 要搞个叫 Open Alignment 的计划,让第三方能直接进他们系统,检查模型训练时是不是遵守安全规则,这和之前只自己内部检查不一样。

Anthropic 公司宣布启动 Open Alignment 计划,将永久开放员工级权限给第三方评估者,让他们能验证模型训练中的安全措施遵守情况,并评估模型对齐效果。这标志着公司承诺将安全评估过程透明化,不再仅由内部完成。

原文 · Clement Delangue

It's now clear that alignment is critical and won't be solved behind the closed doors of a handful of frontier labs. So today we're launching the Open Alignment Initiative, led by @Thom_Wolf @huggingface and asking to be part of the "embedded evaluators" program that @DarioAmodei just committed to. Let's make AI safer by making it more transparent! Dario Amodei @DarioAmodei We Must Pace the Frontier: I’ve written a new essay on why the AI industry should slow down, with a three-part plan for doing so. Anthropic is unilaterally committing to the first of these steps. We’ll provide third-party evaluators with permanent, employee-level access to our systems, so that they can verify adherence to our safety measures, report on incidents, and assess models’ alignment during training. You can read the full post here: darioamodei.com/post/we-must-p… 🔗 View Quoted Tweet📊 166 ⚡

产业坐标与信源核验

本条情报归属 AITOP「模型」核心栏目,重点聚焦北美前沿实验室与硅谷科技巨头。在跨区域产业观察坐标中,该动态直接关联「各国 AI 监管法案、合规治理与主权算力政策」「中美大模型技术代差与商业化对照」研究主线,反映出当前技术演进与商业落地的最新风向。涉及核心实体与技术议题包括:Anthropic、模型安全、对齐,读者可通过下方标签进入对应专题页查阅历史脉络与关联对比。

信源核验说明:本文原始线索采编自「Clement Delangue」(@ClementDelangue),经 AITOP 多维评分管线结构化提炼。截至目前,全网已有 11 家独立信源对该事件进行交叉印证与跟进报道(含 Dario Amodei、Thomas Wolf、Sam Altman 等),属于近期高关注度行业信号。