模型多源确认精选78°

Anthropic 将为第三方提供永久访问权限以评估模型对齐

Worth spending a few minutes this weekend to read this essay in full. Embedded evaluators might so...

精选理由

朋友,Anthropic 的 CEO Dario Amodei 写了一篇关于 AI 行业应该放慢脚步的文章,他们决定给第三方评估员永久访问权限,这样能更严格地检查模型安全。

Anthropic CEO Dario Amodei 发表新文章,提出三步计划让前沿 AI 实验室放慢速度。公司决定为第三方评估员提供永久、员工级别的系统访问权限,让他们在模型训练期间验证安全措施、报告事件并评估模型对齐情况。

原文 · Alex Albert

Worth spending a few minutes this weekend to read this essay in full. Embedded evaluators might so...

Worth spending a few minutes this weekend to read this essay in full. Embedded evaluators might sound unusual in tech but it's pretty normal in other industries. Big banks have federal examiners with desks in the building and every nuclear plant in the US has inspectors who work on site full time. I think frontier AI labs should work the same way and this is a very practical first step. Dario Amodei @DarioAmodei We Must Pace the Frontier: I’ve written a new essay on why the AI industry should slow down, with a three-part plan for doing so. Anthropic is unilaterally committing to the first of these steps. We’ll provide third-party evaluators with permanent, employee-level access to our systems, so that they can verify adherence to our safety measures, report on incidents, and assess models’ alignment during training. You can read the full post here: darioamodei.com/post/we-must-p… 🔗 View Quoted Tweet 💬 9 🔄 3 ❤️ 57 👀 4450 📊 12 ⚡