行业多源确认精选78°

OpenAI 联合创始人 Altman 发推文,呼吁美国制定前沿 AI 安全框架

translation: we will go as fast as we can without going to jail or getting sued out of existence, bu...

精选理由

OpenAI 联合创始人 Altman 发推,说他们现在在模型开发阶段就做安全评估,不是等模型发布后再做,这样能更安全地推进 AI 进步。

Sam Altman 在推文中表示,OpenAI 正在制定安全案例,在推进能力提升的强化学习运行前进行安全评估,以管理前沿 AI 风险。他强调“pacing”(节奏控制)并非停止,而是通过安全措施让进展比可能的速度更慢,以避免风险。他欢迎联邦政府制定统一的安全要求,并希望其他公司学习他们的方法。

原文 · Gary Marcus

translation: we will go as fast as we can without going to jail or getting sued out of existence, bu...

translation: we will go as fast as we can without going to jail or getting sued out of existence, but for optics we will it call it pacing. “When we talk about “pacing”, we do not mean “stopping”. Progress has been rapid and will continue to be. But it should be slower than it otherwise could be; interventions like safety cases and monitoring have significant costs” Sam Altman @sama The world deserves confidence that American companies developing increasingly capable AI will act responsibly, especially as the trajectory of progress has steepened. Every frontier lab must deliver on this, and there is no reason any of us should come to work if we cannot. We welcome a federal framework that sets consistent safety requirements for frontier AI. But we do not believe we need to wait for an anti-trust exemption or legislation to begin the work of providing this confidence. Consistent rules to manage frontier risk so that we can maximize the benefits are a good idea (and we are excited by ideas like independent auditors). Years ago, companies like ours developed things like Responsible Scaling Policies and Preparedness Frameworks. Those were good for that moment, and focused primarily on the deployment of completed models, not what happens during their development process. Today's shift to focusing on safe development and evaluation will need new tools. For example, at OpenAI we now formulate explicit safety cases in advance of frontier reinforcement learning runs we expect to significantly increase capability, in addition to the safety work we have long done in advance of model releases. We hope that other companies will learn from our approaches and propose their own; we think shared standards for misalignment, monitoring, and safety will lead to better outcomes. We look forward to collaborating with our colleagues across the industry to formulate the best version of these. When we talk about “pacing”, we do not mean “stopping”. Progress has been rapid and will continue to be. But it should be slower than it otherwise could be; interventions like safety cases and monitoring have significant costs. Pacing will be well worth this cost; no amount of American competitive pressure should justify recklessness, or let capabilities get ahead of alignment and monitoring. Where we will need the help of our government is for international coordination. But first we should do what we can ourselves. 🔗 View Quoted Tweet 💬 0 🔄 0 ❤️ 0 👀 264 ⚡