行业多源确认

OpenAI首席科学家谈AI防御系统

Quoting Jakub Pachocki

精选理由

OpenAI首席科学家谈AI安全防御,强调需要强大对齐AI来应对其他AI带来的危险。

OpenAI首席科学家Jakub Pachocki表示,需要快速训练更智能的模型来构建防御系统。这些防御系统将用于保护基础设施、实时应对恶意代理并开发新的保护措施。OpenAI将把构建防御系统作为部署工作的重点。

原文 · Simon Willison’s Weblog

Quoting Jakub Pachocki

The strongest argument I see for continuing to train much smarter models quickly is the need to build defensive systems against the dangers posed by other AI. [...] We will need powerful, aligned AI for defense; to secure infrastructure, to protect against rogue agents in real time, and to invent entirely new protective measures. This will be a primary focus of OpenAI’s deployment efforts. At the same time, even with the uncertainty that comes from anticipated broad AI progress and the need to build defensive systems, we must not let that become an excuse for recklessness. The idea of racing forward at all costs seems absurd once one internalizes the seriousness of the stakes. — Jakub Pachocki , Chief Scientist at OpenAI Tags: ai-ethics , openai , ai