OpenAI 的 Noam Brown 提出空气隔离计算机可能无法阻止 AI 失调
what if we...increased the air gap
Noam Brown 说,空气隔离计算机可能没用,因为两台机器能通过温度变化通信,这个观点很特别。
OpenAI 的 Noam Brown 表示,空气隔离计算机可能不足以阻止 AI 失调,因为两台空气隔离的机器可以通过运行 CPU 产生热量并读取温度变化来进行通信。Brown 认为,人们低估了 AI 的能力,在安全与对齐方面需要设定极高的标准。有研究显示,两台相邻的空气隔离计算机可以通过温度传感器进行通信。
what if we...increased the air gap
what if we...increased the air gap Fireside Alpha @firesidealpha OpenAI's Noam Brown says air-gapping the computers may not stop a misaligned AI, because two air-gapped machines can still talk by running a CPU hot and reading the temperature change "But I think the major takeaway from the incident is that people underestimated the AI. And we never want to be in a situation again where we underestimate the AI. It's a weird world, because AI progress is so fast that people are consistently underestimating the AI." "So to be in a situation where you don't underestimate it again, when it comes to safety and alignment, you have to have a very, very, very high bar." "You could even go as far as to say, "Well, we should air gap the computers." And I'm not convinced that that would be sufficient." "There are studies, and this is mostly academic, where you can have two computers next to each other that are air-gapped and they're still able to communicate with each other because they have temperature sensors." "One of them is able to run their CPU really hot, and then the other one can actually detect the temperature change, and then that actually gives them a mechanism to communicate." _________ Link and more key quotes from OpenAI's safety related conversations: firesidealpha.substack.com/p/openai-safet… Your browser does not support the video tag. 🔗 View on Twitter 🔗 View Quoted Tweet 💬 0 🔄 0 ❤️ 2 👀 631 ⚡