模型多源确认78°

Gary Marcus批评OpenAI等未重视AI代理安全风险

“The doomers were the only ones to foresee this” is, as usual, bullshit.

精选理由

Gary Marcus说,OpenAI等没听他的警告,现在AI代理的安全问题很严重,他早就预见了。

Gary Marcus在2023年5月就警告美国参议院,GPT-4发布后OpenAI推出ChatGPT插件,导致AutoGPT等AI代理出现,这些代理拥有互联网访问、写代码和自动化能力,可能带来难以预测的安全后果。当前更强大的AI代理正面临类似问题。

原文 · Gary Marcus

“The doomers were the only ones to foresee this” is, as usual, bullshit.

“The doomers were the only ones to foresee this” is, as usual, bullshit. Gary Marcus @GaryMarcus Perhaps the most important warning I ever issued was this, to the US Senate, May 2023: “A month after GPT-4 was released, OpenAI released ChatGPT plug-ins, which quickly led others to develop something called AutoGPT [enabling the use of LLMs as agents]. With direct access to the internet, the ability to write source code and increased powers of automation, this may well have drastic and difficult to predict security consequences”. Instead of listening, people like Sam Altman, Tyler Cowen, and Kevin Roose have spent years trying to run me down. (Even now, a lot of journalists like to say it was doomers that predicted where we are now, but so far as I know the doomers didn’t pinpoint the specific vulnerability we are confronting now. But the reality is that my warning to the Senate exactly anticipated our current situation. Agents (more powerful than AutoGPT itself was) with direct access to the internet, the ability to write source code and increased powers of automation, are having drastic and difficult to predict security consequences. It was entirely foreseeable. I foresaw it. I warned the United States government. It remains an entirely stupid thing to do. Nobody has done anything about it. Not then. Not now. 🔗 View Quoted Tweet 💬 2 🔄 2 ❤️ 13 👀 2377 📊 3 ⚡