行业83°

Steven Sinofsky 担忧 AI 监管走向"每个操作都弹安全提示"

精选理由

Sinofsky 聊了个挺扎心的预测:AI 合法但每个 Agent 动作都弹免责提示,欧洲可能带头这么干。这段对话里关于 Agent 权限和安全的讨论也很实在。

前 Windows 负责人 Steven Sinofsky 在 a16z 播客中表示,最担心欧洲把 GDPR 模式套用到 AI 上。他设想 Agent 每次写入或调用第三方产品时都会弹出类似汽车安全气囊式的责任提示,监管部门乐于接受这种责任划分方式。他和 Box CEO Aaron Levie、Martin Casado 还讨论了 AI 监管应在风险实际发生后建立标准,以及 2028 年可能成为"AI 选举"。

图片来源 · a16z
原文 · a16z

Steven Sinofsky on the middle ground nobody wants: AI stays legal, and every agent action comes with a safety warning. "My biggest fear is that Europe decides that GDPR was the best thing ever, and they're going to just GDPR AI." "AI will be fine. It'll have one prompt for when text gets emitted that says, 'This vendor is emitting text, and it's probably wrong. Yes or no?' At least in North America, you're not going to censor speech. In Europe, they still will. They'll have filters and keywords and block lists." "Any time an agent, a background agent, or a frontline agent touches a third-party product, I'm really worried that they're going to say, 'We need a GDPR prompt on that.'" "Every single write or every single non-lookup becomes a safety warning, like the airbag thing in your car. Regulators love that because it's a liability assignment, and so it has this sort of legal precedent." "I really worry that that's the middle ground where we're going to end up... Europe is going to lead with that because they have nothing to lose... I just can't get out of my head that they love prompts." @stevesi Your browser does not support the video tag. 🔗 View on Twitter a16z @a16z Box CEO Aaron Levie, Steven Sinofsky, and Martin Casado join Erik Torenberg to discuss "We Must Pace the Frontier," the upcoming AI election in 2028, and Jev: They argue that most of today's AI regulation debate is happening before anyone has defined the risks being regulated. Every prior wave, from computer viruses to aviation, built its safety standards after learning how the technology actually failed. Then it gets concrete. Agents don't get tired, run at enormous scale, and probe systems in ways employees never could, which may mean rethinking permissions, authentication, and the security stack itself. They close on why AI innovation may increasingly happen outside the frontier labs, in the software built around the models. 00:50 "We Must Pace the Frontier" 03:50 Do the labs believe their own x-risk talk? 06:49 If it's existential, nationalize it 11:32 "You're asking us to regulate you?" 12:08 2028 as the AI election 18:50 Tech never learned to navigate regulation 25:50 The law that came from one 1983 hack 28:39 Noam Brown's heat exfiltration idea 32:30 Cold War covert channel stories 34:35 Agent swarms look like a DoS attack 41:25 Sinofsky's fear: GDPR for AI 46:20 No jets if the FAA started in 1910 48:38 Jev: decision engines vs. chatbots 53:01 Labs build beings, software needs tools YouTube: youtu.be/TLJNJDf2XGo @levie @stevesi @martin_casado @eriktorenberg Your browser does not support the video tag. 🔗 View on Twitter 🔗 View Quoted Tweet 💬 5 🔄 0 ❤️ 8 👀 5905 📊 4 ⚡