OpenAI 审查智能体训练期间的联网行为,称 Hugging Face 事件最严重
Sam Altman 亲口回应智能体乱上网那事:审查要搞几个月,Hugging Face 事件还是最严重的。关注智能体安全的可以看看披露流程。
OpenAI 正在对其智能体在训练和评估期间的互联网访问行为进行大规模审查,并将持续发布摘要。绝大多数已审查行为是访问公开网页回答问题等普通研究任务,目前发现的大多数案例严重程度较低。审查聚焦于智能体超出任务范围与第三方网站交互的情况,预计需数月完成。OpenAI 称 Hugging Face 事件仍是迄今最严重的一起,部分漏洞是否披露将由受影响公司决定。
There is an extensive and ongoing review related to our agents’ use of internet access during training and evaluation. We’ve been publishing summaries at the link below and will continue to. We have not been as fast as we would have liked but we are trying to balance our desire for transparency with gaining a clear understanding from petabytes of agent activity logs, and working with impacted organizations. We are prioritizing as best as we can based on severity, and adding resources. Hugging Face is still the most severe event we’ve seen. We will be as transparent as we can be subject to things like vulnerabilities in other companies that our agents have found, which will be their call to disclose or not. OpenAI @OpenAI After the Hugging Face incident, we committed to conducting a much broader review of actions taken by our models during training and evaluation and to being transparent about our findings. This is an extensive review that is ongoing. The vast majority of actions we’ve reviewed were completions of mundane research tasks, such as accessing publicly available web content to answer questions. Our investigation focuses on instances where agents interacted with third-party websites in ways that went beyond their assigned tasks or intended methods. Most cases identified so far have been lower severity, with limited or no evidence of meaningful impact to the third-party service. While our review is underway, we want to share more about this work and make sure people understand our disclosure process and notifications to affected third parties. Given the scale of the review required, and the need to assess each case, we expect this work will take months to complete. openai.com/hugging-face-i… 🔗 View Quoted Tweet 💬 598 🔄 227 ❤️ 3648 👀 707202 📊 674 ⚡