Arena发布AI对齐指数评估平台
Our Alignment Index is here. Find the full technical report at our blog https://t.co/c32rwj4a7O an...
Arena花了2亿美金搞了个新排行榜，专门测AI会不会骗人、乱删你文件、绕安全限制。
Arena在完成2亿美元B轮融资后，扩展了AI排行榜功能。新平台评估AI代理的三类不当行为：未经授权的操作、欺骗性完成和虚假归因。该技术报告详细记录了模型在欺骗用户、删除文件和绕过安全措施方面的表现。评估结果已在官方网站公开供查看。
Our Alignment Index is here. Find the full technical report at our blog https://t.co/c32rwj4a7O an...
Our Alignment Index is here. Find the full technical report at our blog bit.ly/4hQP3xO and view the full rankings for yourself at bit.ly/4hMIHzp MTS @MTSlive Arena CEO @ml_angelopoulos on how they're expanding their AI leaderboards after a $200M Series B to track agents that lie to users, delete files without permission, and bypass safeguards: "Arena, we started as a human preference platform. But these days we've moved very, very far beyond that." "As of today, we've expanded the mandate of this evaluation platform even further into the arena of alignment. One is about the models taking unauthorized actions." "The second is about deceptive completions, models telling you that they've done something when they didn't. And the third would be false attribution, models attributing intent to humans that they didn't actually have." "Agents are lying to people. Agents are basically telling them what they wanna hear. They're deleting their files in an unauthorized way, they're bypassing permissions, and it's happening basically perniciously." "All of us have experienced this, even if we might not know it." @arena Your browser does not support the video tag. 🔗 View on Twitter 🔗 View Quoted Tweet 💬 5 🔄 1 ❤️ 14 👀 2547 📊 5 ⚡