Assistant Benchmark 创始人 David Pawlan 谈 147 个 AI 智能体实测
David Pawlan 实测了 147 个智能体，用订花、规划周末这些真实任务分高下，聊的信任问题是真痛点
David Pawlan 创建的 Assistant Benchmark 已追踪 147 个 AI 智能体。他分析约 3600 条深度用户群聊消息，发现 22% 涉及对智能体的信任问题。他让智能体做同日订花、规划兼顾奢华与性价比的洛杉矶周末等对比测试，考察其平衡冲突偏好的能力。他在 a16z 的播客中把智能体当前阶段比作 1997 年的电商，并讨论了规模优势和对产品过度管束的危害。
David Pawlan, creator of Assistant Benchmark, has tracked 147 AI assistants so far, and in his group chats of AI power users, the number one fear is trust. It comes up in 22% of roughly 3,600 messages. He puts agents through head-to-head tests, like ordering same-day flowers as cheaply as possible or planning a weekend in LA that's both luxurious and cost-efficient, to see which ones can hold competing preferences. He joins a16z's Anish Acharya and Josh Elman to discuss why the scariest agent failures are the embarrassing ones, why agents are where e-commerce was in 1997, why scale is still a moat, and the "dark agent" that could speak to the parts of ourselves we don't reveal. 0:52 Inside a meetup for 100 agent nerds 2:52 Why we'll all have an army of agents 5:36 Trust is power users' top fear 6:28 Building fences around your agent 10:14 Privacy loses to free pizza 12:41 Can agents balance price and speed? 14:19 How agents define luxury differently 19:44 Migrating from one agent to another 21:06 What your photo roll tells an agent 25:48 Will agents make us more rational? 27:38 Why paternalism kills products 31:43 Gossipy agents as social glue 33:41 Scale is still a software moat 36:55 From OpenClaw to agents hanging out 39:23 Agents that introduce you to people 46:15 Predictions and the dark agent idea YouTube: youtu.be/dSiTwPl0t1U @DavidPawlan @illscience @joshelman Your browser does not support the video tag. 🔗 View on Twitter 💬 11 🔄 1 ❤️ 20 👀 7891 📊 12 ⚡
