Hamel Husain 与 Shreya 推出进阶 evals 技能包，可让编码智能体代做大部分工作
Pro tip: Install this new evals skill from @HamelHusain and @sh_reya, it'll save you many hours and ...
做 AI 产品必看，Hamel 和 Shreya 把踩坑经验做成免费技能包，让编码智能体帮你搭 evals，Ramp 和 Cursor 都靠这招降本增效。
Lenny Rachitsky 推荐 Hamel Husain 和 Shreya Shankar 发布的进阶 evals 技能包，是他们此前热门课程《Building eval systems that improve your AI product》的续作。内容基于两人与 50+ AI 公司的合作经验，讲解大多数团队跳过的关键步骤以及哪些环节该自动化、哪些不该。配套一个免费插件，能让编码智能体承担大部分搭建 evals 的工作。文中案例包括 Ramp 把自动收据收集准确率从 35% 提到 83%，Shopify 的 AI 工作流构建器比原前沿模型方案快 2.2 倍、省 68% 成本，Harvey 重建 AI 合同审查器后内部质量分接近翻倍，Cursor 调优 Auto Balance 路由后成本降 41%。
Pro tip: Install this new evals skill from @HamelHusain and @sh_reya, it'll save you many hours and ...
Pro tip: Install this new evals skill from @HamelHusain and @sh_reya , it'll save you many hours and a lot of mistakes github.com/ai-evals-cours… Lenny Rachitsky @lennysan Evals have been coming up more and more in my conversations with podcast guests and PM friends. Nearly half of the 25 awesome PM job openings I shared last week ask for experience writing evals. And leading companies keep sharing what investing in evals bought them: — @tryramp took its automatic receipt collection from 35% to 83% accuracy. — @Shopify shipped an AI workflow builder that's 2.2x faster and 68% cheaper than the frontier-model setup it replaced. — @harvey__ai rebuilt its AI contract reviewer, nearly doubling its internal quality score. — @cursor_ai tuned its Auto Balance routing, with much higher user satisfaction at 41% lower cost. So I asked the 🐐s of evals, @HamelHusain and @sh_reya , to write an advanced sequel to their very popular "Building eval systems that improve your AI product." Drawing on their work with 50+ AI companies, they share the key step most teams skip, what you should (and shouldn't) automate, and a free plugin that lets a coding agent do most of the heavy lifting. Read it here: lennysnewsletter.com/p/advanced-eva… F 🔗 View Quoted Tweet 💬 0 🔄 0 ❤️ 6 👀 1152 📊 2 ⚡
