技巧

Bridgewater 把用户吐槽搜索差,一周做成 200 例评测集

精选理由

用户说搜索不好用,别急着改,先学 Bridgewater 用一周做 200 条评测集,改没改好直接量化。

Aaron Linsky 在 AI Engineer New York 演讲中介绍,Bridgewater 针对用户反馈搜索效果差的问题,用不到一周时间搭建了约 200 个样本的评测集。团队随后用这个评测集来量化每一次搜索改进的效果,把模糊的用户抱怨变成可衡量的指标。

图片来源 · AI Engineer
原文 · AI Engineer

Your users say search is bad. How do you turn that complaint into an eval? Aaron Linsky explains how Bridgewater built a benchmark of about 200 examples in under a week, then used it to measure search improvements. 59 seconds from AI Engineer New York. #AIEngineerNY Your browser does not support the video tag. 🔗 View on Twitter 💬 0 🔄 0 ❤️ 1 👀 267 ⚡