Dictation Bench 用 761 段录音实测十款语音听写应用
Voice Arena 拿 761 段录音在 Mac 上实测了十款听写应用,配置和评审标准全公开,还标出哪些差距只是统计平手。做语音输入工具的团队和想选型听写软件的用户都该看看,这套可复现的测法比各家自己报的百分比靠谱多了。
Voice Arena 用同一批 761 段录音、来自 87 位说话人的音频,在 Mac 上测试了十款听写应用——跑的是真实客户端而非各家 API,并公布了参考规则、应用配置和评审指令。结果还标注了哪些差距属于统计上的平手,避免误读。这套流程被作者称为 Dictation Bench,主张任何“我们是最好的”这类宣称都应该放在可公开核查的统一对比里。作者的诉求是让厂商定期按同一基准报告成绩,而不是各自拿不同条件测出的百分比让用户自己比对。
这套测试的价值在于方法透明:录音相同、配置公开、评审标准可查,厂商可以据此展示自己的领先项、解释失败案例,或指出换一个任务会改变结论——这都比模糊营销更有效。不过测试范围有限,只覆盖 macOS 上的美式英语,结论需要在这个边界内解读。对开发者工具和应用厂商来说,一个可复现的共享基准意味着改进更容易被证明。
If a dictation company says it is the best, I would now ask how it scores on Dictation Bench. One test does not cover every use case, but that kind of claim should hold up in a shared comparison that anyone can inspect.
@voicearena_ai played the same 761 recordings from 87 speakers into ten dictation apps on a Mac (the real apps, not their APIs). They published the reference policies, the app configurations, the judge instructions, and results that flag which gaps are statistical ties.
So companies now have something concrete to respond to. They can show where their product leads, explain the failures, or show that a different task changes the result. Any of those is more useful than asking users to compare percentages measured under different conditions.
The current test covers US English on macOS only, and the results should be read with that scope. Within it, I would like companies to report against this benchmark routinely. A shared standard makes claims easier to check and improvements easier to prove, and this benchmark is a practical place to start.
本条情报归属 AITOP「产品」核心栏目,重点聚焦北美前沿实验室与硅谷科技巨头。在跨区域产业观察坐标中,该动态直接关联「AI 开发者工具链、Coding Agent 与工程化实践」研究主线,反映出当前技术演进与商业落地的最新风向。涉及核心实体与技术议题包括:Dictation Bench、Voice Arena、语音识别、编程助手,读者可通过下方标签进入对应专题页查阅历史脉络与关联对比。
信源核验说明:本文原始线索采编自「rohanpaul_ai」(@rohanpaul_ai),经 AITOP 多维评分管线结构化提炼。