Voice Arena 上线语音识别基准:5 种语言双人对话测试 ASR
Voice Arena 做了个按语言和场景拆分的语音识别基准,第一个数据集是 5 种语言的真实双人对话,做语音智能体的可以去看看排行。
Voice Arena 发布 Speech Recognition Benchmark,按使用场景划分语音识别评测,覆盖多种语言。首个数据集为 Monsoon Conversational ASR Test Set,包含 5 种语言的双人真实对话。排行榜和公开测试集已在 Voice Arena 上线。作者指出模型在美式英语上的表现并不能代表其在巴西葡萄牙语等语言中的排名,按语言和场景的基准更能衡量语音智能体的有效性。
A model being great at US English says little about how it ranks in other languages like Brazilian Portuguese. These benchmark efforts matter a lot for voice. The per-use-case benchmark is also ideal for properly measuring voice agents' effectiveness and robustness in certain languages. Shobhit Banga @shobhitbanga Drop 3/15: Introducing the Speech Recognition Benchmark on @voicearena_ai . One benchmark for every use case of speech recognition, in every language. Tested on real conversations. Dataset 1 is live: the Monsoon Conversational ASR Test Set, two-person conversations in 5 languages. Leaderboard and public test sets at Voice Arena. Your browser does not support the video tag. 🔗 View on Twitter 🔗 View Quoted Tweet 💬 0 🔄 1 ❤️ 1 👀 941 📊 1 ⚡