Voice Arena 推出基于真实电话通话的语音识别评测基准
Voice Arena 搞了个新基准,用真实手机通话测语音转文字模型,双人打断加电话压缩音频,比实验室数据难多了。
Voice Arena 发布新基准,用日常手机在真实房间和真实背景音中拨打的电话测试 speech-to-text 模型。双人对话场景显著提升难度:说话人互相打断、插入 yeah 和 okay 之类的应答词,电话线路还会压缩音频。这类条件正是客服和销售语音智能体每天要面对的真实工作环境。
Speech recognition evalualtion must test where voice agents actually work, which is phone calls between two people.
Voice Arena’s new benchmark tests speech-to-text models on real calls made on everyday phones, in real rooms, with real background sound.
Two speakers make the job much harder for the model. People talk over each other, interrupt, drop in short “yeah” and “okay” replies, and the phone line compresses the audio. A support or sales agent deals with all of this every day.