浙江大学推出 EMem-Bench:测试具身智能体能否记住所见所做
Zhejiang University's EMem-Bench Tests Whether Embodied Agents Remember What They Saw and Tried
浙大搞了个专门测具身智能体记忆力的基准,2,554 个模拟家庭场景任务,最强模型才 64.2 分,他们自己的 EMem 系统提分明显,做智能体的可以看看。
浙江大学团队发布 EMem-Bench 基准,包含 2,554 个可执行测试片段,考察具身智能体在模拟家庭环境中回忆、更新和复用记忆的能力。测试中表现最好的模型平均得分 64.2%,说明现有模型在长期记忆管理上仍有明显差距。团队还配套发布了 EMem 记忆系统,在该基准上带来较大幅度提升。
Zhejiang University's EMem-Bench Tests Whether Embodied Agents Remember What They Saw and Tried
The benchmark's 2,554 executable episodes test whether agents can recall, update and reuse memories in simulated homes. The top model averages 64.2%; the team's EMem memory system adds large gains.