论文

MemEmo 基准测试揭示记忆系统的情感处理短板

MemEmo: Evaluating Emotion in Memory Systems

精选理由

做陪伴类或个性化 AI 产品的团队可以看看这个测试。论文拿了五个主流记忆系统在情感提取、更新、问答、冲突检测上跑分,最好的才 45 分,说明情感这块大家都没做好,能帮你找到自家系统的短板。

arXiv 论文提出 MemEmo 基准,用于评估 LLM 记忆系统处理情感信息的能力,覆盖情感信息提取、情感记忆更新、情感记忆问答和情感冲突检测四个维度。

正文

论文同时构建了 HLME(Human-Like Memory Emotion)数据集作为实证基础,在五个代表性记忆系统上报告了 11 项性能指标。结果显示所有测试系统的综合得分最高仅达 45%,远低于 100% 的满scale,说明现有记忆系统在情感智能上存在明显缺口。

对于做陪伴型或个性化服务的开发者,这个结果意味着当前记忆系统在长期交互中容易丢失或错误更新情感信息,需要专门针对情感维度做优化。

原文 · arXiv cs.AI

MemEmo: Evaluating Emotion in Memory Systems

Memory systems address the challenge of context loss in Large Language Models during prolonged interactions. However, as an essential tool for warm companionship and personalized services, the effectiveness of memory systems in processing affective information remains underexamined. To bridge this gap, we propose an emotion-enhanced memory evaluation benchmark to assess the performance of mainstream and state-of-the-art memory systems in integrating and harnessing emotional information. First, we design a benchmark called \textbf{MemEmo} to assess the affective reasoning and tracking capabilities of memory systems across four dimensions: emotional information extraction, emotional memory updating, emotional memory question-answering, and emotional conflict detection. Second, we construct the \textbf{H}uman-\textbf{L}ike \textbf{M}emory \textbf{E}motion (\textbf{HLME}) dataset to provide an empirical foundation for scrutinizing memory systems. Finally, We evaluate five representative memory systems on the HLME dataset, reporting 11 performance metrics across four dimensions. Experimental results reveal that aggregating scores for all tested memory systems is up to 45\%, far below 100\% scale, exposing a profound disparity between memory system and affective intelligence.

产业坐标与信源核验

本条情报归属 AITOP「论文」核心追踪栏目。涉及核心实体与技术议题包括:MemEmo、HLME、记忆系统、情感智能,读者可通过下方标签进入对应专题页查阅历史脉络与关联对比。

信源核验说明:本文原始线索采编自「arXiv cs.AI」(@Peng Liu, Zhen Tao, Jihao Zhao, Ding Chen, Yansong Zhang, Cuiping Li, Zhiyu Li, Hong Chen),经 AITOP 多维评分管线结构化提炼。