论文

MemLife:长期第一人称视频记忆系统

MemLife: Curating and Reasoning over Long-Term Egocentric Video Memories

精选理由

MemLife解决了长期视频记忆的检索难题,无需训练或视频访问即可提升性能,还提供了MemOpt优化框架。

MemLife是一个多模态记忆系统,将视频压缩为文本表示,通过时间索引的智能体检索器查找相关内容。该系统在四个长期基准测试中,比最强的无训练基线提升4.6-12.0%。MemOpt是一个强化学习框架,可优化记忆生成器,提高记忆质量,在不同视频和问题分布下提升2.7-5.0%。

原文 · arXiv cs.AI

MemLife: Curating and Reasoning over Long-Term Egocentric Video Memories

Long-term egocentric video enables personalized AI assistants to reason about daily life. However, as video histories grow to hundreds of hours spanning months or years, reprocessing raw clips for every query becomes computationally prohibitive. Memory systems offer a scalable alternative by compacting videos into text representations, but often fail on practical benchmarks: either the memory does not preserve key evidence, or the retriever fails to locate relevant entries due to retrieval competition in growing search spaces. To address these challenges, we introduce MemLife, a multimodal memory system that constructs entity-grounded, first-person text episodes and retrieves them via a time-indexed agentic reader. Without training or query-time video access, MemLife improves over the strongest training-free baseline by 4.6--12.0% across four long-horizon benchmarks. To further improve memory quality, we propose MemOpt, a reinforcement learning framework that optimizes the memory writer to produce faithful, informative, and retrievable memories. MemOpt consistently improves MemLife by 2.7--5.0% across different video and question distributions, with gains that generalize across writer and reader backbones and memory systems.