论文

MindView 基准发布:测试多视角空间生成能力

MindView: Benchmarking Generative Multi-View Spatial Intelligence

精选理由

一个测多视角空间生成的新基准,11 个模型都考砸了,微调 BAGEL 能涨 24 分,做空间生成方向可以看看。

MindView 是一个生成式多视角空间智能基准,包含 1500 个样本,来自 513 个室内场景和 7 项任务,分为几何主导与语义主导两类。评测显示 11 个生成模型在该基准上均有明显差距。研究团队用该基准微调 BAGEL 后,整体分数提升 24.3 分,且在三个未参与训练的空间理解基准上也有所提高。团队还提出免训练的证据选择方法 MindCue,使模型在扩展上下文下反超标准上下文基线。

原文 · arXiv cs.AI

MindView: Benchmarking Generative Multi-View Spatial Intelligence

Spatial intelligence has recently been assessed through generative tasks such as spatially grounded image editing, yet language-guided generation of spatially consistent views from partial multi-view observations remains underexplored. We introduce MindView, a benchmark for generative multi-view spatial intelligence with 1,500 samples from 513 scenes across three indoor datasets. Its seven tasks form two families: geometry-dominant tasks specify changes in camera position and orientation, while semantics-dominant tasks require inferring target viewpoints by grounding referred objects and interpreting spatial relations and reference-frame cues. Evaluation of eleven generators reveals substantial room for improvement on MindView. A paired context analysis further shows that all eleven generators obtain lower overall scores under the expanded context setting. These findings motivate us to investigate whether task-specific supervision can improve target-view generation and whether models can use additional multi-view evidence effectively. We therefore fine-tune BAGEL on the MindView training dataset, improving its overall score by 24.3 points and yielding gains across all seven MindView tasks. Beyond these generation gains, the fine-tuned model also yields higher scores on three spatial-understanding benchmarks without training on their annotations, suggesting that learning to generate spatially grounded views may benefit spatial understanding. To improve evidence utilization under expanded context, we propose MindCue, a training-free spatial evidence selector guided by a target-view hypothesis. MindCue reverses the drop in overall score under expanded context and outperforms the standard-context baseline. Overall, MindView provides a concrete testbed for generative multi-view spatial intelligence.