研究表明:LLM 生成博物馆文物描述时,更多元数据字段反而可能引入无据推断
When More Metadata Misleads: Probing Field-Level Grounding in LLM-Generated Museum Descriptions
给做数据到文本生成的朋友:这篇用博物馆藏品做实验,发现多给 LLM 字段不一定更准,图像也会让它瞎猜,评估方法值得换个思路。
arXiv 论文提出一个两阶段框架,研究元数据构成如何影响 LLM 生成文物描述。第一阶段分析大型博物馆馆藏中字段数量、字段类型、图像可用性和地点信息的自然变化。第二阶段通过受控字段探针固定藏品身份,仅改变元数据数量、类型和图像访问。结果显示元数据数量本身不能解释生成行为,字段类型才决定模型是进行事实支撑、省略还是推断,图像既可支持视觉定位也会增加无依据解读。论文据此提出元数据条件数据到文本的评估应在字段级和声明级检验支撑情况,而非只看输入覆盖率或参考相似度。
When More Metadata Misleads: Probing Field-Level Grounding in LLM-Generated Museum Descriptions
Metadata-conditioned generation is often framed as a data-to-text task in which additional input fields should improve grounding. Museum description generation challenges this assumption because catalogue records are heterogeneous, partially visual, and unevenly documented across geographic regions. We study how metadata composition shapes the generation of artefact descriptions through a two-phase framework. Phase 1 analyses natural metadata variation in a large museum collection, where field count, field type, image availability, and Place co-vary. Phase 2 introduces controlled field probes that hold object identity fixed while varying metadata quantity, field type, and image access. Our results show that metadata quantity alone does not explain generation behaviour. Field type determines whether models ground, omit, or infer information, while images can both support visual grounding and increase unsupported interpretation. More broadly, our findings show that metadata-conditioned data-to-text evaluation should assess field- and claim-level support, rather than relying only on aggregate input coverage or reference similarity.