语言模型树结构表达式序列化研究
The Communication Bottleneck: A Round-Trip Study of Tree-Structured Expression Serialization in Language Models
苹果研究团队揭秘语言模型如何处理树结构信息，16个模型往返测试揭示序列化瓶颈。
苹果公司研究团队提出往返协议，评估16个语言模型在树结构表达式序列化中的表现。该研究通过生成器将算术表达式转为文字题，再由提取器从文字题恢复表达式。研究测量了模型在序列化过程中的信息保留程度，揭示了语言模型处理结构化信息的瓶颈。
The Communication Bottleneck: A Round-Trip Study of Tree-Structured Expression Serialization in Language Models
When language models reason in chain-of-thought or exchange free-text intermediates, they serialize structured information into natural language. How much tree-structured compositional content survives this bottleneck? We propose a round-trip protocol that answers this question empirically for tree-structured expressions. A generator converts a procedurally generated arithmetic expression into a word problem, a separate extractor recovers the expression from the word problem alone, and symbolic equivalence provides an exact oracle. Evaluating all pairwise combinations of sixteen models yields…
