提出基于文本结构表示的表格理解新方法 DELTA 和 TARQA
Tables Decoded: DELTA for Structure, TARQA for Understanding
研究团队提出的新方法 DELTA 和 TARQA,通过文本结构表示替代视觉模型,在表格理解任务上取得了显著提升,值得一看。
本文提出 DELTA 模型,通过分离物理结构识别、逻辑结构识别和 OCR 来准确提取表格的布局和内容,输出 Optimised Table Structure Language (OTSL) 格式。在 TSR 任务上,DELTA 在 FinTabNet、PubTabNet 和 PubTables-1M 数据集上达到 SOTA 水平。随后引入 TARQA,基于 OTSL 序列微调 LLM,在 WTQ 和 FinTabNetQA 基准上分别提升 9.3 和 9.2 个百分点。研究还建立了针对非英语表格的 TORQUE 基准,并在该基准上表现优异。
Tables Decoded: DELTA for Structure, TARQA for Understanding
Table understanding is a core task in document intelligence, encompassing two key subtasks: table reconstruction and table visual question answering (TabVQA). While recent approaches predominantly rely on vision- language models (VLMs) operating on table images, we propose a more scalable and effective alternative based on structured textual representations. These representations are easier to process, align more naturally with LLMs, and eliminate the need for language-specific visual encoders, making them particularly suitable for multilingual documents. We present DELTA, which separates physical structure recognition, logical structure recognition, and OCR to extract both layout and content accurately. DELTA outputs tables in Optimised Table Structure Language (OTSL), a compact and unified format that encodes cell arrangements and textual content. On table structure recognition (TSR), DELTA achieves TEDS- Structure scores comparable with state-of-the-art methods across FinTabNet, PubTabNet, and PubTables-1M. We further establish its robustness on non-English tables through our curated Hindi benchmark, TORQUE. Building on this, we introduce TARQA, an LLM fine-tuned on OTSL sequences. Our approach yields gains of 9.3 p.p. on WTQ (TabQA) and 9.2 p.p. on FinTabNetQA (TabVQA), respectively. On TORQUE, our method ranks second among all VLMs and DELTA + LLM variants. We release our code, models, and benchmark at: https://github.com/Tihiitborg/Tables-Decoded