LlamaIndex 发布 ParseBench-2 与 OCRia-1.5 文档解析模型
做 RAG 或文档处理的开发者该看看。旧基准要么指标太脆要么靠 LLM 打分不靠谱，这次按 330 多种错误类型标了严重度来调指标，评测可信多了。附带的 OCRia-1.5 处理复杂表格和表单更强，可以直接上 LlamaParse 试。
LlamaIndex 推出文档解析基准 ParseBench-2，包含 4.3k+ 页文档，比 ParseBench-1 翻倍，并新增表单（forms）维度。基准为 330+ 种错误类型逐一标注严重程度分数，再据此调校各项指标，使其与人工判断高度一致。
现有基准的评测方式各有短板：OmniDocBench 依赖脆弱的确定性指标，ParseArena 采用 LLM-as-a-judge，结果粗糙、随机且受提示词和模型偏见影响。ParseBench-1 已积累 50k+ 月下载量，评测过 150+ 个 OCR 方案，被 NVIDIA、Cohere、Perplexity、Aleph Alpha 等公司采用。
同期发布 OCRia-1.5 文档解析模型家族，驱动 LlamaParse 全部解析模式，在复杂表格、表单、图表、版式和边界框标注上达到当前最优水平。技术报告、博客和官网均已公开。
Today we’re introducing ParseBench-2 - our most ambitious document parsing benchmark to date. It is the only benchmark that provides both extreme granularity into every single type of production parsing error, while also making sure that metric scores are highly aligned with human judgment. We do this by painstakingly assigning severity scores to 330+ error types, and tuning each metric to match the severity scores. Existing benchmarks either use brittle deterministic metrics (e.g. OmniDocBench) or LLM-as-a-judge (ParseArena), which can help recognize equivalent representations but are coarse/stochastic/subject to bias by the prompt+model. ParseBench-2 also contains: ✅ 4.3k+ document pages (double from ParseBench-1). ✅ An extra dimension (forms) ✅ Much better ground-truth across all dimensions compared to ParseBench-1. This is the next evolution of ParseBench, our hugely popular benchmark that has 50k+ monthly downloads, over 150+ OCR solutions benchmarked, and has been adopted by companies like NVIDIA, Cohere, Aleph Alpha, Perplexity, and others. Alongside ParseBench-2, we are also releasing OCRia-1.5 - a new family of document parsing models that powers all our modes in LlamaParse. They represent a massive step up in capabilities from our latest release, and are state of the art in parsing complex tables, forms, charts, formatting, and assigning bounding boxes to complex layouts. Come check out our blog post, technical report, and website. Blog: llamaindex.ai/blog/introduci… Technical Report: llamaindex.ai/files/parseben… Website: parsebench.ai If you’re interested in trying out our OCRia-1.5 capabilities, come sign up for LlamaParse: cloud.llamaindex.ai
本条情报归属 AITOP「模型」核心栏目，重点聚焦北美前沿实验室与硅谷科技巨头。在跨区域产业观察坐标中，该动态直接关联「AI 开发者工具链、Coding Agent 与工程化实践」「中美大模型技术代差与商业化对照」研究主线，反映出当前技术演进与商业落地的最新风向。涉及核心实体与技术议题包括：ParseBench、LlamaParse、OCRia、OCR，读者可通过下方标签进入对应专题页查阅历史脉络与关联对比。
信源核验说明：本文原始线索采编自「Jerry Liu」（@jerryjliu0），经 AITOP 多维评分管线结构化提炼。
