模型精选

LimiX-2 模型发布,采用新架构提升结构化数据智能

LimiX-2: A Contextual Mechanism Network Towards General Structured-Data Intelligence

精选理由

LimiX-2 这个新模型,用新方法学,在结构化数据任务上比之前模型更好,还支持因果推理。

LimiX-2 是 LimiX 家族的新模型,采用 Contextual Mechanism Networks (CMNs) 架构,通过 Context-Conditional Masked Modeling (CCMM) 预训练。它在 TabArena、TALENT 和 BCCO 基准上表现优于现有模型。该模型还具备因果意识,能恢复数据生成结构。

原文 · arXiv cs.AI

LimiX-2: A Contextual Mechanism Network Towards General Structured-Data Intelligence

We introduce LimiX-2, a new model in the LimiX family, developed through model and data scaling guided by our previously established scaling laws. LimiX-2 adopts the Contextual Mechanism Networks (CMNs) paradigm and is pretrained with Context-Conditional Masked Modeling (CCMM). CMNs shifts the organizing principle of in-context learning from target-centric prediction to mechanism-oriented joint modeling. Rather than centering the network on the $p(y \mid x, D_{\mathrm{context}})$ objective of conventional tabular PFNs, it is designed around learning $p(x, y \mid D_{\mathrm{context}})$, a context-dependent representation of the joint structure underlying data generation. Pretraining uses synthetic datasets generated by structural causal models (SCMs) spanning diverse graph structures, functional mechanisms, and observation processes. Evaluations on TabArena, TALENT, and BCCO show that LimiX-2 outperforms current dataset-specific models and tabular foundation models. Beyond predictive performance, the CMN paradigm also promotes causal awareness in LimiX-2: its feature attention encodes direct causal relationships, enabling accurate causal skeleton recovery.