研究评估 TabPFN 与 Mitra 在因果效应估计中的表现
Does Predictive Performance Translate to Causal Performance? Evaluating tabular foundation models as nuisance learners for causal effect estimation
用 TabPFN 和 Mitra 做因果效应估计的系统性测试，复杂场景下准确率和置信区间覆盖率都超过了 Super Learner 集成。做因果推断或统计建模的工程师值得看实验设计，尤其是 cross-fitting 对小样本的必要性结论。
arXiv 论文评估了基于 prior-data fitted networks（PFN）的表格基础模型在因果推断中的表现，测试对象包括 TabPFN 和 Mitra 两个模型。实验将 PFN 作为倾向得分和结局回归的 nuisance learner，嵌入双重稳健估计器，覆盖多种混杂复杂度和效应异质性的合成与半合成数据。
结果显示，在简单参数化数据生成过程下，PFN 与正确设定的参数回归及集成方法表现相当；在更复杂场景中，PFN 在准确性和不确定性量化上超过了包括 Super Learner 集成在内的所有传统学习器。随样本量增大，只有 TabPFN 和 Mitra 能持续接近名义置信区间覆盖率，部分场景下即使不使用 cross-fitting 也能达到接近名义的覆盖率和良好校准的标准误。
局限同样明确：在最小样本量 n=200 及高维半合成设置下，各灵活学习器在不使用 cross-fitting 时覆盖率都较差，PFN 的问题源于倾向得分过拟合，与对处理标签的样本内记忆一致。论文指出 PFN 作为 in-context nuisance learner 有潜力，但在困难场景仍需进一步评估。
Does Predictive Performance Translate to Causal Performance? Evaluating tabular foundation models as nuisance learners for causal effect estimation
Tabular foundation models based on prior-data fitted networks (PFNs) achieve strong predictive performance, but their value for causal inference is unclear. We evaluated whether PFNs, which predict through in-context learning, could match or outperform conventional nuisance learners in supporting accurate causal estimation and reliable uncertainty quantification (inference). Learners modeled propensity scores and outcome regressions within doubly robust estimators of average causal effects, with and without cross-fitting, across synthetic and semi-synthetic settings with varying confounding complexity and effect heterogeneity. Under simple parametric data-generating processes, the PFNs were competitive with correctly specified parametric regressions and ensembles containing them. In more complex settings, they outperformed all conventional learners evaluated, including richly specified Super Learner ensembles, for both accuracy and uncertainty quantification. As sample size increased, only the two PFN models (TabPFN and Mitra) consistently approached nominal confidence interval coverage, whereas under-coverage persisted for conventional learners. In some settings, PFNs achieved near-nominal coverage and well-calibrated standard errors even without cross-fitting. At the smallest sample size (n=200) and in the higher-dimensional semi-synthetic settings, PFNs and other flexible learners exhibited poor coverage without cross-fitting. For PFNs, this appeared to be driven by propensity score overfitting consistent with in-sample memorization of treatment labels. These findings highlight the promise of prior-data fitted networks as in-context nuisance learners for causal estimation, while underscoring the need for further evaluation in challenging settings.
本条情报归属 AITOP「论文」核心追踪栏目。在跨区域产业观察坐标中，该动态直接关联「AI 开发者工具链、Coding Agent 与工程化实践」研究主线，反映出当前技术演进与商业落地的最新风向。涉及核心实体与技术议题包括：TabPFN、Mitra、因果推断、表格基础模型，读者可通过下方标签进入对应专题页查阅历史脉络与关联对比。
信源核验说明：本文原始线索采编自「arXiv cs.AI」（@Andrew R Weckstein, Issa J Dahabreh, Marinka Zitnik, Sonia Hernández-Díaz, Sebastian Schneeweiss），经 AITOP 多维评分管线结构化提炼。