ENFR:用流匹配参考网络估算贝叶斯证据的绝对值
ENFR: Evidence Networks with Flow-Matched References for Amortized Simulation-Based Model Inference
证据 Z 一直很难算,这篇论文用流匹配参考把它变成可摊销的快速估计,还超过了流基线,做 SBI 的科研读者可以看看。
ENFR(Evidence Networks with Flow-matched References)是一种估算贝叶斯证据 Z 的新方法,建立在 Jeffrey & Wandelt 2024 年的 Evidence Network 框架上。它先学习相对于流匹配参考的贝叶斯因子,再恢复绝对证据值,而现有学习方法大多只能给出证据比值。论文还提出并证明了可联合学习一组模型 {M_i} 各自证据的架构。在基准测试中,ENFR 的证据估计优于流基线方法,在所有密度估计方法中表现最好,并在多种科学应用数据上验证了扩展性。
ENFR: Evidence Networks with Flow-Matched References for Amortized Simulation-Based Model Inference
The evidence, $\mathcal{Z} = p(x | \mathcal{M})$, of a data-generating model $\mathcal{M}$ is a powerful tool in Bayesian frameworks: it enables model inference, model misspecification tests, and goodness-of-fit assessment as an alternative to standard discrepancy statistics, e.g. $χ^2$. While versatile, the evidence is notoriously difficult to compute, even when the likelihood is available. In both likelihood-based and simulation-based inference, estimating $\mathcal{Z}$ provides an immediate solution to high-dimensional goodness-of-fit or model misspecification tests: using $\mathcal{Z}(x)$ as the test statistic induces a minimum-volume level-$α$ test. Such tests are essential to assess model fidelity, which is necessary to trust simulation-based parameter inference. Existing learned approaches largely target Bayes factors, which only measure evidence ratios. Instead, we provide accurate, fast, and amortized estimates of the absolute evidence. We present ENFR: Evidence Networks with Flow-matched References. Building on the Evidence Network framework of Jeffrey & Wandelt (2024), the proposed method first learns Bayes factors with respect to a flow-matched reference, from which the absolute evidence is recovered. We show improvement in estimation of $\mathcal{Z}$ over the flow-based baseline in all applications considered and the best performance of all density estimation methods considered in our benchmarks. We furthermore introduce and provide the proof for an architecture that jointly learns the individual evidences of a set of models $\{\mathcal{M}_i\}$. We demonstrate the performance and scaling behavior of these approaches on data from a variety of scientific applications.