论文

VAP 诊断方法将 Flow Matching 训练损失拆解为时间维度分析

Velocity Ambiguity Profiles: Time-Resolved Bayes-Risk Diagnostics for Flow Matching

精选理由

训练 Flow Matching 模型的话可以看看,这个 VAP 方法能把平均损失拆到每个时间点,找出哪些区域数据不够、哪些是本质模糊,实验里 Fréchet 距离降了 23.6%。

arXiv 论文提出 Velocity Ambiguity Profile(VAP),用于度量速度预测在每个插值时间点的 Bayes 风险下界,并把时间分辨损失 L_N(t) 拆为不可再减的模糊项 A_v(t) 与可用更多数据压缩的冗余项 R(t;N)。在分离的各向同性高斯混合设定下,论文证明标签残差回归的 excess-risk 规模为 K·A_v(t)/N。在 CIFAR-100 DINOv2 特征流实验中,按 VAP 引导的时间采样使速度损失降低 6.78%,全局特征 Fréchet 距离降低 23.6%,但类条件 KID 指标无改善。

原文 · arXiv cs.LG

Velocity Ambiguity Profiles: Time-Resolved Bayes-Risk Diagnostics for Flow Matching

Flow matching trains a continuum of velocity regression problems but usually reports a loss averaged over interpolation time, obscuring which regions are limited by intrinsic ambiguity and which remain data-limited. We introduce the Velocity Ambiguity Profile (VAP), $\mathcal{A}_v(t)$, the time-local Bayes-risk floor of velocity prediction, and decompose time-resolved loss as $L_N(t)=\mathcal{A}_v(t)+R(t;N)$, where only the excess term $R(t;N)$ is reducible by more data or a different estimator. For $N$ training samples and a $K$-component mixture in the structured example, we prove two statistical benchmarks. In an intrinsic local-regression benchmark, $\mathcal{A}_v(t)$ enters the time-dependent noise factor of the standard nonparametric rate. In separated isotropic Gaussian mixtures, the Bayes velocity becomes locally affine, and a label-oracle residual-regression benchmark has parametric excess-risk scale $K\mathcal{A}_v(t)/N$, matched within the same separated residual Gaussian-location subproblem. Controlled Gaussian-mixture experiments validate this diagnostic through a dense transition sweep, calibrated oracle-to-blind and empirical-proxy audits, and a local controlled time-sampler stress test in which a frozen reducible-error proxy reduces reducible loss while cross-cell sensitivity delimits aggressive sampling. On CIFAR-100 DINOv2 feature flow, guided time sampling reduces uniformly evaluated velocity loss by $6.78\%$ and global feature Fréchet distance (FD) by $23.6\%$, while class-conditional kernel inception distance (KID) shows no improvement. VAP turns an averaged flow-matching objective into a time-resolved diagnostic for locating ambiguity-limited and data-limited regions.