论文

Path-Flow Alignment:路径与流协同训练改进 flow matching

Co-Evolving Paths and Flows via Path-Flow Alignment

精选理由

改进 flow matching 训练的新论文,联合学路径和流,还修了低熵瓶颈问题,代码开源,做生成模型的可以看看。

论文提出 path-flow alignment,作为 flow matching 的统一训练目标,不再固定插值路径只学速度场,而是用同一对齐损失联合训练路径网络和流网络。作者识别出 path overfitting 这一失败模式:对齐损失下降但样本质量变差,原因是概率路径出现低熵瓶颈。为此引入随机路径正则化,对路径网络隐藏部分源信息同时保持端点不变,给出随机训练路径边际的熵下界。在 ImageNet-256x256 上用 SiT 骨干网络,该方法在不同模型规模下均提升 FID,可扩展到 model-guidance 训练,推理时的架构与采样器保持不变。

原文 · arXiv cs.LG

Co-Evolving Paths and Flows via Path-Flow Alignment

We study path-flow alignment as a unified training objective for flow matching. Instead of fixing the interpolation path and learning only the velocity field, we jointly train an endpoint-preserving path network and a flow network using the same alignment loss: the flow learns to match the path velocity, and the path learns to align its velocity to the current flow. Although every fixed learned path defines a valid flow-matching objective, the alignment loss alone is not a reliable criterion for path learning. We identify path overfitting, a failure mode in which the alignment loss decreases while sample quality worsens. We find that this failure is associated with low-entropy bottlenecks in the induced probability path, where the learned path routes samples through overly concentrated intermediate marginals. Motivated by this diagnosis, we introduce a stochastic path regularizer that hides part of the source information from the path network while preserving exact endpoints. The resulting regularization gives an explicit entropy floor for the stochastic training-path marginals and empirically suppresses the bottleneck in the learned sampler, making joint path-flow training effective. On ImageNet-256x256 with SiT backbones, our method consistently improves FID across model scales, extends to model-guidance training, and leaves the inference-time architecture and sampler unchanged. Code is available at https://github.com/lizeyu090312/traj_opt_paper