论文

Seq-Flow:基于自滚动误差控制的概率预测流模型

Seq-Flow: Efficient Probabilistic Forecasting with Self-Rollout Error Control

精选理由

加速度器束流预测上 CRPS 降了 65%,还能连续跑 400 多步预测不崩,做时序概率预测的可以看看这套自滚动训练思路。

Seq-Flow 是一个条件流模型,其 ODE 将样本从上一次预测分布输送到更新后的分布,无需从高斯噪声重新生成。模型采用 self-rollout 训练,用移动平均副本生成的预测来初始化后续训练更新,从而控制递归复用中的误差累积。在粒子加速器束流预测任务上,Seq-Flow 在少 NFE 采样预算下将 CRPS 降低 65%。训练仅使用至多 4 次更新的自滚动,却能在超过 400 次连续更新中保持准确,同时在流体动力学预测任务上与强基线保持竞争力。代码已在 GitHub 开源。

原文 · arXiv cs.LG

Seq-Flow: Efficient Probabilistic Forecasting with Self-Rollout Error Control

Many scientific forecasting tasks require updating a distribution over future trajectories as new observations arrive. Conventional diffusion and flow models generate each forecast from Gaussian noise, often at the cost of many sampling steps. Warm-start methods reuse earlier predictions to reduce this cost, but their models are not trained to perform the forecast update itself, which can compromise quality under few-step sampling. In this work, we introduce Seq-Flow, a conditional flow model whose ODE transports samples from the previous forecast distribution to the updated one. Because successive forecasts often differ only modestly, this transport starts from an informative distribution and can produce accurate updates with few flow evaluations. Recursive reuse also creates a challenge: errors in one forecast become errors in the initial states of subsequent flows. We address this with self-rollout training, in which a moving average copy of the model generates forecasts that initialize later training updates. Unlike self-forcing methods, which reuse generated outputs as conditioning context, Seq-Flow reuses them as the source of the next flow. Experiments On particle-accelerator beam spill forecasting show Seq-Flow reduces CRPS by 65% under a few-NFE sampling budget, while remaining competitive with strong baselines on fluid-dynamics forecasting tasks. Although trained on self-rollouts of at most four updates, Seq-Flow remains accurate over more than 400 consecutive updates. Our code is available at https://github.com/Graph-COM/Seq-Flow.