HamiFormer:双专家扩散场模型发布
HamiFormer: Dual-Expert Diffusion Fields with Affine Symplectic Maps
清华团队发布HamiFormer,用双专家扩散场解决动力学预测问题,在碰撞模拟上比现有模型误差降低超20%。
HamiFormer结合全窗口去噪与残差校正哈密顿传播,在192步评估中,相比PhysiFormer在HamiBalls-1上降低26.3%归一化相空间MSE,相比DiT在HamiBalls-2上降低21.4%。该模型通过并行局部仿射扫描(PLAS)实现迭代精度的分摊,并在两个数据集上展现出最低的远期位置和动量误差。
HamiFormer: Dual-Expert Diffusion Fields with Affine Symplectic Maps
Predicting smooth dynamics and collisions requires modeling continuous evolution and abrupt state changes. We introduce HamiFormer, a dual-expert diffusion field combining whole-window denoising with residual-corrected Hamiltonian propagation. Their mixed-state feedback attenuates the direct contribution of inherited autoregressive error: each mixed state guides subsequent propagation within the jointly refined window. Parallel Local Affine Scan (PLAS) amortizes iterative refinement across rectified-flow steps and evaluates derivatives in parallel across physical time. PLAS's affine symplectic maps achieve lower solver error and runtime than sequential explicit Euler in our evaluation. A Regime Model Tree specializes residuals and routing to balance typical-state accuracy against large tail errors. Our analysis gives conditions for physically consistent refinement and warm-start tracking, and finite-window error bounds under diffusion feedback. In 192-step evaluations, HamiFormer reduces normalized phase-space MSE by 26.3% against PhysiFormer on HamiBalls-1 and 21.4% against DiT on HamiBalls-2, with comparable model capacities. Disjoint-interval comparisons show the lowest late-horizon position and momentum errors among baselines on both datasets. Project page: https://hamiformer.github.io/.