论文

TailSteer:面向多轮图像编辑的抗漂移轨迹末端训练框架

TailSteer: Trajectory-Tail Steering for Drift-Resistant Multi-turn Image Editing

精选理由

多轮改图容易越改越跑偏,TailSteer 只在去噪末端做修正,FLUX、Qwen 上验证有效,做图像编辑的可以看看这篇。

TailSteer 是一种最终阶段训练框架,用于解决多轮图像编辑中反复复用编辑结果导致的视觉漂移问题。其原理是在早期去噪阶段保持与基础模型一致的动力学,把保真修正集中在轨迹末端。修正信号来自编辑器自身的 on-policy 去噪 rollout,用未修改的源内容作为保真参考,不需要人工标注的编辑数据对。在 FLUX、SenseNova、Qwen 三个模型家族上的实验显示,TailSteer 将 15-20 轮编辑的累积漂移明显降低,同时在文生图和单图编辑基准上基本保留基础模型原有性能。

原文 · arXiv cs.AI

TailSteer: Trajectory-Tail Steering for Drift-Resistant Multi-turn Image Editing

Strong single-turn editing performance does not guarantee reliable multi-turn interaction: as edited outputs are repeatedly reused, small unintended changes can accumulate into severe visual drift. This long-term drift is often mitigated through training on multi-turn data or cross-turn rollouts, potentially altering pretrained priors, or through specialized inference-time mechanisms that are difficult to scale to foundation models. We introduce TailSteer, a final-stage training framework that improves multi-turn robustness while retaining the generative and editing capabilities acquired through earlier training. TailSteer follows a simple principle: keep early denoising dynamics close to those of the base model and concentrate preservation corrections near the trajectory tail, where fine-grained deviations can be suppressed. These corrections are learned from the editor's own on-policy denoising rollouts, using unchanged source content as a preservation reference without requiring curated ground-truth editing pairs. Experiments across the FLUX, SenseNova, and Qwen families show that TailSteer substantially reduces cumulative drift over 15-20 editing turns while largely preserving base-model performance on extensive text-to-image and single-image editing benchmarks. These results demonstrate that long-horizon editing robustness can be unlocked in foundation models after TailSteer, rather than by relearning their existing capabilities.