基于正未标记学习让扩散模型负引导实现渐近精确采样
Asymptotically Exact Negative Guidance of Diffusion Models via Positive-Unlabeled Learning
这篇论文把负引导做成了有明确目标密度的采样器,用 PU 学习加 SMC 修正,图像生成实验也验证了,做扩散模型采样的人可以看看。
论文针对扩散模型负引导的偏差问题:现有方法在每个样本注入局部排斥项,无法对应明确的目标密度,偏差也不能随计算量增加而系统性降低。新方法将负引导表述为从一个显式目标密度采样,通过 Positive-Unlabeled 学习在扩散轨迹上在线估计样本属于不良条件的概率,并用 Sequential Monte Carlo 修正粒子漂移带来的失配。在粒子数趋于无穷时采样器渐近精确,还能把任何现有负引导方法作为提议核。实验显示在 Gaussian mixtures 上逼近真实目标,在回避强度、分布偏差和多样性的权衡上 Pareto 优于现有方法。
Asymptotically Exact Negative Guidance of Diffusion Models via Positive-Unlabeled Learning
Negative guidance of diffusion models generates samples that avoid an undesired condition, specified either by reference samples or by a conditional score alongside an unconditional model. Existing methods inject repulsive terms derived from local information at each sample, so the resulting sampler does not target an explicit density, and its bias cannot be systematically reduced by increasing computation. We instead present a negative-guidance method that samples from an explicit target density, which uniformly handles both reference-sample and score-based specifications and suppresses probability mass near the undesired condition with an avoidance strength that parametrizes the target density itself. Realizing this target requires estimating, at each diffusion timestep, how likely each sample is to belong to the undesired condition. We cast this estimation as a Positive-Unlabeled learning problem that admits lightweight online training along the diffusion trajectory, using condition samples as positives and diffusion particles as unlabeled data. Because the guided particles drift from the unconditional marginal, we further correct the residual mismatch via Sequential Monte Carlo, yielding a sampler that is asymptotically exact in the particle limit and that turns any existing negative-guidance method into its proposal kernel. Empirically, our method approaches the ground-truth target on Gaussian mixtures and Pareto-dominates existing methods on trade-offs between avoidance and generation quality, distributional bias, and diversity, including in an image-generation setting with a pretrained score network.