FreeMatching:通用密集对应匹配框架
Beyond Spatio-Temporal Priors: A Generalizable Approach for Dense Correspondence Matching
FreeMatching突破了传统时空先验限制,在图像编辑和生成任务中实现了更好的对应匹配。
FreeMatching结合生成式和语义基础表示,通过异构监督改进对应匹配质量。该模型在图像编辑和参考引导生成任务中表现优异,在IEG图像对上显著提升对应质量。同时,FreeMatching可作为身份保持评估的定量指标,其评分与人类判断高度相关。
Beyond Spatio-Temporal Priors: A Generalizable Approach for Dense Correspondence Matching
Dense correspondence matching has historically been bounded by simplifying spatio-temporal priors, such as smooth motion and rigid geometry. While effective for classical tasks, these assumptions break down in image editing and reference-guided generation (IEG), where transformations can preserve visual identity while breaking physical continuity. To establish identity-preserving correspondence across such transformations, we introduce FreeMatching, a generalizable framework combining generative and semantic foundation representations with heterogeneous supervision from classical datasets, tracked videos, and synthetic scenes. Teacher-guided iterative refinement further improves correspondence in IEG without dense correspondence annotations. Experimentally, a single FreeMatching model substantially improves correspondence quality on challenging IEG image pairs while retaining competitive performance on classical benchmarks. Furthermore, we demonstrate its utility as a quantitative metric for evaluating identity preservation, with scores that correlate with human judgment. The code is available at https://github.com/luping-liu/FreeMatching.