论文

EDGAR:用扩散模型修复高斯头像的模糊与拉伸伪影

EDGAR: Efficient Diffusion-Driven Gaussian Avatar Refinement via Synthetic Failure

精选理由

做 3D 头像的朋友可以看看,高斯 splatting 重建出的脸容易糊和拉伸,这篇用一步扩散模型修图,还不用逐帧跑,代码已开源。

高斯 splatting 头像重建在单目视频或单图输入下常出现模糊、拉伸和时间不稳定等问题。论文提出 EDGAR,一个条件扩散框架,通过一步扩散主干融合 Sapiens 模型提取的身份特征来去除伪影。训练数据 EDGAR-SET 由真实采集和合成渲染样本组成,用降质渲染图配对真值图模拟高斯头像的典型失败场景。模型采用 Mixture-of-Experts 架构处理不同类型和程度的退化,修复后的多视角渲染作为伪目标优化单一高斯头像,最终渲染无需逐帧运行 EDGAR。在 3 种高斯头像重建方法、各 3 种设置下,EDGAR 在感知和重建指标上均优于原始输出和 SDEdit 风格的精修基线。

原文 · arXiv cs.LG

EDGAR: Efficient Diffusion-Driven Gaussian Avatar Refinement via Synthetic Failure

Recent advances in Gaussian splatting have enabled efficient and photorealistic head avatar reconstruction, yet monocular video-based or image-based methods still suffer from under-constrained geometry and texture, leading to artifacts such as blurring, stretching, and temporal instability. We present EDGAR (Efficient Diffusion-Driven Gaussian Avatar Refinement), a conditional diffusion framework designed to enhance the quality of Gaussian avatars by correcting artifacts while preserving identity fidelity. To train EDGAR, we construct EDGAR-SET, a hybrid triplet dataset composed of real-captured and synthetic-rendered samples, which simulates realistic Gaussian avatar failure cases by pairing degraded renderings with ground-truth and reference images. EDGAR refines degraded frames through a fusion block that injects identity features extracted by the self-supervised Sapiens model into a one-step diffusion backbone, enabling effective artifact removal without sacrificing efficiency. Our EDGAR model incorporates a Mixture-of-Experts (MoE) architecture to address diverse degradation types and severity levels. The refined multi-view renderings are subsequently used as pseudo-targets to optimize a single underlying Gaussian avatar, so that the final avatar can be rendered without applying EDGAR to every output frame. Experiments on three different Gaussian avatar reconstruction methods, each evaluated under three different settings, show improvements in both perceptual and reconstruction measures over the raw outputs and an SDEdit-style refinement baseline. In addition, cross-view evaluation demonstrates improved calibrated consistency, while tests under large yaw and open-mouth expressions verify robustness under extreme settings. These results collectively indicate a useful operating regime for recoverable appearance artifacts. The code is available at https://kwanyun.github.io/edgar/