GALA方法实现实时3D高斯动画
One Basis to Animate Them All: Gaussian Blendshape Distillation for Real-Time Avatars
GALA让3D高斯头像动画提速千倍,手机也能流畅运行,不重新训练原模型就能用。
GALA方法通过线性混合形状蒸馏技术,将预训练头像模型的动画成本降低三个数量级。该方法使用块局部PCA构建基础,在保持渲染质量的同时支持高达60fps的帧率。研究验证了GALA在三种不同头像模型上的有效性,包括面部表情和全身服装动态动画。
One Basis to Animate Them All: Gaussian Blendshape Distillation for Real-Time Avatars
3D Gaussian avatars support fast rendering, however, their real-time animation is often challenged by the costly neural inference. We address this bottleneck and show that the animation of pretrained avatar models can be closely approximated by a linear combination of identity-independent blendshapes. Building on this finding, we introduce GALA (Gaussian Animation via Linear Approximation), a distillation method that replaces per-frame heavy neural decoding with a shallow coefficient predictor and a linear blend. To improve fidelity and reduce memory requirements, we propose to construct the basis using block-local PCA under a rendering-aware metric and a memory budget. Our method learns a shallow MLP network to predict blendshape coefficients and applies to various animation architectures without retraining original models. We validate GALA by accelerating the inference of three distinct avatar models for 3D animation of facial expressions and full-bodies with clothing dynamics. Across these models, our distillation generalizes to held-out identities and reduces CPU animation cost by up to three orders of magnitude while preserving most of the rendering quality. Excellent results of our method confirm the shared linear structure of learned avatar representations and enable highly efficient and accurate animation at frame rates reaching up to 60fps on mobile devices. Project page: https://ramazan793.github.io/gala/