论文

联邦训练会损害 Grad-CAM 可解释性吗?深度伪造检测研究给出答案

Does Federated Training Degrade Explainability? A Comparative Analysis of Grad-CAM Faithfulness in Centralized vs. Federated Deepfake Detection

精选理由

训练深度伪造检测模型时想用联邦学习保护隐私?这篇论文用 EfficientNet-B4 做实验,告诉你数据异构到什么程度 Grad-CAM 的解释会不可信。

这项研究在 FaceForensics++ 数据集上对比了集中式与联邦式训练下 EfficientNet-B4 深度伪造检测器的 Grad-CAM 解释忠实度。实验设置了五个联邦客户端,测试不同程度的非独立同分布数据异构性。结果显示两者关系并非单调:在近 IID 和中等异构度下,联邦模型的可解释性达到甚至超过集中式基线;但在极端异构度下,解释会完全失效,空间上不一致且平均而言具有误导性。论文结论是这种退化不是联邦训练的普遍代价,而是与客户端异构度相关的阈值效应,并给出了判断何时可安全部署的实践指导。

原文 · arXiv cs.LG

Does Federated Training Degrade Explainability? A Comparative Analysis of Grad-CAM Faithfulness in Centralized vs. Federated Deepfake Detection

Automated detection has become the essential safeguard against realistic synthetic media, but deploying it at scale requires training on sensitive data from multiple organizations, putting privacy and the transparency demanded by forensic review in direct conflict. Federated learning resolves the privacy side by sharing only model updates rather than raw data, but whether this comes at the cost of trustworthy gradient-based explanations, which analysts rely on to decide whether or not to trust a flagged clip, has not been studied. We present the systematic study of Grad-CAM explanation faithfulness under federated deepfake detection, evaluating an EfficientNet-B4 detector on FaceForensics++ across five federated clients under varying degrees of data heterogeneity. We find that the relationship between federation and explanation quality is non-monotonic: at near-IID (Independent and Identically Distributed Data) and moderate heterogeneity, federated models match or exceed the faithfulness of a centralized baseline, but at extreme heterogeneity, explanations break down entirely, becoming spatially incoherent and, on average, causally misleading. This degradation is not a general cost of federated training but a threshold effect tied to client heterogeneity, and we offer practical guidance for identifying when privacy-preserving deepfake detection can be deployed safely and when its explanations can no longer be trusted. Code and data partitions are available for reproducibility.