arXiv 论文提出 SAR 指标:衡量模型群体共享脆弱性
Exposing Vulnerability Monoculture Through Systemic Adversarial Robustness
一篇把'模型长得太像会不会一起被攻破'变成可算指标的研究,还实测了 DeepSeek-R1 蒸馏后的模型池确实更脆,做安全的可以看看。
arXiv 论文提出 Systemic Adversarial Robustness(SAR)指标,用攻破一个模型池所需的攻击多样性来衡量共享脆弱性,并将其形式化为带近似保证的部分集合覆盖问题。论文对视觉模型和大语言模型池做了实验,刻画了集体脆弱性曲线。结果显示从 DeepSeek-R1 和 Claude Opus 4.6 蒸馏出的模型池,估计的系统性鲁棒性低于其父模型池,指出前沿模型蒸馏可能带来系统性代价。
Exposing Vulnerability Monoculture Through Systemic Adversarial Robustness
Beneath the apparent diversity of foundation models lies an increasingly homogeneous technical stack of common training pipelines, distillation methods, and data. These shared algorithmic choices can expose an otherwise distinct model ecosystem to concentrated risks leading to a vulnerability monoculture. Yet current practice in assessing adversarial robustness is restricted to individual robustness scores and attack transfer rates, leaving open the unexplored fundamental question: how many attacks suffice for catastrophic widespread compromise? In this paper, we investigate the empirical nature of shared vulnerabilities within a model pool and introduce Systemic Adversarial Robustness (SAR), a novel measure of shared vulnerability of a model pool through the attack diversity needed to exploit it. Specifically, SAR interpolates between single-attack transferability and independent per-model robustness: small values reveal a vulnerability monoculture, whereas large values indicate that failures are dispersed across models. We theoretically formulate SAR as a partial set-cover problem with provable approximation guarantees---enabling the development of scalable algorithms to empirically measure the systemic adversarial robustness. We empirically test the shared vulnerability of vision and large language models and characterize their shared collective vulnerability curve. Specifically, we demonstrate that model pools distilled from DeepSeek-R1 and Claude Opus 4.6 exhibit lower estimated systemic robustness than their corresponding parent pools, revealing a potential systemic cost of frontier-model distillation. Our framework seeks to establish vulnerability monoculture as a measurable target for a more wholistic adversarial evaluation of model populations.