黑盒大模型秘密提取框架研究
Practical Secrets Extraction against Black-box LLMs
研究人员发现黑盒大模型可能泄露训练数据中的机密信息,提出新框架能从API接口提取出真实密钥。
研究人员提出针对商业API大模型的黑盒秘密提取框架。该框架包含交叉验证秘密知识蒸馏和代理引导秘密提取两部分。
在API密钥基准测试中,该框架提高了恢复有效率和真实密钥率,同时降低了提取延迟。研究团队从OpenAI和Claude Code三个独立部署的黑盒系统中成功恢复了被屏蔽的提供商特定凭证。
Practical Secrets Extraction against Black-box LLMs
Large language models (LLMs) increasingly power autonomous coding agents such as Codex and Claude Code, yet their training corpora may contain confidential credentials exposed in public repositories or collected from private development artifacts, creating risks of memorization and subsequent leakage. Existing extraction audits, however, largely assume access to model weights or token probabilities. In this work, we present a black-box secret extraction framework for commercial, API-based LLMs under output-only access. It comprises (i) \emph{Cross-Validated Secret Knowledge Distillation}, which uses semantics-preserving prompt variants, response cross-validation, and provider-specific format filtering to distill secret-relevant behavior into a local white-box proxy; and (ii) \emph{Proxy-Guided Secret Extraction and Candidate Filtering}, which combines truncated top-$p$ sampling with local token entropy, $N$-gram frequency profiling, and provider-specific structural priors. On controlled API-key benchmarks, our framework improves recovery effectiveness and real-key rates over representative baselines while reducing extraction latency. A responsible real-world evaluation further recovers masked provider-specific credentials from three independently deployed black-box LLM systems spanning OpenAI and Claude Code, showing that memorized secrets can be exposed under output-only access.
本条情报归属 AITOP「论文」核心栏目,重点聚焦北美前沿实验室与硅谷科技巨头。在跨区域产业观察坐标中,该动态直接关联「各国 AI 监管法案、合规治理与主权算力政策」「AI 开发者工具链、Coding Agent 与工程化实践」研究主线,反映出当前技术演进与商业落地的最新风向。涉及核心实体与技术议题包括:LLMs、Claude Code、OpenAI、秘密提取,读者可通过下方标签进入对应专题页查阅历史脉络与关联对比。
信源核验说明:本文原始信息发布自一手权威信源「arXiv: OpenAI」(Tier-1 一手发布),具备高确定性参考价值。截至目前,全网已有 11 家独立信源对该事件进行交叉印证与跟进报道(含 Gergely Orosz、Tibor Blaho、IT之家 等),属于近期高关注度行业信号。