论文多源确认78°

大模型无需微调即可遭受密码攻击

Arbitrary Cipher Attacks Against Large Language Models Do Not Require Fine-Tuning

精选理由

OpenAI等大模型存在新漏洞,攻击者只需提示词就能让模型学会加密通信,绕过安全检测。

研究人员发现前沿大模型无需微调即可通过提示词学习密码通信技能。该攻击方法绕过了Anthropic、Google和OpenAI等公司开发的模型的安全防护机制。

正文

攻击者通过加密有害内容,使模型输出看似无意义的文本,从而绕过有害内容分类器。

原文 · arXiv: OpenAI

Arbitrary Cipher Attacks Against Large Language Models Do Not Require Fine-Tuning

Large language model safety and security research is preoccupied with, among other things, detecting and preventing jailbreak attacks: alignment bypasses that allow an adversarial user to elicit unwanted or harmful outputs from models. Arbitrary cipher, or covert communication, attacks are one such type of jailbreak and have previously been demonstrated against the fine-tuning APIs of commercial models. In these attacks, target models are trained on a corpus of encrypted harmful questions and responses and subsequently respond to harmful requests through the learned encryption scheme. In this paper, we show that newer frontier models do not require fine-tuning to acquire cipher-based communication skills. Instead, they can learn these skills through prompting and, when necessary, through in-context learning. Furthermore, model alignment is significantly weakened or entirely bypassed when communication occurs through the learned cipher. To the best of our knowledge, this constitutes a novel attack vector against commercial black-box large language models. We demonstrate successful jailbreaks against frontier models developed by Anthropic, Google, and OpenAI. Our attack bypasses commercial harmfulness classifiers because harmful content is encrypted and therefore appears as nonsensical text or gibberish.

产业坐标与信源核验

本条情报归属 AITOP「论文」核心栏目,重点聚焦北美前沿实验室与硅谷科技巨头。在跨区域产业观察坐标中,该动态直接关联「中美大模型技术代差与商业化对照」「各国 AI 监管法案、合规治理与主权算力政策」研究主线,反映出当前技术演进与商业落地的最新风向。涉及核心实体与技术议题包括:jailbreak、大模型安全、密码攻击、Anthropic,读者可通过下方标签进入对应专题页查阅历史脉络与关联对比。

信源核验说明:本文原始信息发布自一手权威信源「arXiv: OpenAI」(Tier-1 一手发布),具备高确定性参考价值。截至目前,全网已有 11 家独立信源对该事件进行交叉印证与跟进报道(含 shao__meng、Paul Graham、Decoder 等),属于近期高关注度行业信号。