Kairos:在系统边界为 LLM 智能体做事务性安全防护
Kairos: Transactional Security Enforcement at the System Boundary for LLM Agents
智能体被注入指令时防不住?这篇论文把放行决定推迟到证据够了再做,AgentDojo 上攻击成功率从 47% 压到 2.7%,做安全的人可以细看。
arXiv 论文提出 Kairos,一个部署在未修改、不透明智能体隔离边界上的参考监视器。工具调用、shell 命令和智能体写入的脚本都统一为文件与网络操作跨过边界,由声明式策略确定大部分操作效果,其余延迟裁决。在 AgentDojo 基准上,Kairos 将间接提示注入攻击成功率从 47.0% 降到 2.7%,良性任务效用保持与无防护智能体相当。实验覆盖 3 个基准和 3 个智能体模型,在攻击成功率与效用的权衡上优于现有防御方案。
Kairos: Transactional Security Enforcement at the System Boundary for LLM Agents
Large language model (LLM) agents are becoming an integral part of the software development lifecycle, and the capabilities granted to them allow an agent to act with the user's authority on any resource it can access. The reach that gives an agent its utility is equally available to an attacker who can steer it. Anything an agent ingests can carry an injected instruction, and since the model does not reliably distinguish instructions from data, indirect prompt injection should be mitigated by mediating the effects the agent produces. Such mediation faces a structural difficulty. Legitimate work and the first step of an attack often look alike when an individual action is observed, and what separates them lies later in the trace, so a monitor limited to allow and deny is forced to decide before the evidence accumulates. We present Kairos, a reference monitor at the isolation boundary of an unmodified, opaque agent, where a tool call, a shell command, and a script the agent writes all cross the boundary as the same file and network operations, so that confinement holds regardless of the agent's behavior. A declarative policy that states which sources are trusted decides most effects deterministically and defers the rest, which are held while the agent continues speculatively. A decision oracle with bounded authority, such as a language model or a human, releases or refuses each deferred effect on the trace. Across three benchmarks and three agent models, Kairos outperforms existing defenses in the trade-off between attack success and utility. In particular, on AgentDojo, it reduces attack success from 47.0\% to 2.7\% while its benign utility stays at the level of the undefended agent.
- shao__meng10-12 03:55原文