ActGov:在工具调用生效前逐条验证LLM智能体动作的运行时框架
ActGov: Governing LLM Agent Actions via Policy-Constrained Validation
智能体跑长任务容易中提示注入,这篇给了逐动作把关的运行时方案,AgentDojo上比现有防御更稳
论文提出ActGov框架,在LLM智能体的每次工具调用产生外部效果前进行运行时验证,防止不可信输出越权执行。ActGov-Policy从工具规范、良性任务和失败轨迹中迭代构建策略集,每次更新都通过SMT反例检查验证。ActGov-Runtime把每个工具调用抽象为有限策略记录,仅在任务授权边界内并满足全部适用策略时才放行。在AgentDojo和AgentDyn基准的多模型、多攻击配置测试中,ActGov持续降低间接提示注入攻击的成功率,同时保持任务效用。
ActGov: Governing LLM Agent Actions via Policy-Constrained Validation
Large language model (LLM) agents increasingly execute long-horizon workflows through external tools, allowing untrusted outputs to influence subsequent actions and exceed user authorization. Existing defenses isolate injected content or constrain execution with predefined plans and static policies, but these approaches are brittle under dynamic workflows and scale poorly across extensible tool ecosystems. In this work, we present ActGov, a runtime enforcement framework that validates each LLM-proposed tool action before it causes external effects. Built on a unified semantic model of authorization, actions, runtime context, and security constraints, the ActGov-Policy component iteratively constructs a policy set from tool specifications, benign tasks, and observed failure traces, with each update verified through SMT-based counterexample checking. At runtime, ActGov-Runtime abstracts each tool call into finite policy records and permits it only if it remains within the task-scoped authorization boundary and satisfies all applicable policies. This per-action enforcement preserves authorization throughout long-horizon, dynamically branching workflows. We evaluate ActGov on the AgentDojo and AgentDyn benchmarks across multiple models and attack configurations. It shows that ActGov consistently reduces the success rate of indirect prompt-injection attacks while preserving task utility, significantly outperforming existing defenses. These results demonstrate that ActGov can enforce fine-grained authorization over dynamic agent executions without relying on the underlying LLM to correctly identify malicious instructions.