X-AgentRed 框架通过工具依赖图自动发现个人智能体的有害调用路径
X-AgentRed: Red-Teaming Personal Agents in Evolving Multi-Service Ecosystems
个人智能体连一堆服务,良性请求也可能串出有害结果。这篇提出用工具依赖图自动挖有害路径,比 STAC 多 77%,还覆盖近 3 倍工具。
X-AgentRed 是一个自我进化的红队测试框架,用于发现个人智能体在多服务环境中执行良性请求时产生的有害工具调用路径。该框架构建有向图捕捉工具效果如何满足其他工具的执行前置条件,并利用执行反馈进行自我改进。在四个前沿智能体模型上,X-AgentRed 的有害路径率达到 STAC 的 1.77 倍,工具覆盖率为平均 2.99 倍。
X-AgentRed: Red-Teaming Personal Agents in Evolving Multi-Service Ecosystems
Personal agents increasingly connect to services across the web and applications by using tools. As the effects of their actions accumulate and interact across services, unintended or harmful outcomes can arise when agents fulfill benign user requests. Proactively identifying these compositional failures requires systematically exploring diverse cross-service paths. Existing red-teaming methods often simply prompt LLMs to identify potentially harmful paths from task and environment descriptions or decompose harmful objectives specified by humans or LLMs into seemingly benign action combinations. However, generation is biased toward patterns learned during training, potentially favoring familiar tool combinations and leaving novel cross-service interactions underexplored. To address this, we propose X-AgentRed, a self-evolving red-teaming framework that discovers harmful tool call paths through a graph of tool dependencies and expands and refines them using execution feedback. By analyzing each tool's effects, potential harms, and preconditions for execution, the red-teaming agent constructs a directed graph that captures how one tool's effects can satisfy another's execution preconditions. Recipes sampled from this graph are instantiated as realistic scenarios in which agents can produce harmful outcomes. Execution feedback enables self-improvement by diversifying paths that produce harm through tool substitution and refining preconditions at blocked steps in unsuccessful paths to enable further execution. Across four frontier agentic models, X-AgentRed achieves $1.77\times$ the harmful path rate of STAC and explores a more diverse set of tools, yielding $2.99\times$ the tool coverage on average.