ANIS 框架为智能体生成原生桌面界面,成功率达 74.5%
A Decade in a Day: Synthesizing Agent-Native Interfaces from Human-Oriented Software Evolution
给智能体设计界面这事有论文了,DeskIF-Bench 和 ANIS 都开源思路,做 agent 桌面自动化的可以看看怎么提分还省 73% token。
一篇 arXiv 论文研究了桌面软件界面对智能体使用效果的影响,并发布 DeskIF-Bench 基准,包含 255 个经产物验证的任务、覆盖六款桌面应用。通过固定任务、智能体和验证器、只更换软件版本,作者发现最新版本的界面始终让智能体表现更好,并总结出可发现性、粒度、可观测性三个关键属性。基于这些属性提出的 ANIS 框架能从已安装应用的能力自动合成面向智能体的界面。在扩展到 368 个任务、八款应用的评测中,原子级界面使 DeepSeek V4 Flash 和 Claude Haiku 4.5 的成功率比使用原生 SDK 分别提高 3.8 和 3.5 个百分点,在线 token 消耗约降低 73%,目标级指令进一步把成功率推到 74.5% 和 67.4%。
A Decade in a Day: Synthesizing Agent-Native Interfaces from Human-Oriented Software Evolution
Large language model agents are emerging as an important new class of users of desktop applications. However, existing desktop interfaces were designed for human end users or application developers, leaving agents to interpret visual controls or discover and compose low-level software operations. This mismatch can hinder even capable agents, yet it remains unclear what interface properties make desktop software easier for agents to use. To study this question, we treat software evolution as a natural source of interface variation and introduce DeskIF-Bench, a benchmark of 255 artifact-verified tasks across six desktop applications. By holding the task, agent, and verifier fixed while varying the software release, we measure how interface changes affect agent performance. Across two models and six applications, the newest release consistently outperforms the oldest. Trajectory analysis identifies three relevant interface properties: discoverability, granularity, and observability. Guided by these properties, we develop ANIS, a framework that synthesizes agent-native interfaces from the capabilities of installed applications. On an expanded evaluation of 368 tasks across eight applications, atomic interfaces improve success over native SDK use by 3.8 and 3.5 percentage points with DeepSeek V4 Flash and Claude Haiku 4.5, respectively, while reducing online token usage by approximately 73%. Goal-level commands further raise success to 74.5% and 67.4%, respectively.
- IT之家10-13 01:17原文