研究SWE Agent行为的团队终于有了可量化的观察方法——Ada框架把黑箱行为变成可比较的轨迹画像,做Agent评估和调试的开发者值得关注。
论文提出Ada框架,通过有限工具接口让AI Agent在真实代码库中自由探索,记录其导航、证据选择、综合理解等行为轨迹。研究分析了408条轨迹,覆盖多种模型和仓库,将工具使用数据转化为可比较的行为画像。该方法揭示了不同Agent在效率、轨迹多样性、认知基础等方面的差异,为观察SWE Agent在真实环境中的行为提供了方法论基础。
Projecting the Emerging Mindset of SWE Agent by Launching a Wild Code Understanding Journey
Software engineering agents (SWE agents) increasingly work through tool-mediated trajectories in real repositories, yet their behavior remains difficult to characterize in concrete, observable terms. These trajectories record tool use, intermediate reasoning, evidence selection, and self-directed stopping, but they do not by themselves explain why particular moves were chosen, what evidence was trusted, or when understanding was judged sufficient. This tension makes trajectory data both limited and valuable: faithful, replayable traces can become an empirical substrate for studying agent behavior when interpreted through disciplined observation. We introduce Ada, a scoped apparatus for repository-level code understanding. Ada enters real codebases through a bounded tool interface, allowing open-ended exploration to remain recordable as finite trajectories. Across this wild-but-bounded setting, Ada chooses where to look, what to read closely, when to consolidate partial understanding, and when to close its account of the repository. We project Ada's think-action chains through observation lenses that make navigation, evidence selection, synthesis, grounding, and stopping visible without reducing behavior to raw tool counts or speculating about hidden intent. Read together, these lenses produce behavioral profiles grounded in recorded movement through software worlds. Across 408 trajectories, spanning multiple models, repositories, task families, and launch conditions, the study shows how faithful digital traces can be transformed into disciplined, comparable projections of emerging SWE-agent mindset. The results expose differences in efficiency, trajectory diversity, epistemic grounding, and the limits of intervention, while providing a methodological foundation for observing SWE agent behavior in real codebases.