技巧73°

微软论文:基于日志的编程助手提示优化

精选理由

微软论文教你用现有日志让编程助手写出更好提示,比传统调优工具更有效还省钱。

微软研究团队发表论文,提出一种新型编程助手提示优化方法。该方法通过分析助手历史日志来改进提示词,在4个基准测试中击败了GEPA调优工具。新方法成本约为每提示1.60美元,能有效捕捉重复性错误。研究建议优先使用日志分析,而非试错调优来获取主要性能提升。

原文 · rohanpaul_ai

New Microsoft paper shows a coding agent that studies your agent's old logs usually writes a better prompt than trial-and-error tuning tools, so start there.

Many prompt-tuning tools tweak the prompt, rerun the agent, and judge each change from just a few runs.

This paper skips all that and hands your agent's saved logs to an ordinary coding agent. It writes code to count what happens across every run, so it catches repeat mistakes that a handful of runs can hide.

Given the same logs, the coding agent's prompts beat the tuning tool GEPA on 3 of 4 agent benchmarks, at about $1.60 per prompt.

Point a coding agent at the logs you already have first, and save trial-and-error tuning for squeezing out the last gains.