KARMA:免训练框架让广告智能体自动进化知识模块
KARMA: Training-Free Knowledge-Atomic Harness Evolution for Industrial Advertising Agents
阿里的广告智能体不用微调模型,靠自动改知识库就把成绩从30.19提到39.15,还能跨领域复用,做Agent的朋友可以看看思路。
KARMA(Knowledge-Atomic, Regression-Gated Modular Adaptation)是一个免训练框架,在模型权重和执行代码冻结的情况下,对六类知识模块做原子化编辑。其流程由 Trace Verifier 定位错误模块、Critic 对比成功与失败轨迹、Evolver 生成编辑,再经固定验证门控决定是否保留。在约 50 万条真实运营日志、六个电商领域、18 个领域-模型组合的评测中,KARMA 将平均 hold-out 得分从 30.19 提升到 39.15(+8.96 分,+29.7%)。消融实验显示去掉成功或失败轨迹任一类数据,平均增益会减少一半以上;进化出的知识跨领域迁移时仍能带来 8.54 分的平均增益。
KARMA: Training-Free Knowledge-Atomic Harness Evolution for Industrial Advertising Agents
Industrial advertising agents must continually adapt their decision knowledge to changing product offerings, traffic patterns, and operating policies. We present KARMA (Knowledge-Atomic, Regression-Gated Modular Adaptation), a training-free framework that evolves six typed knowledge modules while keeping model weights and executable harness code frozen. During our evolution, a deterministic Trace Verifier maps observed errors to candidate modules, and a Critic compares successful and failed trajectories to guide a tool-constrained Evolver. The Evolver applies atomic knowledge edits, which a fixed validation gate retains only when their measured gain reaches a threshold; otherwise, the previous knowledge state is restored. We evaluate KARMA with three LLM families on cases sampled from a corpus of approximately half a million real-world operation logs across six e-commerce domains. Across 18 domain--model settings, KARMA raises the average hold-out score from 30.19 to 39.15 (+8.96 points, +29.7%). Ablations show that removing either successful or failed trajectories more than halves the average hold-out gain. Evolved knowledge also transfers across domains without further adaptation, yielding an average hold-out gain of 8.54 points across all source--target pairs. By linking retained patches to their diagnostic evidence and validation outcomes, KARMA supports inspectable, reversible knowledge adaptation for agents in Web marketplaces.