论文官方一手精选

Meta 公开 JiTTesting 生产环境实践:用 LLM 在代码合入前自动生成测试抓 Bug

Catching Bugs Before They Land: JiTTesting’s Human-on-the-Loop Approach at Full Scale

精选理由

Meta 把 LLM 生成测试这套流程跑进生产了,还发了论文讲细节,做工程效能的可以看看他们怎么设计人机分工。

Meta 发布论文《Just-in-Time Catching Test Generation at Meta》,详细介绍 JiTTesting 在生产环境一年的落地结果。该方法由 LLM 在代码变更时即时生成测试(JiTTests),并采用 human-on-the-loop 模式让工程师参与把关。文章称该方案已规模化部署,用于在 Bug 合入主干之前拦截。

图片来源 · Meta Engineering Blog
原文 · Meta Engineering Blog

Catching Bugs Before They Land: JiTTesting’s Human-on-the-Loop Approach at Full Scale

Over the last year we’ve been sharing our work leveraging large language models to catch bugs on the fly — a novel approach we call Catching Just-in-Time Tests (JiTTests). Now, we’re sharing the results and positive impact we’ve seen with Catching JiTTests deployed into production. Our paper, “Just-in-Time Catching Test Generation at Meta,” fully details [...] Read More... The post Catching Bugs Before They Land: JiTTesting’s Human-on-the-Loop Approach at Full Scale appeared first on Engineering at Meta .