论文

EasyProver 系统在 Lean 定理证明上逼近基准饱和并推出更难的 Aegis

Scaling Lean Theorem Proving for Real-World Code Verification

精选理由

一个不用微调就能做完 IMO 2026 全部形式化题的 Lean 证明系统,还顺手造了个更难的真实代码验证基准 Aegis,做形式化验证的可以看看。

EasyProver 用递归智能体、隔离上下文、异步搜索和并行 tactic 探测构建 Lean 证明系统,无需额外训练,在 PutnamBench 上解决 669/672 题,并完成全部 6 道 IMO 2026 形式化题目。在代码验证方向,它解决了 597/600 个 NTP4VC 验证条件和全部 189 个 VERINA 任务。由于这些基准接近饱和,团队推出 Aegis,将竞赛编程题转换为基于真实 Rust 实现的更难验证任务,产出 2,045 个经差分验证的 Rust-Lean 程序对和 11,533 条候选规格。在 2,000 条语句的分层抽样中,EasyProver 在每题 30 分钟预算内证明了 52.7%。

原文 · arXiv cs.AI

Scaling Lean Theorem Proving for Real-World Code Verification

We present EasyProver, a Lean proving system built from recursive agents with isolated contexts, asynchronous search, parallel tactic probing, and an elastic elaboration service. Using an off-the-shelf frontier model with no additional training, it proves 669/672 PutnamBench problems and all six IMO 2026 formalizations and resolves 597/600 NTP4VC verification conditions and all 189 VERINA tasks by proof or refutation. Because these benchmarks are close to saturation, we also introduce Aegis, which converts competitive programming problems into much harder verification tasks over real implementations. The pipeline writes safe Rust solutions, translates them into Lean with Aeneas, generates specifications, and labels each frozen statement with a kernel-checked proof or refutation. It produces 2,045 differentially validated Rust-Lean program pairs and 11,533 candidate specifications. Unlike hand-written benchmarks, these tasks carry implementation-level obligations from fixed-width arithmetic, explicit failure, generated loops, casts, and functionalized mutation. On a stratified sample of 2,000 statements, EasyProver proves 1,054 (52.7%) within a 30-minute budget per statement. The same tasks can also be used to benchmark other provers and as rewards for reinforcement learning.