Quant-Arena 发布:评测 LLM 端到端量化研究能力
Quant-Arena: Benchmarking LLM Agents for Quantitative Trading Research
arXiv 上这个 Quant-Arena 基准挺有意思:让 GPT-6 Astra 等 9 个模型做真实 A 股量化策略,结果没有一个跑赢等权市场,排行榜对外开放提交。
Quant-Arena 是一个面向量化研究的基准与公开排行榜,基于真实 A 股数据。模型需要构建特征和股票打分代码,仅在 2022-2023 年数据上获得反馈,并冻结策略接受 2024 年封存数据的检验。评估采用现金账户模拟,计入交易成本和基于模拟订单簿估算的市场冲击,得分以实际超额收益为主。共评测九个前沿模型,GPT-6 Astra 得分最高,但没有模型在 2024 年跑赢等权市场基准。
Quant-Arena: Benchmarking LLM Agents for Quantitative Trading Research
Quantitative research is an iterative loop: a researcher proposes a market hypothesis, implements it as an executable signal, tests it on historical data, and decides what to keep. Existing benchmarks score formulas, code, or individual trading decisions, leaving open whether large language models (LLMs) can complete this loop and produce strategies that work beyond the research period. We introduce Quant-Arena, a benchmark and public leaderboard for end-to-end quantitative research on real A-share market data. A model constructs features and stock-scoring code, receives feedback only on 2022--2023, and freezes one strategy for assessment on the sealed year 2024. A cash-account evaluator applies trading constraints and costs, including market impact estimated from a simulated order book. Scores are dominated by realized excess return and complemented by signal quality and the diversity of features used by the strategy. We evaluate nine frontier models, among which GPT-6 Astra scores highest; yet no model beats the equal-weight market in 2024. Quant-Arena is open to submissions from any model or agent harness.