OpenAI 展示内部模型测试时算力曲线,Navier-Stokes 成绩未见收益递减
OpenAI 贴出内部模型在求解 Navier-Stokes 时的算力曲线,测试时推理收益还没到头,数学能力还在涨。
OpenAI 在 Navier-Stokes 求解结果公布时附上一张内部模型图表,显示测试时算力持续提升、未出现收益递减。该模型被发布者称为 GPT-Aeon。OpenAI 博客称,自 8 月 28 日起训练的新内部模型在包括数学在内的基准上表现突出,且训练仍在进行、性能持续改善。
OpenAI posted a chart for the internal model that solved Navier–Stokes (the model I call GPT-Aeon) with the NS announcement. There were no diminishing returns on test-time compute, it was still going up. I will quote from the blog:
'Since August 28 we have been training a new internal model that has exhibited unprecedented performance in our benchmarks, including mathematics. This model’s training is ongoing and its performance continues to improve.'
That was two months ago.