论文

BriLLM-MetaPred:基于 AGI 数学理论的表示-预测统一语言模型

BriLLM-MetaPred: A Representation-Prediction Unity Language Model with Adaptive Self-Measurement

精选理由

一群研究者把 AGI 数学理论直接落成了语言模型,单一动态状态同时做表示和预测,性能追平同规模 GPT 基线,思路很不一样。

BriLLM-MetaPred 是 MetaPred 机器学习框架的首个工程实现,该框架源自一套 AGI 数学理论。其核心是用单一持续演化的动态状态同时充当上下文表示和预测输出来源,通过对自身状态的连续测量形成定点形式的自监督信号。该实现借助 BriLLM(Zhao et al., 2025)的 SiFu 学习范式(节点-信号流设计)得以在现有软硬件加速器上运行。在同等参数规模下,BriLLM-MetaPred 的预测性能与 GPT 基线相当。论文称这是首个完全从数学理论推导而非人工渐进设计得出的机器学习范式。

原文 · arXiv cs.LG

BriLLM-MetaPred: A Representation-Prediction Unity Language Model with Adaptive Self-Measurement

We present BriLLM-MetaPred, the first engineering implementation of the MetaPred machine-learning framework established by a mathematical theory of AGI, instantiated for language modeling. The theory argues that MetaPred is both necessary and sufficient as a machine-learning primitive for general cognition. Taking this theoretical conclusion as a design premise, we report an implementation of the primitive for language modeling. A single continuously evolving dynamical state serves as both the context representation and the state from which predictions are read out. Continuous measurement of its own state reduces finite-depth inconsistency, maintains internal consistency, and provides an endogenous dynamical self-supervision signal in fixed-point form. The single dynamical state of MetaPred intrinsically couples training and inference. MetaPred therefore exhibits symmetry across almost all key elements of machine learning, an intuitive and observable property of the mathematical optimum over the space of all machine-learning paradigms. BriLLM-MetaPred is neither another recurrent language model nor an extension of BriLLM. It provides a bridge between two prior contributions: the construction and motivation of the MetaPred primitive provided by AGI theory, and the SiFu learning paradigm provided by BriLLM (Zhao et al., 2025). The latter's node-signal-flow design enables the primitive to run on available software and hardware accelerators. Our implementation of BriLLM-MetaPred achieves predictive performance comparable to a GPT baseline of the same size. This provides initial evidence for the engineering feasibility of the MetaPred framework established by the mathematical theory of AGI. MetaPred is the first machine-learning paradigm derived entirely from mathematical theory rather than assembled and incrementally improved through human design---and perhaps the last such paradigm.