Goodfire 用模型内部信号检测 AI 作弊，成本几乎为零
精选理由
Goodfire 的 Tom McGrath 讲他们怎么从模型内部信号里抓到作弊行为，还做成几乎零成本的监测器，做 AI 安全的可以看看。
Goodfire 联合创始人兼首席科学家 Tom McGrath 介绍了团队在所研究模型中检测到内部作弊信号的过程。该信号被转化为一个低成本的监测器，用于发现模型的不当行为。McGrath 表示，相比模型本身的运行成本，这个监测器几乎不花钱。这项工作属于可解释性方向的应用实践。
原文 · The Information
Can we catch an AI cheating by looking inside its “brain”?
@GoodfireAI co-founder and chief scientist Tom McGrath explains how his team detected an internal cheating signal in the models they studied—and turned it into a low-cost monitor.
“It costs almost nothing to run compared to the model.”
🚀 Watch the full episode of AI Deep Dive: https://t.co/QTigsLSxNq
