tszzl:对齐领域自 RLHF 以来无根本性进展
算法圈知名账号 tszzl 吐槽对齐研究:RLHF 之后基本原地踏步,能力跑得比安全远太多,说法挺尖锐的。
X 用户 tszzl 发帖称,自 RLHF 之后,对齐领域没有出现根本性进展。他认为大部分工作仍停留在民间理论层面,尚未形成真正的科学或工程学科。他还表示,能力发展跑在可解释性和对齐前面的预测已经成真。
there have not been fundamental advancements in alignment since RLHF. most of the stuff remains at the level of folk theory rather than scientific or engineering disciplines. the prediction that capabilities would race far ahead of interp and alignment has come true imo