研究发现推理模型对思维链的可控性远高于此前评估结果
一篇有意思的论文:同样约束写进思维链里,推理模型就听话多了,还不用碰推理通道,做提示词的可以试试
这篇论文重新测试了推理模型对思维链(CoT)的约束能力。此前评估把约束放在用户提示里,测得的可控性很低;研究者改为把同一约束写进思维链内部作为自我指令,模型遵循的频率明显提高。加一句通用的“遵守用户约束”提醒也带来显著改善,且自我指令可以仅由用户提示触发,无需访问推理通道。
Interesting finding about reasoning models and CoT.
They find that reasoning models can control their chain of thought much better than earlier tests suggested.
Earlier evaluations put the constraint in the user prompt and found very low controllability. Researchers put the same constraint inside the chain of thought as a self-instruction, and models followed it far more often.
A generic reminder to follow the user's constraint also helped a lot. The self-instruction can be triggered from the user prompt alone, so no access to the reasoning channel is needed.
Paper: https://t.co/fyagSbVT8M
Chat with Paper: https://t.co/90LdW0qwdW