论文09:54
One Symptom, Three Levers: A Critical Review of On-Policy Self-DistillationThis review delves into the challenges of On-Policy Self-Distillation, highlighting the 'collapse' issue and offering insights into its causes. It's a must-read for those interested in understanding the nuances of model training with privileged information.