#collapse

This review delves into the challenges of On-Policy Self-Distillation, highlighting the 'collapse' issue and offering insights into its causes. It's a must-read for those interested in understanding the nuances of model training with privileged information.