Bitter Lesson 的实践解读：加结构也要会拆结构
Hyung Won Chung 讲怎么把 Bitter Lesson 落到日常工程决策里：先加结构推进，条件变了就拆掉。做模型和系统设计的人可以看看。
Hugging Face 工程师 Hyung Won Chung 重提 2.5 年前关于 Bitter Lesson 的演讲。他指出人们口头认同该原则，但日常工作中很少真正遵循。他的实践解读是：先用当前的方法、算力和数据加结构以推进进展，同时记住这些结构的成立条件。条件变化后要重新审视并移除不再需要的结构。
In AI, most artifacts have a short shelf life. So I’m glad this talk I gave 2.5 years ago is still relevant to some people.
The Bitter Lesson has become much more popular since then, but I’ve seen a gap between how readily people agree with it and how much it actually guides their day-to-day work. That’s partly because it’s a statement about what wins in the long run, which doesn’t easily translate into day-to-day decisions, especially under enormous pressure to deliver. What I tried to offer in this talk was a practical interpretation.
That interpretation starts with acknowledging that we have to make progress with the methods, compute, data, and algorithms available today. So we add structure that enables progress now.
But we should remember what justified that structure and revisit it when those conditions change. When it’s no longer needed, remove it. Adding structure while understanding when to take it out may not look "Bitter Lesson pilled" at first glance, but I think this is how we actually put the lesson into practice.
