Together 发布 Together Compiler，推理优化从静态转向自适应
Together 发了个 Together Compiler，能把几周的人工推理调优压缩到一晚上自动跑完，做推理部署的可以看看思路。
Together 提出 Polymorphic Inference 概念，认为传统静态推理方案针对单一模型、单一流量和单一芯片做一次性调优的方式已经不适用。其发布的 Together Compiler 支持持续优化，一次隔夜运行的效果可以比肩或超过过去需要数周的人工专家调优。该方向对应模型每周更新、硬件每年迭代的行业节奏。
Inference is entering a new era. Models ship weekly, traffic shapes shift daily, and hardware turns over every year. The era of Static Inference, tuned once for one model with one traffic shape on one chip, is ending.
Welcome to the era of Polymorphic Inference: inference that adapts to new models, workloads, and hardware as they arrive.
Today we’re announcing Together Compiler, our first step into that era. It enables continual optimization, so a single overnight run can match or beat the manual expert tuning that used to take weeks.
Read the full vision from our SVPs of Research, @simran_s_arora and @realDanFu, on Polymorphic Inference and our research roadmap 👇
https://t.co/kqBbu0nDXZ
