llm-d 将在 PyTorch Conference North America 发布新进展
IBM 背书的 llm-d 开源项目一年后升级，管推理扩容还支持多租户和零停机，10 月 San Jose 大会公布新消息，做推理部署的可以关注。
llm-d 是由 IBM Research 杰出工程师 Carlos Costa 参与联合创立的开源推理扩展开源项目，成立约一年后进入成熟新阶段。该项目为生成式推理服务提供领先的性能表现，并支持多租户服务质量（QoS）、零停机运维等生产环境第二天的运维能力。Carlos Costa 将在 10 月 20-21 日于 San Jose 举行的 PyTorch Conference North America 上公布项目新消息。
Get more out of your AI infrastructure.
Carlos Costa, Distinguished Engineer at @IBMResearch and co-founder of the @_llm_d_ project will share some exciting news about llm-d: how the project changed the way the open source AI community scales inference at PyTorch Conference North America.
A little over a year after the project was founded, llm-d is reaching a new level of maturity, delivering state-of-the-art performance for generative serving, while also enabling the capabilities needed for day two operations, including multi-tenant quality of service, zero downtime operations, and all of that without sacrificing performance in production.
Join us in San Jose, October 20-21: https://t.co/jBApW8ocHQ
