开源平台按任务路由专用模型，替代单一大型模型
精选理由
做智能体的可以看看：分类、OCR、搜索、写作各配一个小模型，比全用一个大的更省更快，开源直接用。
开发者 Santiago 在 X 上分享了一个开源平台，核心思路是用多个专用小模型替代单一大型模型。平台允许为不同任务配置不同模型来服务，例如一个智能体需要消息分类、图片文字识别、文件搜索和回复生成时，可以分别指派 4 个不同的模型处理。这种按任务拆分的方式可以降低推理成本和延迟。
原文 · Ate-a-Pi
Specialized Models >> Larger Models.
This is an open-source platform that will help you choose and run specialized models in your applications.
Basically, you can set up which models you want to serve specific tasks.
For example, if your agent needs to classify a message, read text on an image, search files, and write a response, you could have 4 different models to serve each of these tasks.
