OpenAI API 推出 12 小时提示词缓存选项
做长期运行智能体的朋友看过来,OpenAI API 现在缓存能存 12 小时,隔几小时的请求也能省缓存输入费用。
OpenAI 在 API 中新增 12 小时提示词缓存选项。持续运行的智能体可以全天复用上下文,共享指令、工具和上下文的缓存时间显著延长。即使两次请求相隔数小时,也能按更低的缓存输入价格计费。
You can now choose 12-hour prompt caching in the API. Persistent agents, like dots, reuse context throughout the day. You can keep shared instructions, tools, and context cached longer and pay the lower cached-input rate, even when requests are hours apart. 💬 41 🔄 13 ❤️ 344 👀 16605 📊 76 ⚡