AI EngineerGuide

OpenAI models supports 12-hour prompt caching in API

by Ashik Nesin Ashik Nesin

OpenAI models now supports 12-hour prompt caching in their API. So long running agents like OpenAI’s Dots or other personal assistant which has a long running conversation don’t ended up costing us more.

image.png

And in terms of cost it’s actually 2.5x of input token cost (whereas 1.25× for “30m”)

References

Stay Updated

Get the latest AI engineering insights delivered to your inbox.

No spam. Unsubscribe at any time.