Prompt caching starting December 1, 2025

Change effective on 24 November 2025

On December 1, 2025, we will automatically enable prompt caching for system prompts and tool definitions. Prompt caching optimizes the Heroku Managed Inference and Agents add-on to deliver faster responses for common workflows, document processing, and code-generation tools. You can disable prompt caching for any request.

For more information on this new feature, see Prompt Caching.