Heroku Managed Inference and Agents Add-on API
Last updated May 16, 2025
The Heroku Managed Inference and Agents API offers an easy way to access various large foundational AI models. These include supported language (chat), embedding, and diffusion (image) models.
To learn more about the API endpoints, including parameters, usage examples, and responses, view the documentation linked below.
| Endpoint Documentation | Supported Models | Example Code |
|---|---|---|
| Chat Completions | Claude 3.7 Sonnet, Claude 3.5 Sonnet Latest, Claude 3.5 Haiku, Claude 3.0 Haiku |
Python, JavaScript, Ruby |
| Embeddings | Cohere Embed Multilingual | Python, JavaScript, Ruby |
| Image Generations | Stable Image Ultra | Python, JavaScript, Ruby |