AI Gateway

The AI Gateway provides a unified API to access hundreds of models through a single endpoint. It gives you the ability to set budgets, monitor usage, load-balance requests, and manage fallbacks.

The design allows it to work seamlessly with AI SDK 5, OpenAI SDK, or your preferred framework.

• Unified API: helps you switch between providers and models with minimal code changes
• High reliability: automatically retries requests to other providers if one fails
• Embeddings support: generate vector embeddings for search, retrieval, and other tasks
• Spend monitoring: monitor your spending across different providers
• No markup on tokens: tokens cost the same as they would from the provider directly, with 0% markup, including with Bring Your Own Key (BYOK).

• Getting started with AI Gateway
• Models and providers
• Provider options (routing & fallbacks)
• Observability
• OpenAI compatibility
• Usage and billing
• Authentication
• Bring your own key
• Framework integrations
• App attribution