Introducing the AI Gateway

The Vercel AI Gateway is now available for alpha testing.

Built on the AI SDK 5 alpha, the Gateway lets you switch between ~100 AI models without needing to manage API keys, rate limits, or provider accounts. The Gateway handles authentication, usage tracking, and in the future, billing.

import { gateway } from '@vercel/ai-sdk-gateway'
import { streamText } from 'ai'

const result = streamText({
  model: gateway('xai/grok-3-beta'),
  prompt: 'Tell me the history of the San Francisco Mission-style burrito'
})

Get started with AI SDK 5 and the Gateway, or continue reading to learn more.

pnpm install ai@alpha @vercel/ai-sdk-gateway

Why we’re building the AI Gateway

The current speed of AI development is fast and is only getting faster.

There's a new state-of-the-art model released almost every week. Frustratingly, this means developers have been locked into a specific provider or model API in their application code. We want to help developers ship fast and keep up with AI progress, without needing 10 different API keys and provider accounts.

Production AI applications often run into capacity issues or rate limiting due to high demand. Infrastructure providers move quickly to bring models online and keep up with this demand, but this can come at the expense of performance or availability.

The AI Gateway will allow you to load balance across providers, or fail over if a provider has downtime or degradation in performance. Model inference costs keep dropping and providers are competing on quality, performance, and price. The Gateway helps you quickly take advantage of these cost savings.

We're taking what we've learned scaling v0 to millions of users, by quickly load balancing and switching between a mixture of providers, and turning that infrastructure into the AI Gateway.

Integration with the AI SDK

We built the AI SDK to create a common abstraction for AI model APIs across modalities like text, images, and audio.

The AI SDK is free and open source, and works with any model or infrastructure provider. The AI Gateway is a separate Vercel product built on top of the AI SDK.

We're building these products with high cohesion, but loose coupling. The Gateway will take full advantage of AI SDK features like tool calling, function arguments, streaming, retries, attachments, and structured outputs.

Pricing

During the AI Gateway alpha, usage is free with rate limits based on your Vercel plan tier. These rate limits are similar to the current AI SDK Playground.

We plan to support pay-as-you-go pricing when the Gateway reaches general availability. Model pricing will follow the provider’s market rates, updated regularly. We are also planning to explore bring-your-own-key in the future.

What’s coming next

• Load balancing and model failover

• Pay-as-you-go billing

• Bring-your-own-key support

• Unified logging, usage tracking, and observability

• OpenAI-compatible API

Start exploring AI Gateway

We’re shipping this in alpha to get your input and early feedback. Tag us on X to share your work and tell us what you want to see from the AI Gateway.

For more information, get started with our demo applications:

• Next.js demo

• Svelte demo

For model support and more usage examples, visit ai-sdk.dev/model-library.