Nemotron 3.5 Lightning 30B
NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4 is a large language model (LLM) trained by NVIDIA. The model employs a hybrid Mixture-of-Experts architecture, utilizing interleaved Mamba-2 and MoE layers, along with select Attention layers. The Lightning 3.5 model is released alongside a number of speculative decoding methods for faster text generation. The model has 3B active parameters and 30B parameters in total.
- Input and output price
- Prices from: Input $0.05, Output $0.15, Per 1M tokens
- 24h uptime
- Loading AI Gateway uptime
import { streamText } from 'ai'
const result = streamText({ model: 'nvidia/nemotron-3.5-lightning', prompt: 'Why is the sky blue?'})Copy link to headingProviders
Route requests across multiple providers. Copy a provider slug to set your preference. Visit the docs for more info. Using a provider means you agree to their terms, listed under Legal.
Copy link to headingPlayground
Try out Nemotron 3.5 Lightning 30B by NVIDIA. Usage is billed to your team at API rates. Free users (those who haven't made a payment) get $5 of credits every 30 days.
Nemotron 3.5 Lightning 30B
Nemotron 3.5 Lightning 30B
Copy link to headingUptime24 hours
Direct request success rate on AI Gateway and per-provider. Visit the docs for more info.
Copy link to headingThroughput24 hours
P50 throughput on live AI Gateway traffic, in tokens per second (TPS). Visit the docs for more info.
Copy link to headingLatency24 hours
P50 time to first token (TTFT) on live AI Gateway traffic, in milliseconds. View the docs for more info.
Copy link to headingMore models by NVIDIA
| Model |
|---|
| 1M | 0.3 s | 171 tps | $0.50/M | $2.40/M | Read$0.12/M | — |    +1 | 06/04/2026 | ||||||
| 256K | 0.3 s | 183 tps | $0.15/M | $0.65/M | — |  | 03/11/2026 | |||||||
| 262K | 0.2 s | 127 tps | $0.05/M | $0.24/M | — | | 12/15/2025 | |||||||
| 131K | 0.2 s | 132 tps | $0.20/M | $0.60/M | — | | 10/28/2025 | |||||||
| 131K | 0.2 s | 147 tps | $0.06/M | $0.23/M | — | | 08/18/2025 |