Using Nemotron 3.5 Lightning on Vercel AI Gateway
Implementation guide · Nemotron 3.5 · NVIDIA AI
Vercel AI Gateway exposes Nemotron 3.5 Lightning through model ID nvidia/nemotron-3.5-lightning. Use the setup steps, sourced pricing, capabilities, and official provider links below to validate this route before deployment.
Last refreshed 2026-10-21. Next refresh: weekly.
Quick Start
- 1
- 2Use the Vercel AI Gateway SDK or REST API to call
nvidia/nemotron-3.5-lightning— see the documentation for request format. - 3
Code Examples
pip install openaiAI_GATEWAY_API_KEYnvidia/nemotron-3.5-lightningcreator/model-name e.g. kwaipilot/kat-coder-pro-v2
import os
from openai import OpenAI
client = OpenAI(
api_key=os.environ["AI_GATEWAY_API_KEY"],
base_url="https://ai-gateway.vercel.sh/v1"
)
response = client.chat.completions.create(
model="nvidia/nemotron-3.5-lightning",
messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)Pricing on Vercel AI Gateway
| Type | Price (per 1M) |
|---|---|
| Input tokens | $0.05 |
| Output tokens | $0.20 |
Capabilities
About Nemotron 3.5 Lightning
NVIDIA Nemotron 3.5 Lightning (HF nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B) is an open-weight hybrid Mamba-Transformer mixture-of-experts text model with 30B total and 3B active parameters (NemotronHForCausalLM), released 11 August 2026. NVIDIA lists context up to 1M tokens (256K used for single-H100 deployment). Weights ship in BF16, NVFP4 and speculative-decoding (DSpark/DFlash) variants plus a base checkpoint under OpenMDW 1.1. It is offered on build.nvidia.com and OpenRouter (free tier).