Last refreshed 2026-10-21. Next refresh: weekly.
Why use Nemotron 3.5 Lightning on Vercel AI Gateway?
Vercel AI Gateway offers Nemotron 3.5 Lightning with pay-as-you-go pricing at $0.05/1M input tokens. Vercel AI Gateway is a unified AI proxy providing a single OpenAI-compatible API endpoint to 275+ models from 25+ providers including Anthropic, OpenAI, Google, Meta, Mistral, DeepSeek, xAI, Alibaba, Amazon, ByteDance, Cohere, MiniMax, MoonshotAI, KwaiPilot, Black Forest Labs, Recraft, Voyage AI, NVIDIA, and more.
Compare Nemotron 3.5 Lightning across 2 providers to find the best fit for your use caseSetup recipe
Python + curlpip install openaiexport AI_GATEWAY_API_KEY=...import os
from openai import OpenAI
client = OpenAI(
api_key=os.environ["AI_GATEWAY_API_KEY"],nvidia/nemotron-3.5-lightningRequest example
import os
from openai import OpenAI
client = OpenAI(
api_key=os.environ["AI_GATEWAY_API_KEY"],
base_url="https://ai-gateway.vercel.sh/v1"
)
response = client.chat.completions.create(
model="nvidia/nemotron-3.5-lightning",
messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)Gotchas
- Use provider model ID "nvidia/nemotron-3.5-lightning", not the LLMReference slug "nemotron-3.5-lightning".
- creator/model-name e.g. kwaipilot/kat-coder-pro-v2
- The examples expect AI_GATEWAY_API_KEY; rename it only if your application config maps the new variable.
Compare Nemotron 3.5 Lightning Across Providers
| Provider | Input (per 1M) | Output (per 1M) |
|---|---|---|
| OpenRouter | $0.06 | $0.16 |
| Vercel AI Gateway | $0.05 | $0.20 |
Pricing
| Type | Price (per 1M) |
|---|---|
| Input tokens | $0.05 |
| Output tokens | $0.20 |
Capabilities
About Nemotron 3.5 Lightning
NVIDIA Nemotron 3.5 Lightning (HF nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B) is an open-weight hybrid Mamba-Transformer mixture-of-experts text model with 30B total and 3B active parameters (NemotronHForCausalLM), released 11 August 2026. NVIDIA lists context up to 1M tokens (256K used for single-H100 deployment). Weights ship in BF16, NVFP4 and speculative-decoding (DSpark/DFlash) variants plus a base checkpoint under OpenMDW 1.1. It is offered on build.nvidia.com and OpenRouter (free tier).