Nemotron 4 340B on NVIDIA NIM

Nemotron-4 · NVIDIA AI

ProvisionedOpen Weights

Last refreshed 2026-05-19. Next refresh: weekly.

Why use Nemotron 4 340B on NVIDIA NIM?

NVIDIA NIM offers Nemotron 4 340B with competitive pricing. NVIDIA NIM is NVIDIA's deployment platform for GPU-accelerated inference microservices.

Compare Nemotron 4 340B across 2 providers to find the best fit for your use case
Input / 1M
-
Output / 1M
-
Cache
Not sourced
Batch
Not sourced

Setup recipe

Docs fallback
Install
Use the provider REST API or SDK
Auth
Create a provider API key
Call
model: nemotron-4-340b
Model ID
nemotron-4-340b

Request example

Curated snippets for this provider are not sourced yet. Use NVIDIA NIM documentation with model ID nemotron-4-340b.

Gotchas

No curated gotchas have been sourced for this exact provider/model route yet.

Compare Nemotron 4 340B Across Providers

ProviderInput (per 1M)Output (per 1M)
NVIDIA NIM——
DeepInfra$4.20$4.20

Capabilities

Structured Outputs

About Nemotron 4 340B

Nemotron 4 340B is NVIDIA AI's Nemotron-4 model. It is deprecated (originally released 2025-02-27); use it only for reproducing earlier results or evaluating drift over time.

Get Started

Model Specs

Released2025-02-27
Parameters340B
Context4k
ArchitectureDecoder Only