Using Nemotron 4 340B on NVIDIA NIM

Implementation guide · Nemotron-4 · NVIDIA AI

ProvisionedOpen Weights

NVIDIA NIM exposes Nemotron 4 340B through model ID nemotron-4-340b. Use the setup steps, sourced pricing, capabilities, and official provider links below to validate this route before deployment.

Last refreshed 2026-05-19. Next refresh: weekly.

Quick Start

  1. 1
    Create an account at NVIDIA NIM and generate an API key.
  2. 2
    Use the NVIDIA NIM SDK or REST API to call nemotron-4-340b — see the documentation for request format.
  3. 3
    You'll be billed . See full pricing.
API PortalDocumentationPricingModel Card

Code Examples

See NVIDIA NIM documentation for integration details.

Pricing on NVIDIA NIM

Capabilities

Structured Outputs

About Nemotron 4 340B

Nemotron 4 340B is NVIDIA AI's Nemotron-4 model. It is deprecated (originally released 2025-02-27); use it only for reproducing earlier results or evaluating drift over time.

Full model details →

Model Specs

Released2025-02-27
Parameters340B
Context4k
ArchitectureDecoder Only

More Models on NVIDIA NIM

Nemotron Mini 4B InstructNemotron Mini Hindi 4B Instruct
All models on NVIDIA NIM →

Also available on(1)

DeepInfra$4.20/1M
Compare all providers →

Provider

NVIDIA NIM

NVIDIA

Santa Clara, California, United States