Last refreshed 2026-04-24. Next refresh: weekly.
Why use Nemotron 4 340B on DeepInfra?
DeepInfra offers Nemotron 4 340B with pay-as-you-go pricing at $4.20/1M input tokens. DeepInfra is a cloud inference platform offering cost-effective access to open-source AI models.
Compare Nemotron 4 340B across 2 providers to find the best fit for your use caseInput / 1M
$4.20
Output / 1M
$4.20
Cache
Not sourced
Batch
Not sourced
Setup recipe
Python + curlInstall
pip install openaiAuth
export DEEPINFRA_API_KEY=...Call
import os
from openai import OpenAI
client = OpenAI(
api_key=os.environ["DEEPINFRA_API_KEY"],Model ID
nemotron-4-340bRequest example
import os
from openai import OpenAI
client = OpenAI(
api_key=os.environ["DEEPINFRA_API_KEY"],
base_url="https://api.deepinfra.com/v1/openai"
)
response = client.chat.completions.create(
model="nemotron-4-340b",
messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)Gotchas
- DeepInfra uses "organization/model-name" format, e.g. "meta-llama/Meta-Llama-3-8B-Instruct" or "mistralai/Mistral-7B-Instruct-v0.3". See the DeepInfra model catalog for exact IDs.
- The examples expect DEEPINFRA_API_KEY; rename it only if your application config maps the new variable.
Compare Nemotron 4 340B Across Providers
| Provider | Input (per 1M) | Output (per 1M) |
|---|---|---|
| NVIDIA NIM | — | — |
| DeepInfra | $4.20 | $4.20 |
Pricing
| Type | Price (per 1M) |
|---|---|
| Input tokens | $4.20 |
| Output tokens | $4.20 |
Capabilities
Structured Outputs
FAQ
What does Nemotron 4 340B cost on DeepInfra?
On DeepInfra, Nemotron 4 340B costs $4.20 per 1M input tokens and $4.20 per 1M output tokens.
What is the context window for Nemotron 4 340B on DeepInfra?
Nemotron 4 340B supports a 4,000 token context window on DeepInfra.
How does DeepInfra compare to other Nemotron 4 340B providers?
Nemotron 4 340B is available from 2 providers. The cheapest input pricing is $4.20/1M tokens from DeepInfra.
Who created Nemotron 4 340B?
Nemotron 4 340B was created by NVIDIA AI as part of the Nemotron-4 model family.
Is Nemotron 4 340B open source?
Nemotron 4 340B's open source status is unknown in the seed data.
Model Specs
Released2025-02-27
Parameters340B
Context4K
ArchitectureDecoder Only