Nemotron-4
About
The Nemotron-4 340B family consists of large language models (LLMs) that are openly accessible and tailored for synthetic data generation, crucial for training other LLMs 34. This innovative suite includes a base model, instruct model, and reward model, each serving unique purposes. The base model, trained on an extensive 9 trillion token dataset, supports the instruct model in producing diverse synthetic data that emulates real-world scenarios, while the reward model focuses on evaluating and refining outputs for helpfulness and coherence 12. Optimized for NVIDIA's NeMo framework and TensorRT-LLM for inference, these models are designed for both research and commercial use due to their open licensing. Moreover, the fully open-sourced pipeline encourages AI community collaboration and innovation 9.
Specifications(3 models)
| Model | Released | Context | Parameters | Structured Outputs |
|---|---|---|---|---|
| Nemotron Mini Hindi 4B Instruct | 2024-09 | 4K | 4B | No |
| Nemotron Mini 4B Instruct | 2024-08 | 4K | 4B | No |
Available From(2 providers)
Pricing
Frequently Asked Questions
- What is Nemotron-4?
- The Nemotron-4 340B family consists of large language models (LLMs) that are openly accessible and tailored for synthetic data generation, crucial for training other LLMs 34. This innovative suite includes a base model, instruct model, and reward model, each serving unique purposes. The base model, trained on an extensive 9 trillion token dataset, supports the instruct model in producing diverse synthetic data that emulates real-world scenarios, while the reward model focuses on evaluating and refining outputs for helpfulness and coherence 12. Optimized for NVIDIA's NeMo framework and TensorRT-LLM for inference, these models are designed for both research and commercial use due to their open licensing. Moreover, the fully open-sourced pipeline encourages AI community collaboration and innovation 9.
- How many models are in the Nemotron-4 family?
- The Nemotron-4 family contains 3 models.
- What is the latest Nemotron-4 model?
- The latest model is Nemotron 4 340B, released in 2025-02.
- How much does Nemotron-4 cost?
- Nemotron-4 models are available at $4.2/1M input tokens through providers like DeepInfra.
- Is Nemotron-4 open source?
- 2 of 3 Nemotron-4 models are open source.
