Using DeepSeek R1 Distill Llama 8B on NVIDIA NIM

Implementation guide · DeepSeek R1 · DeepSeek

ServerlessOpen Source

NVIDIA NIM exposes DeepSeek R1 Distill Llama 8B through model ID deepseek-ai/deepseek-r1-distill-llama-8b. Use the setup steps, sourced pricing, capabilities, and official provider links below to validate this route before deployment.

Last refreshed 2026-05-19. Next refresh: weekly.

Quick Start

  1. 1
    Create an account at NVIDIA NIM and generate an API key.
  2. 2
    Use the NVIDIA NIM SDK or REST API to call deepseek-ai/deepseek-r1-distill-llama-8b — see the documentation for request format.
  3. 3
    You'll be billed . See full pricing.
API PortalDocumentationPricing

Code Examples

See NVIDIA NIM documentation for integration details.

Pricing on NVIDIA NIM

Capabilities

Reasoning

About DeepSeek R1 Distill Llama 8B

DeepSeek R1 Distill Llama 8B is DeepSeek's DeepSeek R1 model with an optional reasoning mode. It offers a 128K-token context window with weights openly available for self-hosting.

Full model details →

Model Specs

Released2025-01-20
Parameters8B
Context128k
ArchitectureDecoder Only
Knowledge cutoff2023-12

More Models on NVIDIA NIM

DeepSeek R1DeepSeek R1 Distill Qwen-32BDeepSeek R1 Distill Qwen-14BDeepSeek R1 Distill Qwen-7B
All models on NVIDIA NIM →

Also available on(1)

Fireworks AI$0.20/1M
Compare all providers →

Provider

NVIDIA NIM

NVIDIA

Santa Clara, California, United States