Using CodeLlama 70B on NVIDIA NIM

Implementation guide · Code Llama · AI at Meta

ProvisionedOpen Weights

NVIDIA NIM exposes CodeLlama 70B through model ID codellama-70b. Use the setup steps, sourced pricing, capabilities, and official provider links below to validate this route before deployment.

Last refreshed 2026-07-09. Next refresh: weekly.

Quick Start

  1. 1
    Create an account at NVIDIA NIM and generate an API key.
  2. 2
    Use the NVIDIA NIM SDK or REST API to call codellama-70b — see the documentation for request format.
  3. 3
    You'll be billed . See full pricing.
API PortalDocumentationPricingModel Card

Code Examples

See NVIDIA NIM documentation for integration details.

Pricing on NVIDIA NIM

Capabilities

Structured Outputs

About CodeLlama 70B

CodeLlama 70B is a state-of-the-art generative text model by Meta, specifically designed for code synthesis and understanding. It utilizes an auto-regressive transformer architecture and has been fine-tuned with up to 16,000 tokens, supporting inference with up to 100,000 tokens. The model excels in code completion, infilling, and instruction following, making it versatile for various programming languages and applications. With 70 billion parameters, it offers advanced capabilities for general code generation tasks, while also providing specialized variants for Python and instruction-following.

Full model details →

Model Specs

Released2024-01-29
Parameters70B
Context16k
ArchitectureDecoder Only

Also available on(5)

DeepInfra$0.45/1MReplicate API$0.65/1MTogether AI$0.90/1M
Compare all providers →

Provider

NVIDIA NIM

NVIDIA

Santa Clara, California, United States