Using CodeLlama 7B on Baseten API

Implementation guide · Code Llama · AI at Meta

ServerlessOpen Weights

Baseten API exposes CodeLlama 7B through model ID codellama-7b. Use the setup steps, sourced pricing, capabilities, and official provider links below to validate this route before deployment.

Last refreshed 2026-07-09. Next refresh: weekly.

Quick Start

  1. 1
    Create an account at Baseten API and generate an API key.
  2. 2
    Use the Baseten API SDK or REST API to call codellama-7b — see the documentation for request format.
API PortalDocumentationPricing

Code Examples

See Baseten API documentation for integration details.

Pricing on Baseten API

Capabilities

Structured Outputs

About CodeLlama 7B

CodeLlama 7B is a specialized code generation model released by Meta on August 24, 2023. With 7 billion parameters, it excels in code completion, infilling, and instruction-following tasks. Built on an optimized transformer architecture, it's designed for both commercial and research applications, particularly in English and various programming languages. The model offers robust capabilities for AI engineers looking to enhance coding workflows or develop code generation applications. More details can be found on the official Hugging Face page .

Full model details →

Model Specs

Released2023-08-24
Parameters7B
Context100k
ArchitectureDecoder Only
Knowledge cutoff2022-09

Also available on(4)

Replicate API$0.05/1MTogether AI$0.20/1MFireworks AI$0.20/1M
Compare all providers →

Provider

Baseten API

Baseten

San Francisco, California, United States