CodeLlama 13B

CodeLlama 13B is a state-of-the-art generative text model developed by Meta, specifically designed for code synthesis and understanding tasks. Released on August 24, 2023, this 13-billion-parameter model excels in general code generation and comprehension, making it suitable for a wide range of programming tasks, including code completion, infilling, and instruction following. It utilizes an optimized transformer architecture and has been trained on a diverse dataset similar to Llama 2, ensuring robust understanding of programming languages and coding practices. AI engineers can integrate CodeLlama 13B into various coding environments and tools for both commercial and research applications, leveraging its powerful capabilities to enhance productivity and streamline the coding process.

CodeLlama 13B is Meta's 13-billion-parameter general code generation model, released August 24, 2023. It is produced by further training Llama 2 13B on code-heavy data and supports code completion, fill-in-the-middle (FIM) infilling, and code understanding across multiple programming languages. This LLMReference seed row carries a 100K-token context, so it should be read as a long-context hosted listing for the 13B base model rather than a guarantee that every CodeLlama 13B endpoint exposes the same window.

At 13 billion parameters, CodeLlama 13B offers a meaningful capability improvement over the 7B variant: stronger handling of complex multi-function code, less common programming languages, and more accurate code completions for longer functions. The model covers Python, C, C++, Java, PHP, TypeScript, C#, and Bash, among others. The 100K context row is most relevant when a provider exposes extended code context for larger files, repository excerpts, or long autocomplete histories; verify the selected provider's cap before designing around full-window prompts.

CodeLlama 13B is available as open weights on Hugging Face (meta-llama/CodeLlama-13b-hf) under Meta's Code Llama Community License, and is hosted on Together AI, Fireworks AI, Azure AI Foundry, and Replicate. For Python specialization, the CodeLlama 13B Python variant is preferred. The 34B and 70B variants offer higher accuracy at greater compute cost.

CodeLlama 13B has a 100k-token context window.

CodeLlama 13B input tokens at $0.1/1M, output at $0.5/1M.