Using CodeLlama 13B on Together AI
Implementation guide · Code Llama · AI at Meta
Quick Start
- 1
- 2Use the Together AI SDK or REST API to call
codellama-13b— see the documentation for request format. - 3
Code Examples
pip install togetherTOGETHER_API_KEYcodellama-13bTogether uses "organization/model-name" format, e.g. "meta-llama/Llama-4-Scout-17B-16E-Instruct" or "Qwen/QwQ-32B". See the Together model catalog for the exact ID.
from together import Together
client = Together() # reads TOGETHER_API_KEY from env
response = client.chat.completions.create(
model="codellama-13b",
messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)About Together AI
Platform for running open-source and proprietary LLMs
Together AI is a platform for running open-source and proprietary LLMs with fast serverless and dedicated endpoints at competitive inference pricing.
Pricing on Together AI
| Type | Price (per 1M) |
|---|---|
| Input tokens | $0.30 |
| Output tokens | $0.30 |
Capabilities
About CodeLlama 13B
CodeLlama 13B is a state-of-the-art generative text model developed by Meta, specifically designed for code synthesis and understanding tasks. Released on August 24, 2023, this 13-billion-parameter model excels in general code generation and comprehension, making it suitable for a wide range of programming tasks, including code completion, infilling, and instruction following. It utilizes an optimized transformer architecture and has been trained on a diverse dataset similar to Llama 2, ensuring robust understanding of programming languages and coding practices. AI engineers can integrate CodeLlama 13B into various coding environments and tools for both commercial and research applications, leveraging its powerful capabilities to enhance productivity and streamline the coding process.