Using CodeLlama 7B on Together AI
Implementation guide · Code Llama · AI at Meta
Quick Start
- 1
- 2Use the Together AI SDK or REST API to call
codellama-7b— see the documentation for request format. - 3
Code Examples
pip install togetherTOGETHER_API_KEYcodellama-7bTogether uses "organization/model-name" format, e.g. "meta-llama/Llama-4-Scout-17B-16E-Instruct" or "Qwen/QwQ-32B". See the Together model catalog for the exact ID.
from together import Together
client = Together() # reads TOGETHER_API_KEY from env
response = client.chat.completions.create(
model="codellama-7b",
messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)About Together AI
Platform for running open-source and proprietary LLMs
Together AI is a platform for running open-source and proprietary LLMs with fast serverless and dedicated endpoints at competitive inference pricing.
Pricing on Together AI
| Type | Price (per 1M) |
|---|---|
| Input tokens | $0.20 |
| Output tokens | $0.20 |
Capabilities
About CodeLlama 7B
CodeLlama 7B is a specialized code generation model released by Meta on August 24, 2023. With 7 billion parameters, it excels in code completion, infilling, and instruction-following tasks. Built on an optimized transformer architecture, it's designed for both commercial and research applications, particularly in English and various programming languages. The model offers robust capabilities for AI engineers looking to enhance coding workflows or develop code generation applications. More details can be found on the official Hugging Face page .