Using CodeLlama 7B Python on Together AI
Implementation guide · Code Llama · AI at Meta
Quick Start
- 1
- 2Use the Together AI SDK or REST API to call
codellama-7b-python— see the documentation for request format. - 3
Code Examples
pip install togetherTOGETHER_API_KEYcodellama-7b-pythonTogether uses "organization/model-name" format, e.g. "meta-llama/Llama-4-Scout-17B-16E-Instruct" or "Qwen/QwQ-32B". See the Together model catalog for the exact ID.
from together import Together
client = Together() # reads TOGETHER_API_KEY from env
response = client.chat.completions.create(
model="codellama-7b-python",
messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)About Together AI
Platform for running open-source and proprietary LLMs
Together AI is a platform for running open-source and proprietary LLMs with fast serverless and dedicated endpoints at competitive inference pricing.
Pricing on Together AI
| Type | Price (per 1M) |
|---|---|
| Input tokens | $0.20 |
| Output tokens | $0.20 |
Capabilities
About CodeLlama 7B Python
CodeLlama 7B Python is a specialized variant of Meta's CodeLlama family, designed for Python programming tasks. With 7 billion parameters, it excels in code completion, infilling, and instruction following. The model utilizes an optimized auto-regressive transformer architecture and has been trained on diverse programming tasks. It's suitable for both commercial and research applications, offering AI engineers a powerful tool for enhancing productivity in Python-centric environments. For more details, visit the model's page on Hugging Face .