Using CodeLlama 34B Python on Together AI
Implementation guide · Code Llama · AI at Meta
Quick Start
- 1
- 2Use the Together AI SDK or REST API to call
codellama-34b-python— see the documentation for request format. - 3
Code Examples
pip install togetherTOGETHER_API_KEYcodellama-34b-pythonTogether uses "organization/model-name" format, e.g. "meta-llama/Llama-4-Scout-17B-16E-Instruct" or "Qwen/QwQ-32B". See the Together model catalog for the exact ID.
from together import Together
client = Together() # reads TOGETHER_API_KEY from env
response = client.chat.completions.create(
model="codellama-34b-python",
messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)About Together AI
Platform for running open-source and proprietary LLMs
Together AI is a platform for running open-source and proprietary LLMs with fast serverless and dedicated endpoints at competitive inference pricing.
Pricing on Together AI
| Type | Price (per 1M) |
|---|---|
| Input tokens | $0.80 |
| Output tokens | $0.80 |
Capabilities
About CodeLlama 34B Python
CodeLlama 34B Python is a specialized code generation model released by Meta on August 24, 2023. With 34 billion parameters, it excels in Python-specific tasks like code completion, infilling, and instruction following. This model offers AI engineers a powerful tool for enhancing coding workflows and productivity. Its architecture is optimized for understanding and generating complex code structures, making it particularly useful for software development tasks. The model is available in the Hugging Face Transformers format, facilitating easy integration into existing projects .