Last refreshed 2026-10-18. Next refresh: weekly.
Why use CodeLlama 70B Instruct on OctoML (Deprecated)?
OctoML (Deprecated) offers CodeLlama 70B Instruct with pay-as-you-go pricing at $0.40/1M input tokens. OctoML is an optimized inference platform for foundation models, offering serverless and dedicated deployment with performance tuning for production AI workloads.
Compare CodeLlama 70B Instruct across 2 providers to find the best fit for your use caseSetup recipe
Docs fallbackUse the provider REST API or SDKCreate a provider API keymodel: codellama-70b-instructcodellama-70b-instructRequest example
codellama-70b-instruct.Gotchas
No curated gotchas have been sourced for this exact provider/model route yet.
Compare CodeLlama 70B Instruct Across Providers
| Provider | Input (per 1M) | Output (per 1M) |
|---|---|---|
| OctoML (Deprecated) | $0.40 | $0.60 |
| Fireworks AI | $0.90 | $0.90 |
Pricing
| Type | Price (per 1M) |
|---|---|
| Input tokens | $0.40 |
| Output tokens | $0.60 |
Capabilities
No model capability flags are currently sourced.
About CodeLlama 70B Instruct
CodeLlama 70B Instruct is a large-scale generative text model with 70 billion parameters, specifically designed for code synthesis and understanding tasks. Fine-tuned to follow user instructions effectively, it excels in interactive coding environments, supporting tasks such as code completion, infilling, and explanation. The model is optimized for efficient processing and is suitable for both commercial and research applications in English and various programming languages. While it offers advanced capabilities for AI-assisted coding, it's important to note that it doesn't support long contexts of up to 100k tokens, which may limit its use with extensive codebases.