OctoAI API (Deprecated) Models — Pricing & Benchmarks
13 models available · OctoAI (acquired by NVIDIA)
OctoAI API (Deprecated) hosts 13 AI models in this catalog. Per-token pricing is not listed for these OctoAI API (Deprecated) rows yet; compare context windows, benchmarks, and hosting options instead. LLM Reference lets you compare these models across all 86 providers without switching tabs.
| Model | Input (per 1M) | Output (per 1M) | Context | |
|---|---|---|---|---|
| Hermes 2 Pro Llama 3 8B | — | — | 8k | |
| Llama 3 70B Instruct | — | — | 8k | |
| Llama 3 8B Instruct | — | — | 8k | |
| Llama 3.1 405B Instruct | — | — | 128k | |
| Llama 3.1 70B Instruct | — | — | 128k | |
| Llama 3.1 8B Instruct | — | — | 128k | |
| Llama Guard 2 8B | — | — | 8k | |
| Mistral 7B v0.1 | — | — | 8k | |
| Mixtral 8x22B v0.1 | — | — | 64k | |
| Mixtral 8x7B | — | — | 32k | |
| Nous Hermes 2 Mixtral 8x7B | — | — | 32k | |
| Qwen2-7B | — | — | 128k | |
| WizardLM-2 8x22B | — | — | — |
Where else to run this
Llama Guard 2 8B on OctoAI API (Deprecated)
Provider setup and pricing
Llama 3 8B Instruct on OctoAI API (Deprecated)
Provider setup and pricing
Mixtral 8x7B on OctoAI API (Deprecated)
Provider setup and pricing
Llama Guard 2 8B on Fireworks AI
Alternative host
Llama 3 8B Instruct on AWS Bedrock
Alternative host
Mixtral 8x7B on Databricks Foundation Model Serving
Alternative host
About OctoAI API (Deprecated)
No public independent OctoAI API, model catalog, portal, documentation, or pricing surface was verified on the former OctoAI routes checked. Those routes redirect to NVIDIA’s general site; do not treat that site as a successor to the former OctoAI API.
Full provider profile →