OctoML
OctoML
AI
Platform
Optimized inference platform for foundation models
About OctoML
Optimized inference platform for foundation models
Available Models(7)
| Model | Input (per 1M) | Output (per 1M) | Type |
|---|---|---|---|
| OctoML Llama-2-70b-chat | $0.4 | $0.6 | Serverless |
| OctoML Mixtral-8x7B-Instruct-v0.1 | $0.4 | $0.6 | Serverless |
| OctoML Nous-Hermes-2-Mixtral-8x7B-DPO | $0.4 | $0.6 | Serverless |
| OctoML Mistral-7b-Instruct-v0.2 | $0.15 | $0.2 | Serverless |
| OctoML CodeLlama-70b-Instruct | $0.4 | $0.6 | Serverless |
| OctoML Gemma-7B-it | $0.15 | $0.2 | Serverless |
| OctoML Gemma-2B-it | $0.1 | $0.15 | Serverless |