OctoML (Deprecated)
Inference PlatformTier deprecatedOctoML
AI
Platform Overview
Optimized inference platform for foundation models
Available Models(7)
View all →All models available as Serverless
| Model | Input (per 1M) | Output (per 1M) |
|---|---|---|
| OctoML Gemma-2B-it | $0.1 | $0.15 |
| OctoML Gemma-7B-it | $0.15 | $0.2 |
| OctoML Mistral-7b-Instruct-v0.2 | $0.15 | $0.2 |
| OctoML Mixtral-8x7B-Instruct-v0.1 | $0.4 | $0.6 |
| OctoML Nous-Hermes-2-Mixtral-8x7B-DPO | $0.4 | $0.6 |
| OctoML CodeLlama-70b-Instruct | $0.4 | $0.6 |
| OctoML Llama-2-70b-chat | $0.4 | $0.6 |
Platform Details
TypeInference Platform
TierTier deprecated
Models7
Organization
OctoML
Founded2019
Seattle, Washington, United States
Optimized inference platform for foundation models