LLM Reference

Models on OctoML

7 models available

ModelInput (per 1M)Output (per 1M)Context
OctoML Gemma-2B-it$0.1$0.158192
OctoML Gemma-7B-it$0.15$0.28192
OctoML Mistral-7b-Instruct-v0.2$0.15$0.232768
OctoML CodeLlama-70b-Instruct$0.4$0.6100k
OctoML Llama-2-70b-chat$0.4$0.64096
OctoML Mixtral-8x7B-Instruct-v0.1$0.4$0.632768
OctoML Nous-Hermes-2-Mixtral-8x7B-DPO$0.4$0.632768

Pricing Overview

Cheapest$0.10/1M
Most expensive$0.40/1M

About OctoML

Optimized inference platform for foundation models

Full provider profile →