LLM ReferenceLLM Reference

Using Mixtral 8x7B Instruct v0.1 on OctoML (Deprecated)

Implementation guide · Mixtral · MistralAI

ServerlessOpen Source

Quick Start

  1. 1
    Create an account at OctoML (Deprecated) and generate an API key.
  2. 2
    Use the OctoML (Deprecated) SDK or REST API to call mixtral-8x7b-instruct-v0.1 — see the documentation for request format.
  3. 3
    You'll be billed $0.40/1M input, $0.60/1M output tokens. See full pricing.
API PortalDocumentationPricing

Code Examples

See OctoML (Deprecated) documentation for integration details.

About OctoML (Deprecated)

Optimized inference platform for foundation models

OctoML is an optimized inference platform for foundation models, offering serverless and dedicated deployment with performance tuning for production AI workloads.

View all models on OctoML (Deprecated) →

Pricing on OctoML (Deprecated)

TypePrice (per 1M)
Input tokens$0.40
Output tokens$0.60

Capabilities

VisionMultimodalReasoningFunction CallingTool UseStructured OutputsCode Execution

About Mixtral 8x7B Instruct v0.1

Mixtral 8x7B Instruct v0.1 via AWS Bedrock

Full model details →

Model Specs

Released2023-12-10
Parameters56B
Context33K
ArchitectureDecoder Only
Knowledge cutoff2023-12

Also available on(4)

DeepInfra$0.15/1MIBM watsonx$0.18/1MTogether AI$0.40/1M
Compare all providers →

Provider

OctoML (Deprecated)

OctoML

Seattle, Washington, United States