LLM ReferenceLLM Reference

Using Mistral 7B Instruct v0.2 on OctoML (Deprecated)

Implementation guide · Mistral 7B · MistralAI

Serverless

Quick Start

  1. 1
    Create an account at OctoML (Deprecated) and generate an API key.
  2. 2
    Use the OctoML (Deprecated) SDK or REST API to call mistral-7b-instruct-v0.2 — see the documentation for request format.
  3. 3
    You'll be billed $0.15/1M input, $0.20/1M output tokens. See full pricing.
API PortalDocumentationPricing

Code Examples

See OctoML (Deprecated) documentation for integration details.

About OctoML (Deprecated)

Optimized inference platform for foundation models

OctoML is an optimized inference platform for foundation models, offering serverless and dedicated deployment with performance tuning for production AI workloads.

View all models on OctoML (Deprecated) →

Pricing on OctoML (Deprecated)

TypePrice (per 1M)
Input tokens$0.15
Output tokens$0.20

Capabilities

VisionMultimodalReasoningFunction CallingTool UseStructured OutputsCode Execution

About Mistral 7B Instruct v0.2

Instruction-tuned 7B Mistral variant optimized for conversational AI and task completion with efficient inference.

Full model details →

Model Specs

Released2023-12-11
Parameters7B
Context32K
ArchitectureDecoder Only
Knowledge cutoff2023-12

Also available on(6)

DeepInfra$0.05/1MAWS Bedrock$0.15/1MFireworks AI$0.20/1M
Compare all providers →

Provider

OctoML (Deprecated)

OctoML

Seattle, Washington, United States