Using Llama 4 Maverick 17B Instruct FP8 on DeepInfra

Quick Start

1. 1
   Create an account at DeepInfra and generate an API key.
2. 2
   Use the DeepInfra SDK or REST API to call llama-4-maverick-17b-128e-instruct-fp8 — see the documentation for request format.
3. 3
   You'll be billed $0.15/1M input, $0.60/1M output tokens. See full pricing.

Code Examples

import os
from openai import OpenAI

client = OpenAI(
    api_key=os.environ["DEEPINFRA_API_KEY"],
    base_url="https://api.deepinfra.com/v1/openai"
)
response = client.chat.completions.create(
    model="llama-4-maverick-17b-128e-instruct-fp8",
    messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)

About DeepInfra

DeepInfra offers serverless AI inference with a simple API, supporting hundreds of models across text generation, embeddings, and more. Pay-per-token pricing with no upfront commitments.

DeepInfra is a cloud inference platform offering cost-effective access to open-source AI models. It provides serverless inference for leading models from Meta, Mistral, Alibaba, and others with competitive token-based pricing.

Pricing on DeepInfra

Capabilities

About Llama 4 Maverick 17B Instruct FP8

Meta's Llama 4 Maverick 17B with 128 experts, FP8-optimized for cost-efficient inference. Supports native Model Router integration on Microsoft Foundry.