Llama 4 Maverick 17B Instruct FP8
- Family
- Llama 4
- Released
- 2025-04-05
- Context
- 1M
- Parameters
- 400B (17B active)
- Architecture
- Mixture of Experts
- Knowledge cutoff
- 2024-08
- Specialization
- general
- Openness
- Open weights
- License
- Llama 4 CommunityRestricted
- Weights
- Unknown
- Code
- Unknown
- Training
- Fine-tuned
Large-scale open-source AI for social technologies.
Cheapest of 11 routes · DeepInfra
About
Meta's Llama 4 Maverick 17B with 128 experts, FP8-optimized for cost-efficient inference. Supports native Model Router integration on Microsoft Foundry.
Top use-case fit: coding, agents, and build tasks
Coding
Q/$ CAgents
Q/$ BProviders(11)
Compare all 11Compare API pricing across 11 tracked provider routes for input and output tokens, batch, and cached reads when available.
| Provider | Input / 1M | Output / 1M | Batch in / out | Route |
|---|---|---|---|---|
| DeepInfra | $0.150 | $0.600 | - | Serverless |
| OpenRouter | $0.150 | $0.600 | - | Serverless |
| Novita AI | $0.270 | $0.850 | - | Serverless |
| Together AI | $0.270 | $0.850 | - | Serverless |
| AWS Bedrock | $0.240 | $0.970 | $0.120 / $0.485 | Serverless Scheduled retirement: March 30, 2027 |
| Vercel AI Gateway | $0.240 | $0.970 | - | Serverless |
| GCP Vertex AI | $0.350 | $1.15 | - | Serverless |
| Microsoft Foundry | $0.350 | $1.41 | - | ServerlessProvisioned |
| Fireworks AI | - | - | - | ServerlessPartial |
| Inceptron | - | - | - | ServerlessPartial |
| NVIDIA NIM | - | - | - | ServerlessPartial |
Available via routers & gateways(16)
LiteLLM
GatewayOpen-source Python SDK and proxy server that unifies 100+ LLM APIs behind a single OpenAI-compatible interface, with load balancing, cost tracking, and configurable failover.
OpenRouter
HybridUnified hybrid gateway to 500+ models from 80+ providers via a single OpenAI-compatible API, with an optional Auto Router that selects a model per prompt from market spend data.
Portkey
GatewayProduction AI gateway routing to 1,600+ LLMs with failover, load balancing, caching, and guardrails; MIT-licensed open-source core is self-hostable. Now part of Palo Alto Networks as Prisma AIRS AI Gateway.
AIRouter
RouterCommercial LLM router (branded "AI Router" on its site) that picks the best model per request via a Decision API or an OpenAI-compatible Chat Completions endpoint, with a private selection mode that routes on anonymized patterns; sold as BYOK subscription plans priced by routed tokens.
Amazon Bedrock Intelligent Prompt Routing
RouterAWS Bedrock's native prompt router that predicts each model's performance per request and routes between two models of the same family (Anthropic Claude, Meta Llama or Amazon Nova).
Azure AI Foundry Model Router
RouterMicrosoft Azure AI Foundry's native model router that uses a trained ML model to route each prompt in real time to the optimal Azure-hosted model, with Balanced/Cost/Quality mode selection and automatic failover.
Capabilities
Benchmark peer barsfor Coding
Benchmark scores(10)
| Benchmark | Score | Version | Evaluation | Source |
|---|---|---|---|---|
| 77.4 | 2025-04Observed 2026-04-09 | — | ||
| 15.6 | 2026-04Observed 2026-04-14 | — | ||
| 49.7 | 2025-04 (Instruct Pass@1)Observed 2026-04-14 | — | ||
| 1365.0 | —Observed 2026-04-15 | — | Source Source: LMArena (lmarena.ai), CC BY 4.0 | |
| 68.5 | τ-benchObserved 2026-04-24 | — | ||
| 59.6 | LLM-Stats aggregatorObserved 2026-06-07 | — | ||
| 73.4 | —Observed 2025-04-05 | — | ||
| 80.5 | —Observed 2025-04-05 | — | ||
| 43.4 | —Observed 2025-04-05 | — | ||
| 37.3 | v4Observed 2026-10-26 | Configuration: Llama-4-Maverick-17B-128E-Instruct-FP8 (FC) Harness: BFCL V4 official evaluation (gorilla berkeley-function-call-leaderboard), FC mode Evaluator: Gorilla LLM team (UC Berkeley) Confidence: confirmed Notes: BFCL V4 leaderboard (Last Updated 2026-04-12), entry 'Llama-4-Maverick-17B-128E-Instruct-FP8 (FC)': rank 50, Overall Acc 37.29%; Multi Turn 20.25%, Web Search 28.00%, Memory 18.92%, Non-Live AST 88.65%, Live 73.65%, Irrelevance 55.97%. Retrieved 2026-10-26. |
Migration checks
No linked migration route is available for this model yet.
Rankings & picks(1)
Compare Llama 4 Maverick 17B Instruct FP8 with other models
- Llama 4 Maverick 17B Instruct FP8 vs Llama 3.3 70B Instruct297
- Llama 4 Maverick 17B Instruct FP8 vs Llama 4 Scout 17B-16E Instruct124
- Llama 4 Maverick 17B Instruct FP8 vs DeepSeek V4 Pro33
- Llama 4 Maverick 17B Instruct FP8 vs Qwen3.6-Max20
- Llama 4 Maverick 17B Instruct FP8 vs Grok 414
- Llama 4 Maverick 17B Instruct FP8 vs Claude Sonnet 4.614
- Llama 4 Maverick 17B Instruct FP8 vs Mistral Large 2 (2407)8
- Llama 4 Maverick 17B Instruct FP8 vs DeepSeek V34
Comparison and alternatives
Browse all comparisons →Large-scale open-source AI for social technologies.
Cheapest of 11 routes · DeepInfra