Phi-3 Mini 128K
Advancing the state-of-the-art in AI and computing.
Cheapest of 3 routes · Fireworks AI
Advancing the state-of-the-art in AI and computing.
Cheapest of 3 routes · Fireworks AI
About
Phi-3 Mini-128K-Instruct, developed by Microsoft, is a 3.8 billion-parameter large language model renowned for its lightweight, open-source architecture. Despite its modest size, it excels in reasoning tasks, particularly in math and logic, and showcases strong code generation capabilities. A standout feature is its remarkable ability to handle up to 128,000 tokens, allowing it to process extensive text documents and codebases efficiently. While it has limitations in factual knowledge and focuses primarily on English, it strikes a balance between performance and efficiency, making it ideal for resource-constrained environments.
Providers(3)
Compare all 3Compare API pricing across 3 tracked provider routes for input and output tokens, batch, and cached reads when available.
| Provider | Input / 1M | Output / 1M | Route |
|---|---|---|---|
| Fireworks AI | $0.100 | $0.100 | Provisioned |
| Replicate API | $0.050 | $0.250 | Serverless |
| Baseten API | - | - | ServerlessPartial |
Deprecated provider routes(2)
| Provider | Status | Catalog ID |
|---|---|---|
| NVIDIA NIM | DeprecatedRetired April 15, 2026 | — |
| Microsoft Foundry | DeprecatedRetired August 30, 2025 | — |
Available via routers & gateways(7)
LiteLLM
GatewayOpen-source Python SDK and proxy server that unifies 100+ LLM APIs behind a single OpenAI-compatible interface, with load balancing, cost tracking, and configurable failover.
OpenRouter
HybridUnified hybrid gateway to 500+ models from 80+ providers via a single OpenAI-compatible API, with an optional Auto Router that selects a model per prompt from market spend data.
Portkey
GatewayProduction AI gateway routing to 1,600+ LLMs with failover, load balancing, caching, and guardrails; MIT-licensed open-source core is self-hostable. Now part of Palo Alto Networks as Prisma AIRS AI Gateway.
Azure AI Foundry Model Router
RouterMicrosoft Azure AI Foundry's native model router that uses a trained ML model to route each prompt in real time to the optimal Azure-hosted model, with Balanced/Cost/Quality mode selection and automatic failover.
Helicone
GatewayObservability-first AI gateway with routing, caching, rate limiting, and request tracing; Apache-2.0 open-source platform with a managed hosted tier for logging and analytics.
Kong AI Gateway
GatewayMulti-LLM AI gateway built on Kong Gateway 3.x, adding semantic routing, load balancing, guardrails, and MCP traffic analytics as plugins over Kong's existing API management platform.
Capabilities
No model capability flags are currently sourced.
Benchmark peer barsfor Coding
Benchmark scores(9)
| Benchmark | Score | Version | Evaluation | Source |
|---|---|---|---|---|
| 50.8 | diamondObserved 2026-03-06 | — | ||
| 90.2 | 10-shotObserved 2026-03-06 | — | ||
| 75.9 | pass@1Observed 2026-03-06 | — | ||
| 76.5 | 5-shotObserved 2026-03-06 | — | ||
| 43.9 | —Observed 2026-04-14 | — | ||
| 84.9 | —Observed 2026-05-28 | — | ||
| 78.6 | —Observed 2026-05-28 | — | ||
| 66.7 | RULER (128K) (accuracy)Observed 2026-10-26 | — | ||
| 1024.0 | text creative_writing 2026-10-22Observed 2026-10-22 | Configuration: Phi-3 Mini 128K Instruct Harness: LMArena blind pairwise human votes, Bradley-Terry Evaluator: LMArena Confidence: confirmed Notes: LMArena Text arena, Creative Writing category (no style control), board published 2026-10-22 (HF lmarena-ai/leaderboard-dataset @a467e6b9, text config, latest split). Board entry 'Phi-3 Mini 128K Instruct' (category creative_writing in text/latest-00000-of-00001.parquet): rank 396 of 416, rating 1024.0 (95% CI 1010.0-1037.9), 2949 votes. Source: LMArena (CC BY 4.0). Retrieved 2026-10-27. | Source Source: LMArena (lmarena.ai), CC BY 4.0 |
Migration checks
No linked migration route is available for this model yet.