Phi-3 Small 8K

Name: Phi-3 Small 8K
Author: Microsoft Research

Released

2024-05-21

Last refreshed

2026-10-05

Status

Researched 140d ago

Open sourceCommercial use: permitted

Microsoft Research releases · 6 in the last 12 monthsChangelog →

Specifications

Family: Phi-3
Released: 2024-05-21
Context: 8k
Parameters: 7B
Architecture: Decoder Only
Knowledge cutoff: 2023-10
Specialization: general
Openness: Open source
License: MITOSI-approvedCommercial use: permitted
Weights: Unknown
Code: Unknown
Training: Fine-tuned

Created by

Microsoft Research

Advancing the state-of-the-art in AI and computing.

Redmond, Washington, United States

Founded 1991

Website

Pricing

Output / 1M

$0.960

Input / 1M

$0.320

Cheapest of 2 routes · Microsoft Foundry

Providers(2)

Microsoft Foundry NVIDIA NIM

View 2 provider routes

About

Phi-3 Small 8K is Microsoft Research's Phi-3 model. It offers an 8K-token context window with weights openly available for self-hosting.

Provider price ladder

Compare all 2

Compare API pricing across 2 providers for input and output tokens, batch, and cached reads when available.

Provider	Input / 1M	Output / 1M	Route
Microsoft Foundry	$0.320	$0.960	ServerlessProvisioned
NVIDIA NIM	-	-	ProvisionedPartial

Available via routers & gateways(6)

LiteLLM

Gateway

Open-source Python SDK and proxy server that unifies 100+ LLM APIs behind a single OpenAI-compatible interface, with load balancing, cost tracking, and configurable failover.

Free OSSMicrosoft Foundry

Portkey

Gateway

Production AI gateway routing to 1,600+ LLMs with failover, load balancing, semantic caching, and guardrails; Apache 2.0 core is fully self-hostable with the complete feature set.

SubscriptionMicrosoft Foundry

Azure AI Foundry Model Router

Router

Microsoft Azure AI Foundry's native model router that uses a trained ML model to route each prompt in real time to the optimal Azure-hosted model, with Balanced/Cost/Quality mode selection and automatic failover.

PassthroughMicrosoft Foundry

Helicone

Gateway

Observability-first AI gateway with routing, caching, rate limiting, and request tracing; Apache 2.0 open-source core with a managed hosted tier for logging and analytics.

SubscriptionMicrosoft Foundry

Kong AI Gateway

Gateway

Multi-LLM AI gateway built on Kong Gateway 3.x, adding semantic routing, load balancing, guardrails, and MCP traffic analytics as plugins over Kong's existing API management platform.

SubscriptionMicrosoft Foundry

NVIDIA LLM Router Blueprint

Router

NVIDIA's open-source AI blueprint for LLM routing that selects the optimal model per prompt via intent classification or neural auto-routing; being deprecated 2026-06-20.

Free OSSNVIDIA NIM