Phi-3
About
The Phi-3 family, developed by Microsoft, consists of small language models (SLMs) optimized for Azure AI 1. These models are known for their capability and cost-effectiveness, outperforming larger models in tasks such as language processing, reasoning, coding, and math 1. The Phi-3 lineup includes models like the Phi-3-mini with 3.8 billion parameters, and the Phi-3-small and Phi-3-medium, each with 7 billion and 14 billion parameters, respectively 1. Notably, the Phi-3-mini supports up to a 128K token context window with minimal quality impact, a feature rare for models of its size 1. These models are instruction-tuned for straightforward usage and are optimized for various processing platforms, including GPUs, CPUs, and even mobile hardware 1. Despite their prowess, the Phi-3 models might perform slightly below larger models on factual knowledge tests due to their relatively smaller size 1.
Specifications(15 models)
| Model | Released | Context | Parameters | Vision | Multimodal |
|---|---|---|---|---|---|
| Phi 3.5 Mini Instruct | 2024-08 | 128K | 3.8B | No | No |
| Phi 3.5 MoE Instruct | 2024-08 | 128K | 16x3.8B (42B, 6.6B active) | No | No |
| Phi 3.5 Vision Instruct | 2024-08 | 128K | 4.1B | Yes | Yes |
| Phi-3 Silica | 2024-06 | — | 3.3B | No | No |
| Phi-3 Medium 128K | 2024-05 | 128K | 14B | No | No |
| Phi-3 Medium 4K | 2024-05 | 4K | 14B | No | No |
| Phi-3 Small 128K | 2024-05 | 128K | 7B | No | No |
| Phi-3 Small 8K | 2024-05 | 8K | 7B | No | No |
| Phi-3 Vision | 2024-05 | 128K | 4.2B | Yes | No |
| DeepInfra Phi 3 Mini 4K Instruct | 2024-05 | 4096 | 3800000000 | No | No |
| DeepInfra Phi 3 Small 128K Instruct | 2024-05 | 128k | 7000000000 | No | No |
| Phi-3 Mini 128K | 2024-04 | 128K | 3.8B | No | No |
| Phi-3 Mini 4k | 2024-04 | 4K | 3.8B | No | No |
| Phi-3 Mini | 2024-04 | 4096 | 3.8B | No | No |
| Phi-3 Medium | 2024-04 | 4096 | 14B | No | No |
Available From(6 providers)
Pricing
| Model | Provider | Input / 1M | Output / 1M | Type |
|---|---|---|---|---|
| DeepInfra Phi 3 Mini 4K Instruct | DeepInfra | $0.05 | $0.15 | Serverless |
| Phi-3 Mini 128K | Replicate API | $0.05 | $0.25 | Serverless |
| Phi-3 Mini 4k | Replicate API | $0.05 | $0.25 | Serverless |
| Phi-3 Mini 128K | Fireworks AI | $0.1 | $0.1 | Provisioned |
| Phi-3 Medium 4K | DeepInfra | $0.14 | $0.41 | Serverless |
| Phi-3 Vision | Fireworks AI | $0.2 | $0.2 | Serverless |
| Phi-3 Mini 4k | Azure OpenAI | $0.28 | $0.84 | Serverless |
| Phi-3 Vision | Azure OpenAI | $0.28 | $0.84 | Provisioned |
| Phi-3 Mini 128K | Azure OpenAI | $0.3 | $0.9 | Serverless |
| Phi-3 Small 8K | Azure OpenAI | $0.32 | $0.96 | Serverless |
| Phi-3 Small 128K | Azure OpenAI | $0.35 | $1.05 | Serverless |
| Phi-3 Medium 4K | Azure OpenAI | $0.45 | $1.35 | Serverless |
| DeepInfra Phi 3 Small 128K Instruct | DeepInfra | $0.45 | $0.65 | Serverless |
| Phi-3 Medium 128K | Azure OpenAI | $0.5 | $1.5 | Serverless |
| Phi 3.5 MoE Instruct | Fireworks AI | $0.5 | $0.5 | Serverless |
| Phi 3.5 Mini Instruct | Fireworks AI | $0.9 | $0.9 | Serverless |
Frequently Asked Questions
- What is Phi-3?
- The Phi-3 family, developed by Microsoft, consists of small language models (SLMs) optimized for Azure AI 1. These models are known for their capability and cost-effectiveness, outperforming larger models in tasks such as language processing, reasoning, coding, and math 1. The Phi-3 lineup includes models like the Phi-3-mini with 3.8 billion parameters, and the Phi-3-small and Phi-3-medium, each with 7 billion and 14 billion parameters, respectively 1. Notably, the Phi-3-mini supports up to a 128K token context window with minimal quality impact, a feature rare for models of its size 1. These models are instruction-tuned for straightforward usage and are optimized for various processing platforms, including GPUs, CPUs, and even mobile hardware 1. Despite their prowess, the Phi-3 models might perform slightly below larger models on factual knowledge tests due to their relatively smaller size 1.
- How many models are in the Phi-3 family?
- The Phi-3 family contains 15 models.
- What is the latest Phi-3 model?
- The latest model is Phi 3.5 Mini Instruct, released in 2024-08.
- How much does Phi-3 cost?
- Phi-3 models range from $0.05/1M to $0.9/1M input tokens depending on the model and provider.
Models(15)
Phi 3.5 Mini Instruct
Phi 3.5 MoE Instruct
Phi 3.5 Vision Instruct
Phi-3 Silica
Phi-3 Medium 128K
Phi-3 Medium 4K
Phi-3 Small 128K
Phi-3 Small 8K
Phi-3 Vision
DeepInfra Phi 3 Mini 4K Instruct
DeepInfra Phi 3 Small 128K Instruct
Phi-3 Mini 128K
Phi-3 Mini 4k
Phi-3 Mini
Phi-3 Medium