Phi-2
About
The Phi family of language models, developed by Microsoft Research, comprises several small language models (SLMs) designed to achieve high performance despite their relatively small size. These models employ a Transformer architecture and are trained on a blend of synthetic and web datasets 12. Emphasizing the quality of training data, the models prioritize "textbook-quality" information to enhance reasoning and understanding capabilities 1. The Phi series includes Phi-1, Phi-1.5, and Phi-2, with each version incorporating advancements in model scaling and data curation 1. Phi-2, the latest in the series, has 2.7 billion parameters and exhibits state-of-the-art performance among base models with fewer than 13 billion parameters across various benchmarks 12. Notably, Phi-2 has not been subjected to reinforcement learning from human feedback (RLHF) or instruction fine-tuning 12, and the models are accessible to researchers to aid exploration of safety challenges and other language model developments 2.
Specifications(1 models)
| Model | Released | Parameters | Structured Outputs |
|---|---|---|---|
| Phi-2 | 2023-12 | 2.7B | Yes |
Available From(5 providers)
Pricing
| Model | Provider | Input / 1M | Output / 1M | Type |
|---|---|---|---|---|
| Phi-2 | Replicate API | $0.05 | $0.25 | Serverless |
| Phi-2 | Microsoft Foundry | $0.07 | $0.07 | Provisioned |
| Phi-2 | Together AI | $0.1 | $0.1 | Serverless |
| Phi-2 | Fireworks AI | $0.1 | $0.1 | Provisioned |
Frequently Asked Questions
- What is Phi-2?
- The Phi family of language models, developed by Microsoft Research, comprises several small language models (SLMs) designed to achieve high performance despite their relatively small size. These models employ a Transformer architecture and are trained on a blend of synthetic and web datasets 12. Emphasizing the quality of training data, the models prioritize "textbook-quality" information to enhance reasoning and understanding capabilities 1. The Phi series includes Phi-1, Phi-1.5, and Phi-2, with each version incorporating advancements in model scaling and data curation 1. Phi-2, the latest in the series, has 2.7 billion parameters and exhibits state-of-the-art performance among base models with fewer than 13 billion parameters across various benchmarks 12. Notably, Phi-2 has not been subjected to reinforcement learning from human feedback (RLHF) or instruction fine-tuning 12, and the models are accessible to researchers to aid exploration of safety challenges and other language model developments 2.
- How many models are in the Phi-2 family?
- The Phi-2 family contains 1 model.
- What is the latest Phi-2 model?
- The latest model is Phi-2, released in 2023-12.
- How much does Phi-2 cost?
- Phi-2 models range from $0.05/1M to $0.1/1M input tokens depending on the model and provider.
