LLM Reference

Phi-3 Medium 128K

About

The Phi-3 Medium 128K is an open-source, 14-billion parameter language model by Microsoft, designed for efficient operation in resource-limited environments. Noted for its state-of-the-art performance on reasoning tasks, it excels in language understanding, code generation, and logical reasoning while offering a long context window of up to 128,000 tokens, making it ideal for applications like summarizing lengthy documents. Its dense decoder-only Transformer architecture has been refined with supervised fine-tuning and preference optimization to enhance instruction-following capabilities. Additionally, Phi-3 Medium 128K is optimized for diverse hardware platforms, ensuring broad accessibility and performance 12.

Capabilities

VisionMultimodalReasoningFunction CallingTool UseJSON ModeCode Execution

Providers(2)

Compare all →
ProviderInput (per 1M)Output (per 1M)Type
Azure OpenAI$0.5$1.5ServerlessProvisioned
NVIDIA NIMProvisioned

Benchmark Scores(2)

BenchmarkScoreVersionSource
HumanEval52.2pass@1Open LLM Leaderboard
Massive Multitask Language Understanding75.35-shotOpen LLM Leaderboard

Rankings

Specifications

FamilyPhi-3
Released2024-05-21
Parameters14B
Context128K
ArchitectureDecoder Only
Specializationgeneral
Trainingfinetuning

Created by

Advancing the state-of-the-art in AI and computing.

Redmond, Washington, United States
Founded 1991
Website