Question 1

What is the context window of Phi-3 Small 128K?

Accepted Answer

Phi-3 Small 128K has a context window of 128K tokens.

Question 2

How much does Phi-3 Small 128K cost?

Accepted Answer

Phi-3 Small 128K is available at $0.35/1M input tokens through Azure OpenAI.

Question 3

When was Phi-3 Small 128K released?

Accepted Answer

Phi-3 Small 128K was released on 2024-05-21.

Question 4

Which providers offer Phi-3 Small 128K?

Accepted Answer

Phi-3 Small 128K is available from 2 providers: Azure OpenAI, NVIDIA NIM.

Question 5

What benchmarks has Phi-3 Small 128K been tested on?

Accepted Answer

Phi-3 Small 128K has been evaluated on 4 benchmarks, including Google-Proof Q&A, HellaSwag, HumanEval, Massive Multitask Language Understanding.

Provider	Input (per 1M)	Output (per 1M)	Type
Azure OpenAI	$0.35	$1.05	ServerlessProvisioned
NVIDIA NIM	—	—	Provisioned

Benchmark	Score	Version	Source
Google-Proof Q&A	51.9	diamond	research
HellaSwag	90.8	10-shot	research
HumanEval	73.8	pass@1	research
Massive Multitask Language Understanding	78.1	5-shot	research

Phi-3 Small 128K

Capabilities