Using Phi-3 Medium 128K on NVIDIA NIM
Implementation guide · Phi-3 · Microsoft Research
NVIDIA NIM exposes Phi-3 Medium 128K through model ID phi-3-medium-128k. Use the setup steps, sourced pricing, capabilities, and official provider links below to validate this route before deployment.
Last refreshed 2026-09-21. Next refresh: weekly.
Quick Start
- 1
- 2Use the NVIDIA NIM SDK or REST API to call
phi-3-medium-128k— see the documentation for request format. - 3
Code Examples
Pricing on NVIDIA NIM
Capabilities
No model capability flags are currently sourced.
About Phi-3 Medium 128K
The Phi-3 Medium 128K is an open-source, 14-billion parameter language model by Microsoft, designed for efficient operation in resource-limited environments. Noted for its state-of-the-art performance on reasoning tasks, it excels in language understanding, code generation, and logical reasoning while offering a long context window of up to 128,000 tokens, making it ideal for applications like summarizing lengthy documents. Its dense decoder-only Transformer architecture has been refined with supervised fine-tuning and preference optimization to enhance instruction-following capabilities. Additionally, Phi-3 Medium 128K is optimized for diverse hardware platforms, ensuring broad accessibility and performance 12.