Using Phi-3 Medium 4K on NVIDIA NIM
Implementation guide · Phi-3 · Microsoft Research
NVIDIA NIM exposes Phi-3 Medium 4K through model ID phi-3-medium-4k. Use the setup steps, sourced pricing, capabilities, and official provider links below to validate this route before deployment.
Last refreshed 2026-05-01. Next refresh: weekly.
Quick Start
- 1
- 2Use the NVIDIA NIM SDK or REST API to call
phi-3-medium-4k— see the documentation for request format. - 3
Code Examples
Pricing on NVIDIA NIM
Capabilities
About Phi-3 Medium 4K
The Phi-3 Medium 4K, developed by Microsoft, is a state-of-the-art large language model with 14 billion parameters. It is engineered for efficiency across various tasks, particularly excelling in reasoning capabilities. This model is designed to handle 4,096 token context lengths, allowing for the processing of longer input sequences. Leveraging a dense, decoder-only Transformer architecture, it incorporates techniques like supervised fine-tuning and direct preference optimization to align with human preferences and safety standards. The model supports multilingual data, although it is primarily trained in English.