Last refreshed 2026-05-01. Next refresh: weekly.
Why use Phi-3 Medium 4K on NVIDIA NIM?
NVIDIA NIM offers Phi-3 Medium 4K with competitive pricing. NVIDIA NIM is NVIDIA's deployment platform for GPU-accelerated inference microservices.
Compare Phi-3 Medium 4K across 3 providers to find the best fit for your use caseSetup recipe
Docs fallbackUse the provider REST API or SDKCreate a provider API keymodel: phi-3-medium-4kphi-3-medium-4kRequest example
phi-3-medium-4k.Gotchas
No curated gotchas have been sourced for this exact provider/model route yet.
Compare Phi-3 Medium 4K Across Providers
| Provider | Input (per 1M) | Output (per 1M) |
|---|---|---|
| Microsoft Foundry | $0.45 | $1.35 |
| NVIDIA NIM | — | — |
| DeepInfra | $0.14 | $0.41 |
Pricing
| Type | Rate |
|---|---|
| GPU Hour Rate | $1.00/GPU·hr |
| GPU Config | 1xH100 |
Capabilities
About Phi-3 Medium 4K
The Phi-3 Medium 4K, developed by Microsoft, is a state-of-the-art large language model with 14 billion parameters. It is engineered for efficiency across various tasks, particularly excelling in reasoning capabilities. This model is designed to handle 4,096 token context lengths, allowing for the processing of longer input sequences. Leveraging a dense, decoder-only Transformer architecture, it incorporates techniques like supervised fine-tuning and direct preference optimization to align with human preferences and safety standards. The model supports multilingual data, although it is primarily trained in English. Its lightweight nature allows for deployment on diverse hardware platforms, making it accessible and versatile for both commercial and research purposes. Safety measures are embedded, although further precautions are advised for applications with higher risks.
FAQ
What is the context window for Phi-3 Medium 4K on NVIDIA NIM?
Phi-3 Medium 4K supports a 4,000 token context window on NVIDIA NIM.
How does NVIDIA NIM compare to other Phi-3 Medium 4K providers?
Phi-3 Medium 4K is available from 3 providers. The cheapest input pricing is $0.14/1M tokens from DeepInfra.
Who created Phi-3 Medium 4K?
Phi-3 Medium 4K was created by Microsoft Research as part of the Phi-3 model family.
Is Phi-3 Medium 4K open source?
Phi-3 Medium 4K is open source according to the seed data.