Last refreshed 2026-05-01. Next refresh: weekly.
Why use Phi-3 Medium 128K on NVIDIA NIM?
NVIDIA NIM offers Phi-3 Medium 128K with competitive pricing. NVIDIA NIM is NVIDIA's deployment platform for GPU-accelerated inference microservices.
Compare Phi-3 Medium 128K across 2 providers to find the best fit for your use caseSetup recipe
Docs fallbackUse the provider REST API or SDKCreate a provider API keymodel: phi-3-medium-128kphi-3-medium-128kRequest example
phi-3-medium-128k.Gotchas
No curated gotchas have been sourced for this exact provider/model route yet.
Compare Phi-3 Medium 128K Across Providers
| Provider | Input (per 1M) | Output (per 1M) |
|---|---|---|
| Microsoft Foundry | $0.50 | $1.50 |
| NVIDIA NIM | — | — |
Pricing
| Type | Rate |
|---|---|
| GPU Hour Rate | $1.00/GPU·hr |
| GPU Config | 1xH100 |
Capabilities
No model capability flags are currently sourced.
About Phi-3 Medium 128K
The Phi-3 Medium 128K is an open-source, 14-billion parameter language model by Microsoft, designed for efficient operation in resource-limited environments. Noted for its state-of-the-art performance on reasoning tasks, it excels in language understanding, code generation, and logical reasoning while offering a long context window of up to 128,000 tokens, making it ideal for applications like summarizing lengthy documents. Its dense decoder-only Transformer architecture has been refined with supervised fine-tuning and preference optimization to enhance instruction-following capabilities. Additionally, Phi-3 Medium 128K is optimized for diverse hardware platforms, ensuring broad accessibility and performance 12.
FAQ
What is the context window for Phi-3 Medium 128K on NVIDIA NIM?
Phi-3 Medium 128K supports a 128,000 token context window on NVIDIA NIM.
How does NVIDIA NIM compare to other Phi-3 Medium 128K providers?
Phi-3 Medium 128K is available from 2 providers. The cheapest input pricing is $0.5/1M tokens from Microsoft Foundry.
Who created Phi-3 Medium 128K?
Phi-3 Medium 128K was created by Microsoft Research as part of the Phi-3 model family.
Is Phi-3 Medium 128K open source?
Phi-3 Medium 128K is open source according to the seed data.