Last refreshed 2026-05-01. Next refresh: weekly.
Why use Phi-3 Small 128K on NVIDIA NIM?
NVIDIA NIM offers Phi-3 Small 128K with competitive pricing. NVIDIA NIM is NVIDIA's deployment platform for GPU-accelerated inference microservices.
Compare Phi-3 Small 128K across 2 providers to find the best fit for your use caseInput / 1M
-
Output / 1M
-
Cache
Not sourced
Batch
Not sourced
Setup recipe
Docs fallbackInstall
Use the provider REST API or SDKAuth
Create a provider API keyCall
model: phi-3-small-128kModel ID
phi-3-small-128kRequest example
Curated snippets for this provider are not sourced yet. Use NVIDIA NIM documentation with model ID
phi-3-small-128k.Gotchas
No curated gotchas have been sourced for this exact provider/model route yet.
Compare Phi-3 Small 128K Across Providers
| Provider | Input (per 1M) | Output (per 1M) |
|---|---|---|
| Microsoft Foundry | $0.35 | $1.05 |
| NVIDIA NIM | — | — |
Pricing
| Type | Rate |
|---|---|
| GPU Hour Rate | $1.00/GPU·hr |
| GPU Config | 1xH100 |
Capabilities
No model capability flags are currently sourced.
FAQ
What is the context window for Phi-3 Small 128K on NVIDIA NIM?
Phi-3 Small 128K supports a 128,000 token context window on NVIDIA NIM.
How does NVIDIA NIM compare to other Phi-3 Small 128K providers?
Phi-3 Small 128K is available from 2 providers. The cheapest input pricing is $0.35/1M tokens from Microsoft Foundry.
Who created Phi-3 Small 128K?
Phi-3 Small 128K was created by Microsoft Research as part of the Phi-3 model family.
Is Phi-3 Small 128K open source?
Phi-3 Small 128K is open source according to the seed data.
Get Started
Model Specs
Released2024-05-21
Parameters7B
Context128K
ArchitectureDecoder Only