Last refreshed 2026-05-01. Next refresh: weekly.
Why use Phi-3 Small 8K on NVIDIA NIM?
NVIDIA NIM offers Phi-3 Small 8K with competitive pricing. NVIDIA NIM is NVIDIA's deployment platform for GPU-accelerated inference microservices.
Compare Phi-3 Small 8K across 2 providers to find the best fit for your use caseInput / 1M
-
Output / 1M
-
Cache
Not sourced
Batch
Not sourced
Setup recipe
Docs fallbackInstall
Use the provider REST API or SDKAuth
Create a provider API keyCall
model: phi-3-small-8kModel ID
phi-3-small-8kRequest example
Curated snippets for this provider are not sourced yet. Use NVIDIA NIM documentation with model ID
phi-3-small-8k.Gotchas
No curated gotchas have been sourced for this exact provider/model route yet.
Compare Phi-3 Small 8K Across Providers
| Provider | Input (per 1M) | Output (per 1M) |
|---|---|---|
| Microsoft Foundry | $0.32 | $0.96 |
| NVIDIA NIM | — | — |
Pricing
| Type | Rate |
|---|---|
| GPU Hour Rate | $1.00/GPU·hr |
| GPU Config | 1xH100 |
Capabilities
No model capability flags are currently sourced.
FAQ
What is the context window for Phi-3 Small 8K on NVIDIA NIM?
Phi-3 Small 8K supports a 8,000 token context window on NVIDIA NIM.
How does NVIDIA NIM compare to other Phi-3 Small 8K providers?
Phi-3 Small 8K is available from 2 providers. The cheapest input pricing is $0.32/1M tokens from Microsoft Foundry.
Who created Phi-3 Small 8K?
Phi-3 Small 8K was created by Microsoft Research as part of the Phi-3 model family.
Is Phi-3 Small 8K open source?
Phi-3 Small 8K is open source according to the seed data.
Get Started
Model Specs
Released2024-05-21
Parameters7B
Context8K
ArchitectureDecoder Only