Last refreshed 2026-05-01. Next refresh: weekly.
Why use Phi 3.5 Mini Instruct on NVIDIA NIM?
NVIDIA NIM offers Phi 3.5 Mini Instruct with competitive pricing. NVIDIA NIM is NVIDIA's deployment platform for GPU-accelerated inference microservices.
Compare Phi 3.5 Mini Instruct across 2 providers to find the best fit for your use caseInput / 1M
-
Output / 1M
-
Cache
Not sourced
Batch
Not sourced
Setup recipe
Docs fallbackInstall
Use the provider REST API or SDKAuth
Create a provider API keyCall
model: microsoft/phi-3.5-mini-instructModel ID
microsoft/phi-3.5-mini-instructRequest example
Curated snippets for this provider are not sourced yet. Use NVIDIA NIM documentation with model ID
microsoft/phi-3.5-mini-instruct.Gotchas
- Use provider model ID "microsoft/phi-3.5-mini-instruct", not the LLMReference slug "phi-3.5-mini-instruct".
Compare Phi 3.5 Mini Instruct Across Providers
| Provider | Input (per 1M) | Output (per 1M) |
|---|---|---|
| Fireworks AI | $0.90 | $0.90 |
| NVIDIA NIM | — | — |
Pricing
| Type | Rate |
|---|---|
| GPU Hour Rate | $1.00/GPU·hr |
| GPU Config | 1xH100 |
Capabilities
No model capability flags are currently sourced.
FAQ
What is the context window for Phi 3.5 Mini Instruct on NVIDIA NIM?
Phi 3.5 Mini Instruct supports a 128,000 token context window on NVIDIA NIM.
How does NVIDIA NIM compare to other Phi 3.5 Mini Instruct providers?
Phi 3.5 Mini Instruct is available from 2 providers. The cheapest input pricing is $0.9/1M tokens from Fireworks AI.
What API model ID do I use for Phi 3.5 Mini Instruct on NVIDIA NIM?
Use the model ID microsoft/phi-3.5-mini-instruct when calling NVIDIA NIM's API.
Who created Phi 3.5 Mini Instruct?
Phi 3.5 Mini Instruct was created by Microsoft Research as part of the Phi-3 model family.
Is Phi 3.5 Mini Instruct open source?
Phi 3.5 Mini Instruct is open source according to the seed data.
Model Specs
Released2024-08-20
Parameters3.8B
Context128K
ArchitectureDecoder Only