Using Phi 3.5 Mini Instruct on NVIDIA NIM

Implementation guide · Phi-3 · Microsoft Research

ServerlessOpen Source

NVIDIA NIM exposes Phi 3.5 Mini Instruct through model ID microsoft/phi-3.5-mini-instruct. Use the setup steps, sourced pricing, capabilities, and official provider links below to validate this route before deployment.

Last refreshed 2026-05-19. Next refresh: weekly.

Quick Start

  1. 1
    Create an account at NVIDIA NIM and generate an API key.
  2. 2
    Use the NVIDIA NIM SDK or REST API to call microsoft/phi-3.5-mini-instruct — see the documentation for request format.
  3. 3
    You'll be billed . See full pricing.
API PortalDocumentationPricing

Code Examples

See NVIDIA NIM documentation for integration details.

Pricing on NVIDIA NIM

Capabilities

No model capability flags are currently sourced.

About Phi 3.5 Mini Instruct

Phi 3.5 Mini Instruct is Microsoft Research's Phi-3 model. It offers a 128K-token context window with weights openly available for self-hosting.

Full model details →

Model Specs

Released2024-08-20
Parameters3.8B
Context128k
ArchitectureDecoder Only
Knowledge cutoff2023-10

More Models on NVIDIA NIM

Phi-3 Mini 128KPhi-3 Medium 4KPhi-3 Mini 4kPhi-3 Small 128KPhi-3 Small 8KPhi-3 Vision
All models on NVIDIA NIM →

Also available on(1)

Fireworks AI$0.90/1M
Compare all providers →

Provider

NVIDIA NIM

NVIDIA

Santa Clara, California, United States