Using Phi 3.5 MoE Instruct on Fireworks AI
Implementation guide · Phi-3 · Microsoft Research
ServerlessOpen Source
Fireworks AI exposes Phi 3.5 MoE Instruct through model ID phi-3.5-moe-instruct. Use the setup steps, sourced pricing, capabilities, and official provider links below to validate this route before deployment.
Last refreshed 2026-05-19. Next refresh: weekly.
Quick Start
- 1
- 2Use the Fireworks AI SDK or REST API to call
phi-3.5-moe-instruct— see the documentation for request format. - 3
Code Examples
Install
pip install openaiAPI key
FIREWORKS_API_KEYModel ID
phi-3.5-moe-instructFireworks model IDs use "accounts/fireworks/models/{model-name}" format, e.g. "accounts/fireworks/models/llama4-scout-instruct-basic" or "accounts/fireworks/models/deepseek-r1".
import os
from openai import OpenAI
client = OpenAI(
api_key=os.environ["FIREWORKS_API_KEY"],
base_url="https://api.fireworks.ai/inference/v1"
)
response = client.chat.completions.create(
model="phi-3.5-moe-instruct",
messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)Pricing on Fireworks AI
| Type | Price (per 1M) |
|---|---|
| Input tokens | $0.50 |
| Output tokens | $0.50 |
Capabilities
No model capability flags are currently sourced.
About Phi 3.5 MoE Instruct
Phi 3.5 MoE Instruct is Microsoft Research's Phi-3 model. It offers a 128K-token context window with weights openly available for self-hosting.
Model Specs
Released2024-08-20
Parameters16x3.8B (42B, 6.6B active)
Context128k
ArchitectureDecoder Only
Knowledge cutoff2023-10