Last refreshed 2026-04-15. Next refresh: weekly.
Why use Phi-3 Mini 128K on Baseten API?
Baseten API offers Phi-3 Mini 128K with competitive pricing. Baseten is an AI infrastructure platform that provides comprehensive tools for deploying and serving machine learning models efficiently and cost-effectively.
Compare Phi-3 Mini 128K across 5 providers to find the best fit for your use caseSetup recipe
Docs fallbackUse the provider REST API or SDKCreate a provider API keymodel: phi-3-mini-128kphi-3-mini-128kRequest example
phi-3-mini-128k.Gotchas
No curated gotchas have been sourced for this exact provider/model route yet.
Compare Phi-3 Mini 128K Across Providers
| Provider | Input (per 1M) | Output (per 1M) |
|---|---|---|
| NVIDIA NIM | — | — |
| Baseten API | — | — |
| Microsoft Foundry | $0.30 | $0.90 |
| Fireworks AI | $0.10 | $0.10 |
| Replicate API | $0.05 | $0.25 |
Capabilities
No model capability flags are currently sourced.
About Phi-3 Mini 128K
Phi-3 Mini-128K-Instruct, developed by Microsoft, is a 3.8 billion-parameter large language model renowned for its lightweight, open-source architecture. Despite its modest size, it excels in reasoning tasks, particularly in math and logic, and showcases strong code generation capabilities. A standout feature is its remarkable ability to handle up to 128,000 tokens, allowing it to process extensive text documents and codebases efficiently. While it has limitations in factual knowledge and focuses primarily on English, it strikes a balance between performance and efficiency, making it ideal for resource-constrained environments. The model is available on platforms like Azure AI Studio and Hugging Face and benefits from training on high-quality synthetic and publicly available data, with fine-tuning to improve instruction adherence and safety.
FAQ
What is the context window for Phi-3 Mini 128K on Baseten API?
Phi-3 Mini 128K supports a 128,000 token context window on Baseten API.
How does Baseten API compare to other Phi-3 Mini 128K providers?
Phi-3 Mini 128K is available from 5 providers. The cheapest input pricing is $0.05/1M tokens from Replicate API.
Who created Phi-3 Mini 128K?
Phi-3 Mini 128K was created by Microsoft Research as part of the Phi-3 model family.
Is Phi-3 Mini 128K open source?
Phi-3 Mini 128K is open source according to the seed data.