Open Inference
Researched 73d agoInference PlatformTier 3Open Inference
CodingRAGAgentsLong contextVisionClassificationJSON / Tool useapi
Open Inference offers 4 tracked models (4 with output token pricing). This catalog covers coding, rag, and agents; open any model detail page for benchmarks, batch tiers, and migration prompts.
Covers 7 workload areas across 4 tracked models; last verified 2026-06-30.
Use it for
- Teams comparing token and batch pricing across this provider's models
- Operators routing coding, rag, and agents workloads through this API
Do not use it for
- Final benchmark picks without opening the relevant model detail page
Tracked models
4
Models available through this provider
Priced output routes
4
Models with output token pricing tracked
Cheapest output
Unknown
Output pricing not yet tracked
Batch-ready models
0
No batch pricing tracked
Latest model release
2026-03-31
164d since newest release
Freshness
2026-06-30
Researched 73d ago
stale
Information
TypeInference Platform
TierTier 3
Models4
CompanyOpen Inference
Open Inference provides an OpenAI-compatible API for hosted text-generation model inference.
Where this host wins
- Coding: 2 tracked models with SWE-bench / HumanEval-style scores.
- RAG: 4 tracked models with ruler / needle retrieval benchmarks.
- Agentic: 4 tracked models with BFCL, tau-bench, and SWE-bench tool-use coverage.
- Long-context: 4 tracked models with context-token or InfiniteBench-class signal.
Platform Overview
Open Inference provides an OpenAI-compatible API for hosted text-generation model inference.
Available Models(4)
View all →All models available as Serverless
| Model | Input (per 1M) | Output (per 1M) |
|---|---|---|
| Gemma 4 26B A4B IT | $0 | $0 |
| Gemma 4 31B IT | $0 | $0 |
| gpt-oss-120b | $0 | $0 |
| gpt-oss-20b | $0 | $0 |
Where else to run this
gpt-oss-20b on Open Inference
Provider setup and pricing
gpt-oss-120b on Open Inference
Provider setup and pricing
Gemma 4 31B IT on Open Inference
Provider setup and pricing
gpt-oss-20b on Cloudflare Workers AI
Alternative host
gpt-oss-120b on Cloudflare Workers AI
Alternative host
Gemma 4 31B IT on Google AI Studio
Alternative host