Open Inference
Researched 5d agoInference PlatformTier 3Open Inference
Open Inference offers 4 tracked models (4 with output token pricing). This catalog covers coding, rag, and agents; open any model detail page for benchmarks, batch tiers, and migration prompts.
Covers 7 workload areas across 4 tracked models; last verified 2026-06-30.
Use it for
- Teams comparing token and batch pricing across this provider's models
- Operators routing coding, rag, and agents workloads through this API
Do not use it for
- Final benchmark picks without opening the relevant model detail page
Tracked models
4
Models available through this provider
Priced output routes
4
Models with output token pricing tracked
Cheapest output
Unknown
Output pricing not yet tracked
Batch-ready models
0
No batch pricing tracked
Latest model release
2026-03-31
96d since newest release
Freshness
2026-06-30
Researched 5d ago
Information
Open Inference provides an OpenAI-compatible API for hosted text-generation model inference.
Catalog freshness
The newest model tracked on this provider was released 2026-03-31 (96d ago).
Where this host wins
- Coding: 2 tracked models with SWE-bench / HumanEval-style scores.
- RAG: 4 tracked models with ruler / needle retrieval benchmarks.
- Agentic: 4 tracked models with BFCL, tau-bench, and SWE-bench tool-use coverage.
- Long-context: 4 tracked models with context-token or InfiniteBench-class signal.
Compliance notes
No verified compliance claims (SOC 2, ISO, HIPAA) tracked for this provider yet — check the vendor's trust center for current certifications.
Platform Overview
Open Inference provides an OpenAI-compatible API for hosted text-generation model inference.
Compare per-model pricing, input and output token costs, batch availability, and benchmark coverage.
Available Models(4)
View all →All models available as Serverless
| Model | Input (per 1M) | Output (per 1M) |
|---|---|---|
| Gemma 4 26B A4B IT | $0 | $0 |
| Gemma 4 31B IT | $0 | $0 |
| gpt-oss-120b | $0 | $0 |
| gpt-oss-20b | $0 | $0 |