Open-source LLM routers
Open-source router and gateway projects are the right first stop when you need inspectable routing policy, self-host paths, or a proxy you can adapt. This page keeps open-source rows in one view across gateway, router, and hybrid types.
Filtered router list
Helicone
Subscription
Observability-first AI gateway with routing, caching, rate limiting, and request tracing; Apache 2.0 open-source core with a managed hosted tier for logging and analytics.
BerriAI
~100 models · Free OSS
Open-source Python SDK and proxy server that unifies 100+ LLM APIs behind a single OpenAI-compatible interface, with load balancing, cost tracking, and configurable failover.
Portkey AI
~1.6K models · Subscription
Production AI gateway routing to 1,600+ LLMs with failover, load balancing, semantic caching, and guardrails; Apache 2.0 core is fully self-hostable with the complete feature set.
LMSYS (lm-sys)
Free OSS
Open-source LLM routing framework from LMSYS that routes simpler queries to a cheaper weak model and harder ones to a stronger frontier model, achieving 35–85% cost reduction on benchmarks.
Red Hat / vLLM Project
Free OSS
Open-source Mixture-of-Models router that semantically classifies each request and routes it to the best backend (local, private, or frontier) by cost, latency, privacy, or safety, deployed as an Envoy External Processor.
Related decision paths
These links keep the SEO view tied to the single router store, target-provider graph, and model decision pages.
Compare every verified gateway, router, and hybrid row in the shared store.
Use the directory controls to add openness, hosting, API, and routing-scope filters.
Inspect the provider that one or more listed routers can target.
Inspect the provider that one or more listed routers can target.
Inspect the provider that one or more listed routers can target.
Inspect the provider that one or more listed routers can target.
Choose the model side of a self-hosted stack.
Focus on deployment control instead of license alone.
Compare model cost before adding routing overhead.
Machine-readable source
This page is generated from data/seed/router.json. Agents can consume the same catalog through /api/routers.