Directory · Routing layer
Routers & gateways
Can't pick one model? Route per request. 17 verified gateways and routers, updated daily.
Decision mechanism
Optimizes for
Routing scope
5 of 17 active routers
Kong Inc.
Subscription
Multi-LLM AI gateway built on Kong Gateway 3.x, adding semantic routing, load balancing, guardrails, and MCP traffic analytics as plugins over Kong's existing API management platform.
BerriAI
~100 models · Free OSS
Open-source Python SDK and proxy server that unifies 100+ LLM APIs behind a single OpenAI-compatible interface, with load balancing, cost tracking, and configurable failover.
Free OSS
NVIDIA's open-source AI blueprint for LLM routing that selects the optimal model per prompt via intent classification or neural auto-routing; being deprecated 2026-06-20.
LMSYS (lm-sys)
Free OSS
Open-source LLM routing framework from LMSYS that routes simpler queries to a cheaper weak model and harder ones to a stronger frontier model, achieving 35–85% cost reduction on benchmarks.
Red Hat / vLLM Project
Free OSS
Open-source Mixture-of-Models router that semantically classifies each request and routes it to the best backend (local, private, or frontier) by cost, latency, privacy, or safety, deployed as an Envoy External Processor.
Popular router comparisons
Curated router-vs-router pairs for common gateway, self-hosted, provider-native, and cost-routing decisions.
Compare routing policy, target providers, pricing model, API compatibility, and data handling.
Compare routing policy, target providers, pricing model, API compatibility, and data handling.
Compare routing policy, target providers, pricing model, API compatibility, and data handling.
Compare routing policy, target providers, pricing model, API compatibility, and data handling.
Compare routing policy, target providers, pricing model, API compatibility, and data handling.
Compare routing policy, target providers, pricing model, API compatibility, and data handling.