Directory · Routing layer
Routers & gateways
Can't pick one model? Route per request. 17 verified gateways and routers, updated daily.
Editorial picks are selected independently by our editorial team based on technical merit and breadth of use. We may earn a commission on purchases made through affiliate links; this does not influence editorial picks.
Decision mechanism
Optimizes for
Routing scope
4 of 17 active routers
BerriAI
~100 models · Free OSS
Open-source Python SDK and proxy server that unifies 100+ LLM APIs behind a single OpenAI-compatible interface, with load balancing, cost tracking, and configurable failover.
Portkey AI
~1.6K models · Subscription
Production AI gateway routing to 1,600+ LLMs with failover, load balancing, semantic caching, and guardrails; Apache 2.0 core is fully self-hostable with the complete feature set.
Helicone
Subscription
Observability-first AI gateway with routing, caching, rate limiting, and request tracing; Apache 2.0 open-source core with a managed hosted tier for logging and analytics.
Kong Inc.
Subscription
Multi-LLM AI gateway built on Kong Gateway 3.x, adding semantic routing, load balancing, guardrails, and MCP traffic analytics as plugins over Kong's existing API management platform.
Popular router comparisons
- Policy
- Providers
- Pricing
- API
- Data
- Policy
- Providers
- Pricing
- API
- Data
- Policy
- Providers
- Pricing
- API
- Data
- Policy
- Providers
- Pricing
- API
- Data
- Policy
- Providers
- Pricing
- API
- Data
- Policy
- Providers
- Pricing
- API
- Data