Directory · Routing layer

Routers & gateways

Can't pick one model? Route per request. 17 verified gateways and routers, updated daily.

Openness

Hosting

API compatibility

Sort

Decision mechanism

Optimizes for

Routing scope

4 of 17 active routers

Show deprecated

Helicone

GatewayOpen sourceHosted SaaSReliabilityCost

Subscription

Observability-first AI gateway with routing, caching, rate limiting, and request tracing; Apache 2.0 open-source core with a managed hosted tier for logging and analytics.

FreshView detail

Kong AI Gateway

Kong Inc.

GatewayCommercialSelf-hostedCostLatency

Subscription

Multi-LLM AI gateway built on Kong Gateway 3.x, adding semantic routing, load balancing, guardrails, and MCP traffic analytics as plugins over Kong's existing API management platform.

FreshView detail

LiteLLM

BerriAI

GatewayOpen sourceSelf-hostedCostReliability

~100 models · Free OSS

Open-source Python SDK and proxy server that unifies 100+ LLM APIs behind a single OpenAI-compatible interface, with load balancing, cost tracking, and configurable failover.

FreshView detail

Portkey

Portkey AI

GatewayOpen sourceHosted SaaSReliabilityCost

~1.6K models · Subscription

Production AI gateway routing to 1,600+ LLMs with failover, load balancing, semantic caching, and guardrails; Apache 2.0 core is fully self-hostable with the complete feature set.

FreshView detail

Popular router comparisons

Curated router-vs-router pairs for common gateway, self-hosted, provider-native, and cost-routing decisions.

OpenRouter vs Requesty