Build with AI·Standings
Best LLM Gateways in 2026
This list covers software that sits between an app and large language model providers. Compare how many providers each gateway supports, whether it can switch to a fallback, and whether it offers usage analytics, spending controls or virtual API keys.
Check where each gateway runs: through an API, in a web browser, on your own server, or on Linux, macOS or Windows. The board also shows free plans and paid starting prices where provided. Each entry has a signal score out of 10, plus marks for a public API, open-source code and a free tier.
- 33 platforms
- 24 with a free tier
- Checked 16 Oct 2026
- 1 B
Bifrostgetmaxim.aiEnterprise gateway unifying 20+ providers with routing, failover and access controls.
- 2 LGLLM Gatewayllmgateway.io
OpenAI-compatible API routing 250+ models from 40+ providers; free plan.
- 3 MManifestmanifest.build
Open-source gateway with fallbacks, request repair and spending tracking; free plan.
- 4 YYoloRouteryolorouter.com
OpenAI-compatible gateway translating protocols and routing across AI providers.
- 5 L
LangSmithlangchain.comPlatform for building, evaluating, deploying and monitoring AI agents; free plan.
- 6 T
TensorZerotensorzero.comOpen-source LLM gateway and optimization stack; free, but no longer maintained.
- 7 EAEnvoy AI Gatewayaigateway.envoyproxy.io
Open-source Envoy control plane with one API for hosted and self-hosted models.
- 8 KG
Kong Gatewaykonghq.comOpen-source software routes APIs for microservices across hybrid or multi-cloud environments.
- 9 SSGLangsglang.io
Open-source framework for serving language, vision and diffusion models on GPUs.
- 10 RRequestyrequesty.ai
OpenAI-compatible gateway for 600+ models with routing, analytics and failover.
- 11 RRouterlyrouterly.ai
A free, self-hosted gateway that routes requests, tracks costs, and enforces budgets across providers.
- 12 TATrueFoundry AI Gatewaytruefoundry.com
Gateway connecting 1,000+ models across 35+ platforms through one API.
- 13 O
OpenRouteropenrouter.aiSingle API for hundreds of models and text, image, video and audio generation.
- 14 H
Heliconehelicone.aiAI gateway for routing, debugging and analytics, with 100+ models and a free plan.
- 15 L
LiteLLMlitellm.aiOpen-source gateway with one API for 140+ providers and 1,800+ models.
- 16 OA
Orq.aiorq.aiAI gateway for routing and governing 500+ models from 30+ providers.
- 17 IGInference Gatewaydocs.inference-gateway.com
An open-source proxy exposing hosted and local providers through one OpenAI-compatible API.
- 18 PPolyrouterpolyrouter.app
An open-source gateway offering one endpoint for multiple providers, routing rules, fallbacks, and budgets.
- 19 TATyk AI Studio Proxytyk.io
Open-source control plane for routing and securing LLM, agent and tool traffic.
- 20 WAWSO2 AI Gatewaywso2.com
A paid gateway governing AI APIs with usage visibility, guardrails, prompt management, and caching.
- 21 CA
Cloudflare AI Gatewaycloudflare.comAn AI gateway with fallback routing, usage analytics, and budget controls.
- 22 EAEden AIedenai.co
Unified API for 500+ AI models covering OCR, speech, vision and translation.
- 23 UUniterRouteruniterouter.ai
Unified API gateway for 200+ models with load balancing and cost-based routing.
- 24 V
Vercelvercel.comPlatform that lets teams create, ship, secure, monitor, and scale apps and agents.
- 25 AA
Apache APISIXapisix.apache.orgAn open-source API and AI gateway for routing, securing, and managing API and LLM traffic.
Places #1, #2, #3, #4, #5 on this board are open to sponsors. Take #1 · Other ways to advertise
How to choose
Start with the access you need
Twenty-seven of the 33 gateways have a free plan. Nine offer a free trial, while some are paid or list pricing only on request.
Examples include TensorZero and Envoy AI Gateway with free plans, Helicone with a free plan and a seven-day trial, and LiteLLM with a 30-day trial.
Match the way your apps connect
An API is a connection that lets software send requests without a browser. Thirty-one items offer an API and 28 have a web option.
Twenty-two support self-hosting, meaning you run the gateway on your own servers. Platform coverage also includes Linux for 13 items, macOS for nine and Windows for six.
Look for routing and spending controls
The comparison covers provider count, fallback routing, usage analytics, budget controls and virtual API keys. These features help you see usage, set limits and switch providers when needed.
Check which of these controls your existing apps require before choosing a gateway.
Read the paid terms closely
Pricing varies. Manifest lists a free plan with paid service from $19 a month, LangSmith from $39 per user each month, and Helicone from $79 a month with a seven-day trial.
Kong Gateway lists paid pricing on request, while OpenRouter and Requesty list free plans without a paid starting price in the supplied details.
Questions
How many LLM gateways are on the list?
The list contains 33 gateways.
Do most gateways have a free plan?
Yes. Twenty-seven of the 33 items have a free plan.
Can I run a gateway myself?
Self-hosting is available for 22 items. This means running the gateway on your own server rather than using only a hosted service.
Which platforms are covered?
Thirty-one items offer an API, 28 have a web option, 22 support self-hosting, 13 support Linux, nine support macOS and six support Windows.
What features are compared?
The board compares free plan, paid starting price, provider count, fallback routing, usage analytics, self-hosted deployment, budget controls and virtual API keys.
Some top positions on this board can be paid placements, standing where they were sold. The facts on each platform are not for sale. How we rank · Disclosure