Build with AI·Standings

Best LLM Gateways in 2026

This list covers software that sits between an app and large language model providers. Compare how many providers each gateway supports, whether it can switch to a fallback, and whether it offers usage analytics, spending controls or virtual API keys.

Check where each gateway runs: through an API, in a web browser, on your own server, or on Linux, macOS or Windows. The board also shows free plans and paid starting prices where provided. Each entry has a signal score out of 10, plus marks for a public API, open-source code and a free tier.

  • 33 platforms
  • 24 with a free tier
  • Checked 16 Oct 2026
  1. 1
    B
    Bifrostgetmaxim.ai

    Enterprise gateway unifying 20+ providers with routing, failover and access controls.

    8.5 APIOpenFree Free tier
  2. 2
    LG
    LLM Gatewayllmgateway.io

    OpenAI-compatible API routing 250+ models from 40+ providers; free plan.

    8.3 APIOpenFree Free tier
  3. 3
    M
    Manifestmanifest.build

    Open-source gateway with fallbacks, request repair and spending tracking; free plan.

    8.3 APIOpenFree Free tier · from $19/mo
  4. 4
    Y
    YoloRouteryolorouter.com

    OpenAI-compatible gateway translating protocols and routing across AI providers.

    8.0 APIOpenFree Free tier
  5. 5
    L
    LangSmithlangchain.com

    Platform for building, evaluating, deploying and monitoring AI agents; free plan.

    7.4 APIOpenFree Free tier · $39 usage-based
  6. 6
    T
    TensorZerotensorzero.com

    Open-source LLM gateway and optimization stack; free, but no longer maintained.

    7.2 APIOpenFree Free tier
  7. 7
    EA
    Envoy AI Gatewayaigateway.envoyproxy.io

    Open-source Envoy control plane with one API for hosted and self-hosted models.

    7.0 APIOpenFree Free tier
  8. 8
    KG
    Kong Gatewaykonghq.com

    Open-source software routes APIs for microservices across hybrid or multi-cloud environments.

    6.9 APIOpenFree Free tier
  9. 9
    S
    SGLangsglang.io

    Open-source framework for serving language, vision and diffusion models on GPUs.

    6.9 APIOpenFree Free tier
  10. 10
    R
    Requestyrequesty.ai

    OpenAI-compatible gateway for 600+ models with routing, analytics and failover.

    6.8 APIOpenFree Free tier
  11. 11
    R
    Routerlyrouterly.ai

    A free, self-hosted gateway that routes requests, tracks costs, and enforces budgets across providers.

    6.8 APIOpenFree Free tier
  12. 12
    TA
    TrueFoundry AI Gatewaytruefoundry.com

    Gateway connecting 1,000+ models across 35+ platforms through one API.

    6.8 APIOpenFree Free tier · from $499/mo
  13. 13
    O
    OpenRouteropenrouter.ai

    Single API for hundreds of models and text, image, video and audio generation.

    6.6 APIOpenFree Free tier
  14. 14
    H
    Heliconehelicone.ai

    AI gateway for routing, debugging and analytics, with 100+ models and a free plan.

    6.5 APIOpenFree Free tier · from $79/mo
  15. 15
    L
    LiteLLMlitellm.ai

    Open-source gateway with one API for 140+ providers and 1,800+ models.

    6.5 APIOpenFree Free tier
  16. 16
    OA
    Orq.aiorq.ai

    AI gateway for routing and governing 500+ models from 30+ providers.

    6.5 APIOpenFree Free tier
  17. 17
    IG
    Inference Gatewaydocs.inference-gateway.com

    An open-source proxy exposing hosted and local providers through one OpenAI-compatible API.

    6.5 APIOpenFree Free tier
  18. 18
    P
    Polyrouterpolyrouter.app

    An open-source gateway offering one endpoint for multiple providers, routing rules, fallbacks, and budgets.

    6.4 APIOpenFree Free tier
  19. 19
    TA
    Tyk AI Studio Proxytyk.io

    Open-source control plane for routing and securing LLM, agent and tool traffic.

    6.3 APIOpenFree Free tier
  20. 20
    WA
    WSO2 AI Gatewaywso2.com

    A paid gateway governing AI APIs with usage visibility, guardrails, prompt management, and caching.

    6.3 APIOpenFree Free tier · from $119/mo
  21. 21
    CA
    Cloudflare AI Gatewaycloudflare.com

    An AI gateway with fallback routing, usage analytics, and budget controls.

    6.3 APIOpenFree Free tier
  22. 22
    EA
    Eden AIedenai.co

    Unified API for 500+ AI models covering OCR, speech, vision and translation.

    6.2 APIOpenFree $5.50 one-time
  23. 23
    U
    UniterRouteruniterouter.ai

    Unified API gateway for 200+ models with load balancing and cost-based routing.

    6.2 APIOpenFree Free tier · from $500/yr
  24. 24
    V
    Vercelvercel.com

    Platform that lets teams create, ship, secure, monitor, and scale apps and agents.

    6.2 APIOpenFree Free tier · $20 usage-based
  25. 25
    AA
    Apache APISIXapisix.apache.org

    An open-source API and AI gateway for routing, securing, and managing API and LLM traffic.

    6.2 APIOpenFree Free tier

Places #1, #2, #3, #4, #5 on this board are open to sponsors. Take #1 · Other ways to advertise

How to choose

Start with the access you need

Twenty-seven of the 33 gateways have a free plan. Nine offer a free trial, while some are paid or list pricing only on request.

Examples include TensorZero and Envoy AI Gateway with free plans, Helicone with a free plan and a seven-day trial, and LiteLLM with a 30-day trial.

Match the way your apps connect

An API is a connection that lets software send requests without a browser. Thirty-one items offer an API and 28 have a web option.

Twenty-two support self-hosting, meaning you run the gateway on your own servers. Platform coverage also includes Linux for 13 items, macOS for nine and Windows for six.

Look for routing and spending controls

The comparison covers provider count, fallback routing, usage analytics, budget controls and virtual API keys. These features help you see usage, set limits and switch providers when needed.

Check which of these controls your existing apps require before choosing a gateway.

Read the paid terms closely

Pricing varies. Manifest lists a free plan with paid service from $19 a month, LangSmith from $39 per user each month, and Helicone from $79 a month with a seven-day trial.

Kong Gateway lists paid pricing on request, while OpenRouter and Requesty list free plans without a paid starting price in the supplied details.

Questions

How many LLM gateways are on the list?

The list contains 33 gateways.

Do most gateways have a free plan?

Yes. Twenty-seven of the 33 items have a free plan.

Can I run a gateway myself?

Self-hosting is available for 22 items. This means running the gateway on your own server rather than using only a hosted service.

Which platforms are covered?

Thirty-one items offer an API, 28 have a web option, 22 support self-hosting, 13 support Linux, nine support macOS and six support Windows.

What features are compared?

The board compares free plan, paid starting price, provider count, fallback routing, usage analytics, self-hosted deployment, budget controls and virtual API keys.

Some top positions on this board can be paid placements, standing where they were sold. The facts on each platform are not for sale. How we rank · Disclosure