Inference Gateway

Inference Gateway alternatives

The platforms standing nearest to Inference Gateway on LLM gateways.

Nearest on its board

  1. 16
    OA
    Orq.aiorq.ai

    Orq.ai provides an AI gateway and platform to route, govern, and observe AI model and tool requests.

    6.5 APIOpenFree Free tier
  2. 18
    P
    Polyrouterpolyrouter.app

    Polyrouter is an open-source LLM gateway that puts one endpoint in front of multiple model providers.

    6.4 APIOpenFree Free tier
  3. 15
    L
    LiteLLMlitellm.ai

    LiteLLM is an open-source AI gateway and LLM proxy for platform teams.

    6.5 APIOpenFree Free tier
  4. 19
    TA
    Tyk AI Studio Proxytyk.io

    AI Studio is an open source control plane for routing, governing, and securing organizational AI traffic, including LLMs, agents, MCP tool chains, and RAG…

    6.3 APIOpenFree Free tier
  5. 14
    H
    Heliconehelicone.ai

    Helicone routes, debugs, and analyzes AI applications.

    6.5 APIOpenFree Free tier · from $79/mo
  6. 20
    WA
    WSO2 AI Gatewaywso2.com

    WSO2 AI Gateway governs AI APIs and GenAI services with usage visibility, AI guardrails, prompt management, and semantic caching.

    6.3 APIOpenFree Free tier · from $119/mo
  7. 13
    O
    OpenRouteropenrouter.ai
    6.6 APIOpenFree Free tier
  8. 21
    CA
    Cloudflare AI Gatewaycloudflare.com

    Cloudflare AI Gateway is a managed control plane that routes AI application traffic through one gateway for visibility, controls, billing and logs.

    6.3 APIOpenFree Free tier
  9. 12
    TA
    TrueFoundry AI Gatewaytruefoundry.com

    TrueFoundry AI Gateway is a control layer that connects applications to models, tools and agents while centralizing routing, governance, observability and cost…

    6.8 APIOpenFree Free tier · from $499/mo
  10. 22
    EA
    Eden AIedenai.co

    Eden AI provides one OpenAI-compatible gateway to roughly 1,000 language and specialist models from more than 50 providers.

    6.2 APIOpenFree $5.50 one-time
  11. 11
    R
    Routerlyrouterly.ai

    Routerly is a self-hosted gateway between applications and AI providers that routes requests, tracks costs, and enforces budgets.

    6.8 APIOpenFree Free tier
  12. 23
    U
    UniterRouteruniterouter.ai

    UniterRouter is a unified AI gateway that routes and analyzes requests across multiple LLM providers through one API.

    6.2 APIOpenFree Free tier · from $500/yr
  13. 10
    R
    Requestyrequesty.ai

    Requesty is an AI gateway that places one OpenAI-compatible endpoint in front of more than 600 language models.

    6.8 APIOpenFree Free tier
  14. 24
    V
    Vercelvercel.com

    Vercel describes itself as infrastructure for building, deploying, securing, observing, and scaling apps and agents.

    6.2 APIOpenFree Free tier · $20 usage-based
  15. 9
    S
    SGLangsglang.io

    SGLang is an open-source inference framework for serving large language, vision-language, and diffusion models.

    6.9 APIOpenFree Free tier
  16. 25
    AA
    Apache APISIXapisix.apache.org

    Apache APISIX is an open-source API gateway for routing, securing, and managing traffic to APIs, microservices, and LLM workloads.

    6.2 APIOpenFree Free tier
  17. 8
    KG
    Kong Gatewaykonghq.com

    Kong Gateway is an open-source API gateway built for hybrid and multi-cloud environments and optimized for microservices and distributed architectures.

    6.9 APIOpenFree Free tier
  18. 26
    VS
    vLLM Semantic Routervllm-sr.ai

    vLLM Semantic Router is an open, programmable decision layer that selects or combines models for each call according to policy.

    6.2 APIOpenFree Free tier
  19. 7
    EA
    Envoy AI Gatewayaigateway.envoyproxy.io

    Envoy AI Gateway, now named Agent Router, is an open-source control plane for managing AI and agent traffic using Envoy.

    7.0 APIOpenFree Free tier
  20. 27
    Z
    ZenMuxzenmux.ai
    6.1 APIOpenFree Free tier · from $20/mo