Inferse
For vendors
AdvertiseTop spots, featured rows, home sponsor Get listedAdd a product we don't cover yet Claim a listingFree: verify the domain, then correct your page Vendor dashboardNumbers, orders and placements
List your platform
Vendor dashboard

LLM Gateway

APIyesFREEyesDOCS4/5
LG7.3#8of 33
outWeboutLinux

Ranked in LLM gateways·Free plan

Visit site Alternatives

About

LLM Gateway provides one OpenAI-compatible API for routing requests across 250+ models from 40+ providers. If a provider errors, times out, or rate-limits a request, the gateway can retry up to twice with another provider for the same model. Its dashboard tracks request, token, spend, latency, error, and cache metrics, with breakdowns by provider and model. Teams can bring their own provider API keys without a platform fee and pay providers directly. The core is open source under AGPLv3 and can be self-hosted for free; enterprise features require a license. The Free plan is free forever, lists a 5% fee on credit usage, and includes 200+ models across 40+ providers, activity logs, and export. It allows 20 requests per minute on free models; paid models are not rate limited. Enterprise adds custom routing, SSO, centrally configured guardrails, unlimited data retention, a 99.9% uptime SLA, and 24/7 priority support. Enterprise pricing is custom and requires contacting the company.

Who it is for

It suits product and platform teams routing model requests through a shared API. Enterprise identity, guardrails, and support target organizations deploying LLM infrastructure across teams.

What is good

  • One API routes requests across 250+ models
  • Can retry failed requests with another provider
  • Dashboard breaks down usage and performance metrics
  • Open-source core can be self-hosted for free
  • BYOK has no platform fee

What to know first

  • Free plan charges a 5% fee on credit usage
  • Free models are limited to 20 requests per minute
  • Enterprise pricing is custom and not listed

Verdict

LLM Gateway brings multi-provider routing, fallback retries, and usage metrics behind an OpenAI-compatible API, with a free self-hostable core. Enterprise identity, guardrails, and support are available under custom pricing.

Compared on LLM gateways

Free plan
Yesllmgateway.io
Fallback routing
Yesllmgateway.io
Usage analytics
Yesllmgateway.io
Self-hosted deployment
Yesllmgateway.io
Budget controls
Yesllmgateway.io
Virtual API keys
Yesllmgateway.io

Facts

Product
LLM Gateway provides one OpenAI-compatible API to route requests across 250+ models from 40+ providers.llmgateway.io · 7 Oct 2026
Routing
The gateway can retry up to twice with another provider for the same model when a provider errors, times out, or rate-limits a request.llmgateway.io · 7 Oct 2026
Analytics
The dashboard tracks request, token, spend, latency, error, and cache metrics, with breakdowns by model and provider.llmgateway.io · 7 Oct 2026
BYOK
Using your own provider API keys has no platform fee; users pay providers directly.llmgateway.io · 7 Oct 2026
Self-hosting
The core gateway is open source under AGPLv3 and can be self-hosted for free; enterprise features require a license.llmgateway.io · 7 Oct 2026
Integrations
Published integration guides include Claude Code, Cursor, Codex CLI, Cline, Continue CLI, GitHub Copilot, n8n, OpenCode, and VS Code.llmgateway.io · 7 Oct 2026
Security
The company states that it is SOC 2 Type II audited and GDPR-aligned, and describes TLS in transit and AES-256 encryption at rest.llmgateway.io · 7 Oct 2026
Enterprise identity
Enterprise SSO supports SAML 2.0 and OIDC with SCIM provisioning and group-based role mapping.llmgateway.io · 7 Oct 2026
Guardrails
Enterprise guardrails detect prompt injection, personally identifiable information, and secrets, and can be centrally configured at the gateway.llmgateway.io · 7 Oct 2026
Data retention
Pricing lists metadata retention as free and full payload retention at $0.01 per 1 million tokens; the Free plan includes activity logs and export.llmgateway.io · 7 Oct 2026
Support
The Free plan lists Discord Community support, while Enterprise includes 24/7 priority support through a dedicated Slack or Discord channel.llmgateway.io · 7 Oct 2026
Enterprise limits
Enterprise plans include unlimited seats and unlimited data retention, according to the enterprise page.llmgateway.io · 7 Oct 2026
Who it serves
The product describes itself as serving product and platform teams, while enterprise features target organizations deploying LLM infrastructure across teams.llmgateway.io · 7 Oct 2026

Best LLM Gateway alternatives

See all 20
Kong Gateway01 Free7.4TensorZero02 Free7.4Eden AI03 7.3Envoy AI Gateway04 Free7.3Helicone05 $79/mo7.3LangSmith06 $39/mo7.3

Where it ranks on Inferse

Sources