LiteLLM
APIyesOSS—FREEyesDOCS4/5
LI7.3#5 of 32
outWeb—Windows—Mac—Linux—Android—iOS
Ranked in LLM gateways ·Free plan
About
LiteLLM is ranked #5 of 32 in LLM gateways on Inferse. It runs on API, Self-hosted, Web. There is a free plan. A free trial is offered.
Compared on LLM gateways
- Free plan
- Yeslitellm.ai
- Fallback routing
- Yeslitellm.ai
- Usage analytics
- Yeslitellm.ai
- Self-hosted deployment
- Yeslitellm.ai
- Budget controls
- Yeslitellm.ai
- Virtual API keys
- Yeslitellm.ai
Facts
- Product
- LiteLLM is an open-source AI gateway and LLM proxy for platform teams.litellm.ai · 2 Oct 2026
- Unified access
- The gateway provides one OpenAI-compatible API to 140+ providers and 1,800+ models.litellm.ai · 2 Oct 2026
- Routing
- LiteLLM supports load balancing, lowest-cost routing, and automatic routing of simple prompts to cheaper models.litellm.ai · 2 Oct 2026
- Spend controls
- It tracks usage and spend by key, user, team, organization, tool, agent, and MCP, and supports hard budgets and rate limits.litellm.ai · 2 Oct 2026
- Caching
- Response and semantic caching can use Redis, S3, or GCS.litellm.ai · 2 Oct 2026
- Deployment
- The gateway can be self-hosted, including in air-gapped environments, and supports deployment with an official Helm chart or Terraform module.litellm.ai · 2 Oct 2026
- Integrations
- The integrations documentation lists observability tools including Langfuse, Datadog, Grafana Cloud, OpenTelemetry, LangSmith, Arize/Phoenix, and Helicone.docs.litellm.ai · 2 Oct 2026
- Security
- The product page describes signed hardened non-root images, vulnerability scanning, SSO/JWT/RBAC controls, and secrets-manager integrations.litellm.ai · 2 Oct 2026
- Data handling
- LiteLLM says its self-hosted deployment has no telemetry and keeps data within the user's infrastructure.litellm.ai · 2 Oct 2026
- Enterprise access
- The Enterprise plan includes SSO and SCIM, OIDC/JWT authentication, audit logs, secret managers, key rotation, and organization and team administrators.litellm.ai · 2 Oct 2026
- Support
- Enterprise includes dedicated support and onboarding, with 24/7 support and SLAs listed on the pricing page.litellm.ai · 2 Oct 2026
- Trial
- The pricing FAQ offers an instant 30-day Enterprise trial key without a credit card.litellm.ai · 2 Oct 2026
- Intended users
- The Enterprise plan is described for teams running LiteLLM in production, including high-volume and regulated deployments.litellm.ai · 2 Oct 2026
Best LiteLLM alternatives
See all 12
Where it ranks on Inferse
- Best LLM Gateways in 2026#5 of 32
Sources
- litellm.ai· checked 2 Oct 2026
- docs.litellm.ai/docs/integrations/· checked 2 Oct 2026
- litellm.ai/pricing· checked 2 Oct 2026