Inferse
For vendors
AdvertiseTop spots, featured rows, home sponsor Get listedAdd a product we don't cover yet Claim a listingFree: verify the domain, then correct your page Vendor dashboardNumbers, orders and placements
List your platform
Vendor dashboard

Routerly

APIyesFREEyesDOCS4/5
RO7.2#23of 33
outWeboutWindowsoutMacoutLinux

Ranked in LLM gateways·Free plan

Visit site Alternatives

About

Routerly is a self-hosted gateway that directs application requests to AI providers and gives teams controls for routing, cost tracking, and budgets. Its routing engine offers up to nine configurable policies, covering model selection, cost, provider health, performance, capabilities, context, budget, rate limits, and fairness. OpenAI and Anthropic wire formats are supported, including streaming, so compatible clients can connect by changing the base URL. Providers include OpenAI, Anthropic, Google Gemini, Ollama, Mistral, Cohere, xAI, and custom HTTP endpoints. Routerly tracks per-token costs using built-in pricing presets or custom model pricing. Budgets can measure cost, calls, or tokens globally, per project, or per token across rolling or calendar windows. Projects can have separate Bearer tokens, model pools, routing settings, and limits. Configuration and usage records are stored in JSON files without an external database. Docker and installer deployment are available. Routerly is free to self-host under AGPL-3.0, with no markup on API calls.

Who it is for

Routerly suits developers and SaaS teams that want to route AI-provider requests from their own infrastructure. Its project isolation and configurable budgets can also fit local-first development and larger deployments.

What is good

  • Supports OpenAI and Anthropic formats with streaming.
  • Routes across named providers and custom HTTP endpoints.
  • Offers per-token cost tracking and configurable budgets.
  • Stores configuration and usage records in JSON files.
  • Free self-hosted under AGPL-3.0 with no call markup.

What to know first

  • Self-hosted deployment is required.
  • Provider keys and project tokens require local management.

Verdict

Routerly combines provider routing, project separation, cost visibility, and budget controls in a self-hosted gateway. Its free AGPL-3.0 license and lack of call markup are relevant for teams evaluating the operational tradeoff of running it themselves.

Compared on LLM gateways

Free plan
Yesrouterly.ai
Fallback routing
Yesrouterly.ai
Usage analytics
Yesrouterly.ai
Self-hosted deployment
Yesrouterly.ai
Budget controls
Yesrouterly.ai
Virtual API keys
Yesrouterly.ai

Facts

Product
Routerly is a self-hosted gateway between applications and AI providers that routes requests, tracks costs, and enforces budgets.routerly.ai · 30 Sept 2026
Routing
Its routing engine uses up to nine configurable policies, including LLM selection, cost, health, performance, capability, context, budget, rate limits, and fairness.blog.routerly.ai · 30 Sept 2026
API compatibility
It supports OpenAI and Anthropic wire formats with streaming, so clients can use Routerly by changing the base URL.routerly.ai · 30 Sept 2026
Providers
Supported providers include OpenAI, Anthropic, Google Gemini, Ollama, Mistral, Cohere, xAI, and custom HTTP endpoints.routerly.ai · 30 Sept 2026
Integrations
The site names Cursor, Open WebUI, OpenClaw, LangChain, and LlamaIndex as clients or frameworks that can connect to Routerly.routerly.ai · 30 Sept 2026
Cost tracking
Routerly tracks per-token costs and supports built-in pricing presets and custom model pricing.routerly.ai · 30 Sept 2026
Project isolation
Each project can have separate Bearer tokens, model pools, routing configuration, and budget limits.routerly.ai · 30 Sept 2026
Security
The documentation says provider API keys and project tokens are AES-256 encrypted at rest, and user passwords are bcrypt-hashed.doc.routerly.ai · 30 Sept 2026
Data handling
Routerly is self-hosted, and its maker says prompts and API keys stay on the user's infrastructure.blog.routerly.ai · 30 Sept 2026
Storage and dependencies
Routerly stores configuration and usage records in JSON files and does not require an external database.doc.routerly.ai · 30 Sept 2026
Deployment
The maker provides Docker and installer-based deployment, and says the installer supports Windows, macOS, and Linux.routerly.ai · 30 Sept 2026
License and pricing
Routerly is free to self-host under the AGPL-3.0 license, and the site says it adds no markup to API calls.routerly.ai · 30 Sept 2026
Intended users
The site describes Routerly as built for developers and use cases ranging from indie projects to enterprise deployments, including SaaS teams and local-first development.routerly.ai · 30 Sept 2026

Best Routerly alternatives

See all 20
Kong Gateway01 Free7.4TensorZero02 Free7.4Eden AI03 7.3Envoy AI Gateway04 Free7.3Helicone05 $79/mo7.3LangSmith06 $39/mo7.3

Where it ranks on Inferse

Sources