Routerly

Input—per 1M tokens

Output—per 1M tokens

Context—tokens

WeightsClosed

About

Routerly is ranked #17 of 29 in llm gateways on Inferse. It runs on API, Linux, macOS, Self-hosted, Web, Windows. There is a free plan.

Compared on llm gateways

Free plan: Yesrouterly.ai
Fallback routing: Yesrouterly.ai
Usage analytics: Yesrouterly.ai
Self-hosted deployment: Yesrouterly.ai
Budget controls: Yesrouterly.ai
Virtual API keys: Yesrouterly.ai

Facts

Product: Routerly is a self-hosted gateway between applications and AI providers that routes requests, tracks costs, and enforces budgets.routerly.ai · 30 Sept 2026
Routing: Its routing engine uses up to nine configurable policies, including LLM selection, cost, health, performance, capability, context, budget, rate limits, and fairness.blog.routerly.ai · 30 Sept 2026
API compatibility: It supports OpenAI and Anthropic wire formats with streaming, so clients can use Routerly by changing the base URL.routerly.ai · 30 Sept 2026
Providers: Supported providers include OpenAI, Anthropic, Google Gemini, Ollama, Mistral, Cohere, xAI, and custom HTTP endpoints.routerly.ai · 30 Sept 2026
Integrations: The site names Cursor, Open WebUI, OpenClaw, LangChain, and LlamaIndex as clients or frameworks that can connect to Routerly.routerly.ai · 30 Sept 2026
Cost tracking: Routerly tracks per-token costs and supports built-in pricing presets and custom model pricing.routerly.ai · 30 Sept 2026
Budget controls: Budgets can be set globally, per project, or per token, and can track cost, calls, or token usage over rolling or calendar windows.doc.routerly.ai · 30 Sept 2026
Project isolation: Each project can have separate Bearer tokens, model pools, routing configuration, and budget limits.routerly.ai · 30 Sept 2026
Security: The documentation says provider API keys and project tokens are AES-256 encrypted at rest, and user passwords are bcrypt-hashed.doc.routerly.ai · 30 Sept 2026
Data handling: Routerly is self-hosted, and its maker says prompts and API keys stay on the user's infrastructure.blog.routerly.ai · 30 Sept 2026
Storage and dependencies: Routerly stores configuration and usage records in JSON files and does not require an external database.doc.routerly.ai · 30 Sept 2026
Deployment: The maker provides Docker and installer-based deployment, and says the installer supports Windows, macOS, and Linux.routerly.ai · 30 Sept 2026
License and pricing: Routerly is free to self-host under the AGPL-3.0 license, and the site says it adds no markup to API calls.routerly.ai · 30 Sept 2026
Intended users: The site describes Routerly as built for developers and use cases ranging from indie projects to enterprise deployments, including SaaS teams and local-first development.routerly.ai · 30 Sept 2026