agentgateway

Input—per 1M tokens

Output—per 1M tokens

Context—tokens

WeightsClosed

About

agentgateway is ranked #4 of 27 in Kubernetes ingress controllers on Inferse. It runs on API, Linux, Self-hosted. There is a free plan.

Compared on Kubernetes ingress controllers

Free plan: Yesagentgateway.dev
Ingress API model: bothagentgateway.dev
TLS automation: Yesagentgateway.dev
Canary routing: Yesagentgateway.dev
Rate limiting: Yesagentgateway.dev
Auth policies: Yesagentgateway.dev
Deployment model: self-hostedagentgateway.dev

Facts

Purpose: Agentgateway is an open-source HTTP and gRPC gateway for routing, securing, observing, and governing service, LLM, MCP, and agent-to-agent traffic.agentgateway.dev · 2 Oct 2026
LLM routing: Its LLM gateway provides an OpenAI-compatible API for providers including OpenAI, Anthropic, Bedrock, Gemini, Vertex, and OSS Llama runs.agentgateway.dev · 2 Oct 2026
Inference: Self-hosted inference routing supports vLLM, TGI, and Triton, with latency-aware, cost-aware, and model-aware routing.agentgateway.dev · 2 Oct 2026
MCP and A2A: The gateway supports MCP server discovery, scoped tool calls and audit trails, and A2A routing between LangChain, CrewAI, ADK, and other runtimes.agentgateway.dev · 2 Oct 2026
Security: Listed security features include JWT and OIDC, API keys, authorization policies, TLS and mTLS with certificate rotation, and rate limiting.agentgateway.dev · 2 Oct 2026
Guardrails: MCP guardrails inspect calls and responses for prompt injection and unsafe payloads, while prompt guards support checks and redaction.agentgateway.dev · 2 Oct 2026
Observability: The site describes OpenTelemetry by default, Prometheus token-usage histograms, Jaeger traces, and request logs with latency, token counts, and realized USD cost.agentgateway.dev · 2 Oct 2026
Cost controls: Features include scoped virtual keys, per-key or per-team token and dollar spend caps, and a dashboard grouped by model, provider, and user.agentgateway.dev · 2 Oct 2026
Integrations: The site lists model integrations including OpenAI, Anthropic, Gemini, Bedrock, Azure OpenAI, Mistral, DeepSeek, Ollama, Vertex AI, xAI, and Snowflake.agentgateway.dev · 2 Oct 2026
Deployment: The maker describes deployment options as a standalone binary, Docker, or Kubernetes.agentgateway.dev · 2 Oct 2026
Intended users: The site invites tool-builders, platform engineers, and AI enthusiasts to join the community and describes the controls as suited to platform teams.agentgateway.dev · 2 Oct 2026
Support: The enterprise page lists partner-provided commercial support, including a Solo.io offer with 24×7 coverage, upstream collaboration, and best-practice guidance.agentgateway.dev · 2 Oct 2026
Project stewardship: The enterprise page says agentgateway was originally created by Solo.io and is an AAIF project.agentgateway.dev · 2 Oct 2026