H

API Gateway Software

Higress: Open-Source AI API Gateway

higress.io · checked 15 Oct 2026

Open-source AI-native API gateway for models, agents, MCP servers, and cloud-native traffic.

How it plugs in

—Public API
YesOpen source
YesFree tier

Signal on API Gateway Software7.7#1 of 29

Higress is an open-source API gateway built on Istio and Envoy. It routes and governs model APIs, AI agents, MCP servers, microservices, and other cloud-native traffic. It runs self-hosted or through web and desktop-supported platforms, with Kubernetes resources, service discovery integrations, security controls, caching, and extensible Wasm plugins.

Higress home page

Review

In a line

Higress is an open-source AI-native API gateway. It manages traffic for large language model APIs, AI agents, MCP servers, and cloud-native services.

What it does

The gateway exposes services, controls traffic, and manages API lifecycles. Its AI gateway routes model requests, converts protocols, balances loads, and can fall back to another model.

It can proxy native MCP servers or turn HTTP services into MCP services. Token quotas, rate limits, key-pool rotation, and consumer authentication help control access.

Inference caching can reuse exact or semantically similar results to lower token use and response delay. Listed protections include prompt-attack detection, sensitive-content checks, privacy controls, and output filtering.

How it connects

Higress supports HTTP, HTTP/2, HTTPS, gRPC, gRPCS, TCP, and Dubbo. Kubernetes users can use Ingress and Gateway API resources, with compatibility for many NGINX Ingress annotations. See Kubernetes ingress controllers for related options.

Service discovery integrations include Nacos, ZooKeeper, Consul, and Eureka, plus Dubbo, Nacos, and Sentinel integrations. Authentication options include key, HMAC, JWT, Basic, OAuth2, OIDC, external authentication, and OPA.

The project is Apache 2.0 licensed, although bundled components may have other licenses. Its public repository includes API definitions, Kubernetes resources, Gateway API resources, and a Go SDK for Wasm plugins. Plugins can be written in Go, Rust, JavaScript, and other languages, with sandbox isolation and separate upgrades.

The model directory uses one OpenAI-compatible protocol to manage, route, and protect more than 100 mainstream model services.

Good fit

Higress suits teams that want a self-hosted gateway for AI and ordinary APIs, especially when Kubernetes, MCP tools, or several model providers are involved.

It also fits organizations needing service discovery, API security, protocol conversion, token accounting, or custom gateway extensions. Local Docker deployment is available without signup, and Kubernetes installation uses Helm, including local Kind clusters.

Watch for

The community editions leave stability, performance, monitoring, alerting, and multi-zone operation to the organization running them, and they do not include an SLA. Commercial editions add support and service commitments.

Failover is off by default. Retry behavior is limited, and retries apply only to non-streaming requests. Check these defaults against your reliability needs.

Higress is a hybrid deployment product with many controls and integrations. Teams should confirm their required protocols, registries, plugins, and operational skills before adopting it.

Pricing

Higress Community and Higress Community Edition are free, open-source, self-hosted options with community support and documentation. There is no free trial because the community plans are already free.

Alibaba Cloud AI Gateway Serverless Standard, Alibaba Cloud AI Gateway Serverless Enterprise, and Feitian Exclusive Edition have price on request. Their descriptions mention usage-based or negotiated billing, managed resources, support, SLAs, or enterprise features.

Verdict

Choose Higress if you need one open-source gateway for model traffic, MCP services, Kubernetes workloads, and conventional APIs, and you can run the infrastructure yourself.

Look elsewhere if you require built-in enterprise operations, guaranteed availability in the free edition, or simple defaults for failover and retries. Commercial Higress plans may address some of those needs, but their prices are not published.

Our take

Higress is a sensible option for teams consolidating AI and standard API traffic behind a self-managed gateway. Its broad model access, MCP conversion, Kubernetes support, authentication choices, caching, and plugin system cover many gateway jobs in one project. The trade-off is operational responsibility: community users handle reliability and observability, while failover and retries need review. Buyers wanting a managed service can ask about the Alibaba Cloud or Feitian plans, but should budget around undisclosed pricing and verify the support and SLA terms they need.

  • Open-source Apache 2.0 project with self-hosted community editions
  • Routes and governs more than 100 mainstream language models
  • Supports MCP proxying and HTTP-to-MCP conversion
  • Kubernetes Ingress and Gateway API support
  • Wasm plugins with sandbox isolation and independent upgrades
  • Community editions have no SLA
  • Users handle stability, monitoring, alerting, and multi-zone operations
  • Failover is disabled by default
  • Retries cover only non-streaming requests
  • Commercial plan prices are not published
  • Pick it ifTeams running AI and API traffic on Kubernetes; Organizations needing self-hosted MCP and model governance; Operators that can manage gateway reliability
  • Skip it ifYou need a managed gateway with published pricing and built-in operations; You require automatic failover and broad retry behavior by default; Your team cannot maintain self-hosted infrastructure

Pricing

The Community and Community Edition plans are free and self-hosted. Three commercial plans list price on request; some use usage-based or negotiated billing and may include managed resources, support, or SLAs.

  • Alibaba Cloud AI Gateway Serverless StandardStarts at ¥0; usage-based billing · Fully managed · automatic request-based scaling · LLM, Agent and MCP supportFree
  • Higress CommunityFree & Open Source, Community Support · Self-hosted · self-managed stability and performance · community supportFree
  • Higress Community Editionself-hosted · community support and documentation · user handles stability and performanceFree
  • Alibaba Cloud AI Gateway Serverless EnterpriseUsage-based commercial service; price not shown · 99.95% SLA · dedicated endpoints · custom domains · transport encryptionOn request
  • Feitian Exclusive EditionNegotiated on demand · Elastic resources · negotiated SLA · commercial support · enterprise integrationsOn request

As higress.ai lists them, checked 15 Oct 2026.

Questions

Is Higress free?

Its Community and Community Edition plans are free, open-source, and self-hosted. Commercial Alibaba Cloud and Feitian plans have price on request.

Does Higress support Kubernetes?

Yes. It supports Kubernetes Ingress and Gateway API resources, Helm installation, and local Kind clusters.

Can Higress manage AI models and MCP servers?

Yes. It routes and governs model APIs, supports more than 100 mainstream models, proxies native MCP servers, and converts HTTP services to MCP.

What authentication methods does Higress support?

Listed methods include key, HMAC, JWT, Basic, OAuth2, OIDC, external authentication, and OPA.

Does Higress have rate limiting and caching?

Yes. It offers token quotas, rate limiting, and exact or semantic inference caching.

Does the free edition include an SLA?

No. The community editions provide community support and documentation, while the operator handles stability and performance.

Can I extend Higress with plugins?

Yes. Wasm plugins can be written in Go, Rust, JavaScript, and other languages, with sandbox isolation and independent upgrades.