Portkey

Input—per 1M tokens

Output—per 1M tokens

Context—tokens

WeightsClosed

About

Portkey is ranked #4 of 23 in AI LLM observability tools on Inferse. It runs on API, Self-hosted, Web. There is a free plan. Paid plans start at $49/mo.

Compared on AI LLM observability tools

Free plan: Yesportkey.ai
Paid from: $49/moportkey.ai
LLM trace capture: Yesportkey.ai
Token cost tracking: Yesportkey.ai
Output evaluations: Yesportkey.ai
Latency metrics: Yesportkey.ai
Failure tracking: Yesportkey.ai
Free-plan retention: 3 daysportkey.ai

Facts

Product: Portkey describes itself as a production platform for managing, observing, and governing GenAI across teams.portkey.ai · 29 Sept 2026
Gateway: Its AI gateway provides a unified API to access models and providers across modalities.portkey.ai · 29 Sept 2026
Routing: The gateway supports configurable routing, failovers, retries, and load balancing across models.portkey.ai · 29 Sept 2026
Observability: Portkey offers logs, traces, feedback, metadata, filters, and alerts for AI activity.portkey.ai · 29 Sept 2026
Prompt management: Prompt management includes templates, a playground, API endpoints, versioning, and variables.portkey.ai · 29 Sept 2026
Integrations: The integrations catalog lists providers and platforms including OpenAI, Anthropic, Google Gemini, Azure, Amazon Bedrock, and Ollama.portkey.ai · 29 Sept 2026
Agent ecosystem: Documented integrations include agent frameworks such as CrewAI, LangChain, LangGraph, and the OpenAI Agents SDK.portkey.ai · 29 Sept 2026
Caching: Portkey says its gateway offers simple and semantic caching to reduce latency and save costs on repeat requests.portkey.ai · 29 Sept 2026
Guardrails: The Production plan includes LLM and partner guardrails, while Enterprise lists custom guardrail hooks and advanced evaluation templates.portkey.ai · 29 Sept 2026
Security: Security features include virtual provider keys, access controls, inbound IP and geographic rules, and sensitive-data redaction.portkey.ai · 29 Sept 2026
Compliance: The Enterprise plan lists SOC 2 Type 2, GDPR, and HIPAA under advanced compliance, along with custom BAAs and data isolation.portkey.ai · 29 Sept 2026
Deployment: Portkey lists self-hosted and local deployment options, and Enterprise offers private cloud deployment and VPC hosting.portkey.ai · 29 Sept 2026
Support: The Free plan lists community support, Production lists production support, and Enterprise lists dedicated onboarding and priority support.portkey.ai · 29 Sept 2026
Company: Portkey’s company information page lists San Francisco, California as its headquarters and March 2023 as its launch date.portkey.ai · 29 Sept 2026