OpenLIT

Input—per 1M tokens

Output—per 1M tokens

Context—tokens

WeightsClosed

About

OpenLIT is ranked #15 of 32 in AI agent observability tools on Inferse. It runs on API, Linux, macOS, Self-hosted, Web, Windows. There is a free plan.

Compared on AI agent observability tools

Free plan: Yesopenlit.io
Deployment options: self_hostedopenlit.io
Cost tracking: Yesopenlit.io

Facts

What it does: OpenLIT is an open-source Agent Harness Engineering platform for LLM tracing, evaluations, prompt management, and cost tracking, built on OpenTelemetry.openlit.io · 29 Sept 2026
Tracing: LLM tracing can capture calls, tools, and retrievals, with filters for user, session, cost, latency, and metadata.openlit.io · 29 Sept 2026
Evaluations: Evaluations support LLM-as-a-judge, heuristics, or human review on production traffic or experiments.openlit.io · 29 Sept 2026
Prompt Hub: Prompt Hub supports prompt versioning, dynamic variables, API retrieval, unlimited prompt fetching, and AI-assisted improvement.openlit.io · 29 Sept 2026
Model comparison: OpenGround compares models side by side for latency, tokens, and cost, and supports bring-your-own-key model comparison.openlit.io · 29 Sept 2026
Coding agent monitoring: Coding agent observability tracks sessions, cost, tokens, repository activity, and code impact.openlit.io · 29 Sept 2026
Integrations: The site lists 56+ integrations across LLMs, agent frameworks, vector databases, and GPUs, including OpenAI, Anthropic, LangChain, Pinecone, and NVIDIA NIM.openlit.io · 29 Sept 2026
Deployment: The platform can be self-hosted using Docker Compose or Kubernetes Helm and accepts OpenTelemetry data through OTLP.openlit.io · 29 Sept 2026
License and data: OpenLIT is Apache 2.0 licensed, and its site says self-hosting keeps prompts, traces, and secrets in the user's environment.openlit.io · 29 Sept 2026
Secret storage: Vault provides encrypted storage for LLM API keys using AES-256-GCM, with key and tag based retrieval and API authentication.openlit.io · 29 Sept 2026
Security sign-in: The OSS plan lists sign-in with Google, Azure AD, and GitHub.openlit.io · 29 Sept 2026
Support: The OSS plan includes community support on GitHub.openlit.io · 29 Sept 2026
Notable limits: Fleet Hub lists single-cluster collector monitoring, while the self-hosted plan lists unlimited usage, historical data, users, projects, and environments.openlit.io · 29 Sept 2026
Company background: OpenLIT says the project is community-driven, built in public on GitHub, and used by developers worldwide.openlit.io · 29 Sept 2026