AI Tools·Standings
AI Agent Observability Tools
AI agent observability tools help you review agent activity, including traces, sessions, prompts, tool calls and costs. This board compares free plans, paid starting prices, trace retention, session replay, deployment choices and agent framework support.
Use the signal score out of 10 as a quick comparison. The API, open-source and free-tier marks show whether each tool lists a public API, open-source code or a free plan.
- 31 platforms
- 2 with a public API on this page
- 24 with a free tier
- Checked 23 Sept 2026
- 1 WB
W&B Weavesite.wandb.aiProduction AI agent monitoring that groups activity by sessions and turns, with steps, tools and sub-agents.
- 2 OOpenLITopenlit.io
Open-source platform for LLM tracing, evaluations, prompt management, and cost tracking.
- 3 O
Opikcomet.comTool that records agent actions, adds trace notes, and runs evaluation workflows.
- 4 L
LangWatchlangwatch.aiAI agent platform tracing steps, costs, errors, evaluations, and conversation outcomes.
- 5 L
Langfuselangfuse.comOpen-source platform for tracing, analyzing, and improving AI agent applications.
- 6 MTMLflow Tracingmlflow.org
Free tracing tool capturing inputs, outputs, metadata, latency, costs, and exceptions.
- 7 LLunarylunary.ai
LLM monitoring platform tracking calls, agents, errors, usage, costs and user satisfaction.
- 8 A
Agentaagenta.aiOpen-source workspace for AI coworkers with Slack and Telegram support.
- 9 TTracelooptraceloop.com
LLM monitoring platform that traces prompts and responses, with quality checks and a free plan.
- 10 A
AgentOpsagentops.aiAgent observability platform that tracks calls and tools, replays runs and keeps an audit trail.
- 11 L
LangSmithlangchain.comAgent platform for building, evaluating, deploying, monitoring, and improving AI agents.
- 12 PPetalTracedocs.petallabs.io
PetalTrace captures AI workflow execution data, including LLM prompts and completions, tool calls, token use, costs, and timelines.
- 13 B
Braintrustbraintrust.devAI observability platform for tracing agents, evaluating outputs, and comparing models.
- 14 S
SigNozsignoz.ioOpen-source OpenTelemetry tool combining application logs, metrics, traces, and alerts.
- 15 FA
Fiddler AIfiddler.aiFiddler describes its platform as providing unified observability and security for AI agents and predictive applications.
- 16 G
Galileogalileo.aiPlatform for evaluating, observing, and adding guardrails to GenAI and agent apps.
- 17 MA
Maxim AIgetmaxim.aiPlatform to monitor AI agents and experiment with prompts, models, tools, and context.
- 18 O
Observeobserveinc.comSoftware monitoring platform that brings logs, metrics and traces together; AI helps investigate incidents.
- 19 APArize Phoenixarize.com
Free AI application tool for tracing, evaluating, debugging and comparing application versions.
- 20 H
HoneyHivehoneyhive.aiAgent observability platform with step-by-step traces, evaluations, drift detection and alerts.
- 21 LLogicGazelogicgaze.com
AI observability platform for tracing calls, evaluating outputs, guardrails, and costs.
- 22 TTraceRoottraceroot.ai
Open-source agent layer detecting production failures and opening fixes from trace analysis.
- 23 VVoltOpsvoltagent.dev
AI agent console tracing calls and tools, with alerts and Airtable, Discord, Gmail and Slack actions.
- 24 H
Heliconehelicone.aiAI gateway that routes, debugs, and analyzes applications across 100+ models.
- 25 L
Laminarlaminar.shOpen-source platform tracing AI agents, replaying runs, and evaluating datasets.
Places #1, #2, #3, #4, #5 on this board are open to sponsors. Take #1 · Other ways to advertise
How to choose
Start with the pricing model
There are free plans on 28 of the 32 tools. Listed paid starting prices range from $0.00 for Fiddler AI to $249 per month for Braintrust; other examples include Agenta at $29 per month and Galileo at $100 per month annually.
Check whether a free trial matters to you: nine tools list one. Helicone lists a 7-day trial alongside its $79-per-month starting price.
Match the traces you need
The comparison covers trace retention, session replay, prompt and tool tracing, and cost tracking. Use those fields to decide how much of an agent run you need to review after it happens.
Check where it runs
The list includes 31 tools with an API, 30 with a web option and 26 with self-hosted deployment. Six list Linux support, while four list macOS and four list Windows.
If your team needs a local setup, focus on the self-hosted and operating-system marks before choosing a plan.
Review framework support
Agent framework support is one of the comparison fields. Check that field against the framework your agents use, along with prompt and tool tracing, before committing.
Decide how much control you want
Two of the 32 tools are open source. PetalTrace lists open source as its pricing note, while OpenLIT lists a free plan. An API is available across 31 tools, which can matter when connecting an existing app.
Questions
How many tools have a free plan?
Twenty-eight of the 32 tools list a free plan.
How many are open source?
Two of the 32 tools list open-source code.
Which deployment options are covered?
The board covers API, web and self-hosted options, plus Linux, macOS and Windows availability.
What observability features are compared?
It compares trace retention, session replay, prompt and tool tracing, deployment options, agent framework support and cost tracking.
Do any tools offer free trials?
Nine tools list a free trial. Helicone lists a 7-day trial.
Some top positions on this board can be paid placements, standing where they were sold. The facts on each platform are not for sale. How we rank · Disclosure