A

AI Agent Evaluation Tools

AgentClash

agentclash.dev · checked 1 Oct 2026

How it plugs in

—Public API
NoOpen source
YesFree tier

Signal on AI Agent Evaluation Tools5.8#19 of 28

AgentClash is an open-source AI-agent evaluation platform that runs agents on real tasks, scores outcomes, replays steps, and turns failures into regression tests.

AgentClash home page

Pricing

  • Free1 workspace · 25 eval runs / month · up to 4 models per run · 7-day replay retention · BYO LLM API key · BYO E2B sandbox token · community supportFree
  • ProBilled monthly; annual billing $39 / month ($468 / yr) · 500 eval runs / workspace / month · up to 8 models per run · 30-day replay retention · hosted sandbox with included credit · private challenge packs · CI integration · 3 concurrent eval runs · email support < 1 business day$49/mo
  • TeamBilled monthly; annual billing $80 / month ($960 / yr) · 2,000 eval runs / workspace / month · up to 12 models per run · 90-day replay retention · 10 concurrent eval runs · multiple workspaces · workspace-level audit log · Slack notifications · priority email support < 4 business hours$100/mo
  • EnterpriseCustom · SSO / SAML · org-wide audit logs · unlimited replay retention · 99.9% uptime SLA · dedicated support channel · custom MSA / billing termsOn request

As agentclash.dev lists them, checked 1 Oct 2026.