DeepEval alternatives
The platforms standing nearest to DeepEval on LLM Evaluation Tools.
Nearest on its board
- 2 P
Promptfoopromptfoo.devPromptfoo is a local-first open-source CLI and library for evaluating and red-teaming LLM applications.
- 3 G
Giskardgiskard.aiGiskard tests AI agents for security vulnerabilities, quality failures and compliance risks before and after deployment.
- 4 AF
Arena (formerly Chatbot Arena)arena.aiArena lets people compare anonymous AI-model responses, vote for the better answer, and contribute to public rankings.
- 5 TTruLenstrulens.org
TruLens evaluates and traces LLM applications and AI agents, helping teams find quality failures and cost issues.
- 6 B
Braintrustbraintrust.devBraintrust is an observability and evaluation platform for instrumenting, understanding and improving AI agents in production.
- 7 H
HELMcrfm.stanford.eduHELM is an open-source Python framework for holistic, reproducible, and transparent evaluation of foundation models, including language and multimodal models.
- 8 SBSWE-benchswebench.com
SWE-bench evaluates language models on real-world GitHub software issues by asking them to generate patches that resolve the issues.
- 9 Ggarakgarak.ai
garak is an LLM vulnerability scanner that probes language models and systems using them for security weaknesses.
- 10 R
Ragasragas.ioRagas is a library for systematically evaluating AI and large language model applications.
- 11 AAgentBenchgithub.com
AgentBench is a benchmark for evaluating the reasoning and decision-making abilities of LLMs acting as agents.
- 12 AARESgithub.com
ARES is an automated framework for evaluating retrieval-augmented generation (RAG) systems.
- 13 G
Galileogalileo.aiGalileo is an observability, evaluation, and guardrail platform for GenAI and agentic applications.
- 14 MA
Maxim AIgetmaxim.aiMaxim is an end-to-end evaluation and observability platform for simulating, evaluating, and monitoring AI agents.
- 15 OOpenCompassgithub.com
OpenCompass is an LLM evaluation platform for assessing models across datasets covering knowledge, reasoning, coding, science, language, long context, and…
- 16 PPyRITmicrosoft.github.io
PyRIT is an open-source framework for security professionals and engineers to identify risks in generative AI systems.
- 17 CA
Confident AIconfident-ai.comConfident AI is an AI Quality platform that provides development evaluations and production observability for reliable AI applications.
- 18 EEvalPlusgithub.com
EvalPlus is a framework for rigorously evaluating large language models on code related tasks.
- 19 HHarmBenchgithub.com
HarmBench is an open-source framework for evaluating automated red teaming methods and LLM attacks and defenses.
- 20 LELM Evaluation Harnessgithub.com
LM Evaluation Harness is a unified framework for evaluating generative language models across evaluation tasks.
- 21 PAParea AIparea.ai
Parea describes itself as a platform for experiment tracking, observability, and human annotation to help teams ship LLM applications to production.