OpenCompass alternatives
The platforms standing nearest to OpenCompass on LLM Evaluation Tools.
Nearest on its board
- 14 MA
Maxim AIgetmaxim.aiMaxim is an end-to-end evaluation and observability platform for simulating, evaluating, and monitoring AI agents.
- 16 PPyRITmicrosoft.github.io
PyRIT is an open-source framework for security professionals and engineers to identify risks in generative AI systems.
- 13 G
Galileogalileo.aiGalileo is an observability, evaluation, and guardrail platform for GenAI and agentic applications.
- 17 CA
Confident AIconfident-ai.comConfident AI is an AI Quality platform that provides development evaluations and production observability for reliable AI applications.
- 12 AARESgithub.com
ARES is an automated framework for evaluating retrieval-augmented generation (RAG) systems.
- 18 EEvalPlusgithub.com
EvalPlus is a framework for rigorously evaluating large language models on code related tasks.
- 11 AAgentBenchgithub.com
AgentBench is a benchmark for evaluating the reasoning and decision-making abilities of LLMs acting as agents.
- 19 HHarmBenchgithub.com
HarmBench is an open-source framework for evaluating automated red teaming methods and LLM attacks and defenses.
- 10 R
Ragasragas.ioRagas is a library for systematically evaluating AI and large language model applications.
- 20 LELM Evaluation Harnessgithub.com
LM Evaluation Harness is a unified framework for evaluating generative language models across evaluation tasks.
- 9 Ggarakgarak.ai
garak is an LLM vulnerability scanner that probes language models and systems using them for security weaknesses.
- 21 PAParea AIparea.ai
Parea describes itself as a platform for experiment tracking, observability, and human annotation to help teams ship LLM applications to production.
- 8 SBSWE-benchswebench.com
SWE-bench evaluates language models on real-world GitHub software issues by asking them to generate patches that resolve the issues.
- 22 RRAGCheckergithub.com
RAGChecker is an automatic evaluation framework for assessing and diagnosing retrieval-augmented generation systems.
- 7 H
HELMcrfm.stanford.eduHELM is an open-source Python framework for holistic, reproducible, and transparent evaluation of foundation models, including language and multimodal models.
- 23 IA
Inspect AIinspect.aisi.org.ukInspect is an open-source framework for evaluating large language models across coding, agentic tasks, reasoning, knowledge, behavior, and multimodal…
- 6 B
Braintrustbraintrust.devBraintrust is an observability and evaluation platform for instrumenting, understanding and improving AI agents in production.
- 24 LLiveBenchlivebench.ai
LiveBench is an LLM benchmark designed to limit test set contamination and use objective evaluation.
- 5 TTruLenstrulens.org
TruLens evaluates and traces LLM applications and AI agents, helping teams find quality failures and cost issues.
- 25 WWebArenawebarena.dev
WebArena is a standalone, self-hostable web environment and benchmark for building autonomous agents.