Lighteval alternatives
The platforms standing nearest to Lighteval on LLM Evaluation Tools.
Nearest on its board
- 28 KBkube-benchgithub.com
- 27 OEOpenAI Evalsgithub.com
- 26 D
DecodingTrustdecodingtrust.github.ioDecodingTrust is a research project for assessing trustworthiness in GPT models and helping researchers and practitioners understand their capabilities…
- 25 WWebArenawebarena.dev
WebArena is a standalone, self-hostable web environment and benchmark for building autonomous agents.
- 24 LLiveBenchlivebench.ai
LiveBench is an LLM benchmark designed to limit test set contamination and use objective evaluation.
- 23 IA
Inspect AIinspect.aisi.org.ukInspect is an open-source framework for evaluating large language models across coding, agentic tasks, reasoning, knowledge, behavior, and multimodal…
- 22 RRAGCheckergithub.com
RAGChecker is an automatic evaluation framework for assessing and diagnosing retrieval-augmented generation systems.
- 21 PAParea AIparea.ai
Parea describes itself as a platform for experiment tracking, observability, and human annotation to help teams ship LLM applications to production.
- 20 LELM Evaluation Harnessgithub.com
LM Evaluation Harness is a unified framework for evaluating generative language models across evaluation tasks.
- 19 HHarmBenchgithub.com
HarmBench is an open-source framework for evaluating automated red teaming methods and LLM attacks and defenses.
- 18 EEvalPlusgithub.com
EvalPlus is a framework for rigorously evaluating large language models on code related tasks.
- 17 CA
Confident AIconfident-ai.comConfident AI is an AI Quality platform that provides development evaluations and production observability for reliable AI applications.
- 16 PPyRITmicrosoft.github.io
PyRIT is an open-source framework for security professionals and engineers to identify risks in generative AI systems.
- 15 OOpenCompassgithub.com
OpenCompass is an LLM evaluation platform for assessing models across datasets covering knowledge, reasoning, coding, science, language, long context, and…
- 14 MA
Maxim AIgetmaxim.aiMaxim is an end-to-end evaluation and observability platform for simulating, evaluating, and monitoring AI agents.
- 13 G
Galileogalileo.aiGalileo is an observability, evaluation, and guardrail platform for GenAI and agentic applications.
- 12 AARESgithub.com
ARES is an automated framework for evaluating retrieval-augmented generation (RAG) systems.
- 11 AAgentBenchgithub.com
AgentBench is a benchmark for evaluating the reasoning and decision-making abilities of LLMs acting as agents.
- 10 R
Ragasragas.ioRagas is a library for systematically evaluating AI and large language model applications.
- 9 Ggarakgarak.ai
garak is an LLM vulnerability scanner that probes language models and systems using them for security weaknesses.