UpTrain alternatives
The platforms standing nearest to UpTrain on AI LLM Evaluation Tools.
Nearest on its board
- 28 OEOpenAI Evalsevals.openai.com
Evals is a framework for evaluating large language models and LLM systems, with an open-source benchmark registry.
- 30 LLightevalgithub.com
- 27 IA
Inspect AIinspect.aisi.org.ukInspect is an open-source framework for evaluating large language models across coding, agentic tasks, reasoning, knowledge, behavior, and multimodal…
- 26 RRAGCheckergithub.com
RAGChecker is an automatic evaluation framework for assessing and diagnosing retrieval-augmented generation systems.
- 25 LELM Evaluation Harnessgithub.com
LM Evaluation Harness is a unified framework for evaluating generative language models across evaluation tasks.
- 24 PEPydantic Evalspydantic.dev
Pydantic Evals tests and evaluates AI systems, from simple LLM calls to complex multi-agent applications.
- 23 H
HoneyHivehoneyhive.aiHoneyHive is an agent observability platform for observing, evaluating, and improving AI agents in production.
- 22 CA
Confident AIconfident-ai.comConfident AI is an AI Quality platform that provides development evaluations and production observability for reliable AI applications.
- 21 APArize Phoenixarize.com
Phoenix helps teams trace, evaluate, debug, and improve AI applications.
- 20 RARhesis AIrhesis.ai
Rhesis is an open-source collaboration layer that brings domain-expert knowledge into AI agent development.
- 19 NNNVIDIA NeMo Evaluatordeveloper.nvidia.com
NeMo Evaluator evaluates generative AI applications, including LLMs, RAG pipelines, and AI agents.
- 18 MA
Maxim AIgetmaxim.aiMaxim is an end-to-end evaluation and observability platform for simulating, evaluating, and monitoring AI agents.
- 17 G
Galileogalileo.aiGalileo is an observability, evaluation, and guardrail platform for GenAI and agentic applications.
- 16 AARESgithub.com
ARES is an automated framework for evaluating retrieval-augmented generation (RAG) systems.
- 15 R
Ragasragas.ioRagas is a library for systematically evaluating AI and large language model applications.
- 14 OOpenCompassopencompass.org.cn
OpenCompass is a platform and toolkit for evaluating large language models and large vision-language models.
- 13 H
HELMcrfm.stanford.eduHELM is an open-source Python framework for holistic, reproducible, and transparent evaluation of foundation models, including language and multimodal models.
- 12 B
Braintrustbraintrust.devBraintrust is an observability and evaluation platform for instrumenting, understanding and improving AI agents in production.
- 11 WB
Weights & Biaseswandb.aiWeights & Biases is an AI developer platform for building, training, fine-tuning, evaluating and managing AI models and applications.
- 10 L
LangSmithlangchain.comLangSmith is LangChain's framework-agnostic platform for observing, evaluating and deploying AI agents.