UpTrain

UpTrain alternatives

The platforms standing nearest to UpTrain on AI LLM Evaluation Tools.

Nearest on its board

  1. 28
    OE
    OpenAI Evalsevals.openai.com

    Evals is a framework for evaluating large language models and LLM systems, with an open-source benchmark registry.

    5.2 APIOpenFree —
  2. 30
    L
    Lightevalgithub.com
    3.8 APIOpenFree —
  3. 27
    IA
    Inspect AIinspect.aisi.org.uk

    Inspect is an open-source framework for evaluating large language models across coding, agentic tasks, reasoning, knowledge, behavior, and multimodal…

    5.6 APIOpenFree Free tier
  4. 26
    R
    RAGCheckergithub.com

    RAGChecker is an automatic evaluation framework for assessing and diagnosing retrieval-augmented generation systems.

    5.7 APIOpenFree Free tier
  5. 25
    LE
    LM Evaluation Harnessgithub.com

    LM Evaluation Harness is a unified framework for evaluating generative language models across evaluation tasks.

    5.8 APIOpenFree Free tier
  6. 24
    PE
    Pydantic Evalspydantic.dev

    Pydantic Evals tests and evaluates AI systems, from simple LLM calls to complex multi-agent applications.

    5.8 APIOpenFree Free tier
  7. 23
    H
    HoneyHivehoneyhive.ai

    HoneyHive is an agent observability platform for observing, evaluating, and improving AI agents in production.

    5.9 APIOpenFree Free tier
  8. 22
    CA
    Confident AIconfident-ai.com

    Confident AI is an AI Quality platform that provides development evaluations and production observability for reliable AI applications.

    5.9 APIOpenFree Free tier · from $200/mo
  9. 21
    AP
    Arize Phoenixarize.com

    Phoenix helps teams trace, evaluate, debug, and improve AI applications.

    5.9 APIOpenFree Free tier
  10. 20
    RA
    Rhesis AIrhesis.ai

    Rhesis is an open-source collaboration layer that brings domain-expert knowledge into AI agent development.

    6.0 APIOpenFree Free tier
  11. 19
    NN
    NVIDIA NeMo Evaluatordeveloper.nvidia.com

    NeMo Evaluator evaluates generative AI applications, including LLMs, RAG pipelines, and AI agents.

    6.0 APIOpenFree Free tier
  12. 18
    MA
    Maxim AIgetmaxim.ai

    Maxim is an end-to-end evaluation and observability platform for simulating, evaluating, and monitoring AI agents.

    6.0 APIOpenFree Free tier · from $29/mo
  13. 17
    G
    Galileogalileo.ai

    Galileo is an observability, evaluation, and guardrail platform for GenAI and agentic applications.

    6.0 APIOpenFree Free tier · from $100/mo
  14. 16
    A
    ARESgithub.com

    ARES is an automated framework for evaluating retrieval-augmented generation (RAG) systems.

    6.0 APIOpenFree Free tier
  15. 15
    R
    Ragasragas.io

    Ragas is a library for systematically evaluating AI and large language model applications.

    6.0 APIOpenFree Free tier
  16. 14
    O
    OpenCompassopencompass.org.cn

    OpenCompass is a platform and toolkit for evaluating large language models and large vision-language models.

    6.1 APIOpenFree Free tier
  17. 13
    H
    HELMcrfm.stanford.edu

    HELM is an open-source Python framework for holistic, reproducible, and transparent evaluation of foundation models, including language and multimodal models.

    6.3 APIOpenFree Free tier
  18. 12
    B
    Braintrustbraintrust.dev

    Braintrust is an observability and evaluation platform for instrumenting, understanding and improving AI agents in production.

    6.3 APIOpenFree Free tier · from $249/mo
  19. 11
    WB
    Weights & Biaseswandb.ai

    Weights & Biases is an AI developer platform for building, training, fine-tuning, evaluating and managing AI models and applications.

    6.7 APIOpenFree Free tier · from $60/mo
  20. 10
    L
    LangSmithlangchain.com

    LangSmith is LangChain's framework-agnostic platform for observing, evaluating and deploying AI agents.

    6.7 APIOpenFree Free tier · $39 usage-based