DeepEval

DeepEval alternatives

The platforms standing nearest to DeepEval on LLM Evaluation Tools.

Nearest on its board

  1. 2
    P
    Promptfoopromptfoo.dev

    Promptfoo is a local-first open-source CLI and library for evaluating and red-teaming LLM applications.

    7.7 APIOpenFree Free tier
  2. 3
    G
    Giskardgiskard.ai

    Giskard tests AI agents for security vulnerabilities, quality failures and compliance risks before and after deployment.

    7.4 APIOpenFree Free tier
  3. 4
    AF
    Arena (formerly Chatbot Arena)arena.ai

    Arena lets people compare anonymous AI-model responses, vote for the better answer, and contribute to public rankings.

    7.3 APIOpenFree Free tier
  4. 5
    T
    TruLenstrulens.org

    TruLens evaluates and traces LLM applications and AI agents, helping teams find quality failures and cost issues.

    7.1 APIOpenFree Free tier
  5. 6
    B
    Braintrustbraintrust.dev

    Braintrust is an observability and evaluation platform for instrumenting, understanding and improving AI agents in production.

    6.3 APIOpenFree Free tier · from $249/mo
  6. 7
    H
    HELMcrfm.stanford.edu

    HELM is an open-source Python framework for holistic, reproducible, and transparent evaluation of foundation models, including language and multimodal models.

    6.3 APIOpenFree Free tier
  7. 8
    SB
    SWE-benchswebench.com

    SWE-bench evaluates language models on real-world GitHub software issues by asking them to generate patches that resolve the issues.

    6.3 APIOpenFree Free tier
  8. 9
    G
    garakgarak.ai

    garak is an LLM vulnerability scanner that probes language models and systems using them for security weaknesses.

    6.1 APIOpenFree Free tier
  9. 10
    R
    Ragasragas.io

    Ragas is a library for systematically evaluating AI and large language model applications.

    6.0 APIOpenFree Free tier
  10. 11
    A
    AgentBenchgithub.com

    AgentBench is a benchmark for evaluating the reasoning and decision-making abilities of LLMs acting as agents.

    6.0 APIOpenFree Free tier
  11. 12
    A
    ARESgithub.com

    ARES is an automated framework for evaluating retrieval-augmented generation (RAG) systems.

    6.0 APIOpenFree Free tier
  12. 13
    G
    Galileogalileo.ai

    Galileo is an observability, evaluation, and guardrail platform for GenAI and agentic applications.

    6.0 APIOpenFree Free tier · from $100/mo
  13. 14
    MA
    Maxim AIgetmaxim.ai

    Maxim is an end-to-end evaluation and observability platform for simulating, evaluating, and monitoring AI agents.

    6.0 APIOpenFree Free tier · from $29/mo
  14. 15
    O
    OpenCompassgithub.com

    OpenCompass is an LLM evaluation platform for assessing models across datasets covering knowledge, reasoning, coding, science, language, long context, and…

    6.0 APIOpenFree Free tier
  15. 16
    P
    PyRITmicrosoft.github.io

    PyRIT is an open-source framework for security professionals and engineers to identify risks in generative AI systems.

    6.0 APIOpenFree Free tier
  16. 17
    CA
    Confident AIconfident-ai.com

    Confident AI is an AI Quality platform that provides development evaluations and production observability for reliable AI applications.

    5.9 APIOpenFree Free tier · from $200/mo
  17. 18
    E
    EvalPlusgithub.com

    EvalPlus is a framework for rigorously evaluating large language models on code related tasks.

    5.8 APIOpenFree Free tier
  18. 19
    H
    HarmBenchgithub.com

    HarmBench is an open-source framework for evaluating automated red teaming methods and LLM attacks and defenses.

    5.8 APIOpenFree Free tier
  19. 20
    LE
    LM Evaluation Harnessgithub.com

    LM Evaluation Harness is a unified framework for evaluating generative language models across evaluation tasks.

    5.8 APIOpenFree Free tier
  20. 21
    PA
    Parea AIparea.ai

    Parea describes itself as a platform for experiment tracking, observability, and human annotation to help teams ship LLM applications to production.

    5.8 APIOpenFree Free tier · from $150/mo