LE

LLM Evaluation Tools

LM Evaluation Harness

github.com · checked 4 Oct 2026

How it plugs in

—Public API
NoOpen source
YesFree tier

Signal on LLM Evaluation Tools5.8#20 of 29

LM Evaluation Harness is a unified framework for evaluating generative language models across evaluation tasks.

LM Evaluation Harness home page

Pricing

  • LM Evaluation HarnessMIT-licensed software · model backends and task dependencies may require separate optional installsFree

As github.com lists them, checked 4 Oct 2026.