Noveum

Input—per 1M tokens

Output—per 1M tokens

Context—tokens

WeightsClosed

About

Noveum is ranked #2 of 29 in AI agent evaluation tools on Inferse. It runs on API, Linux, Self-hosted, Web. There is a free plan. A free trial is offered. Paid plans start at $69/mo.

Compared on AI agent evaluation tools

Free plan: Yesnoveum.ai
Paid from: $69/monoveum.ai
Evaluation methods: hybridnoveum.ai
Tool-call checks: Yesnoveum.ai
Trace ingestion: Yesnoveum.ai
Safety evaluations: Yesnoveum.ai
Regression runs: Yesnoveum.ai
SDK language support: bothnoveum.ai

Facts

Purpose: Noveum is an AI agent evaluation platform for production chat, voice, and workflow agents.noveum.ai · 29 Sept 2026
Tracing: NovaTrace captures LLM calls, tool invocations, retrieval, and agent steps, with tokens, cost, and latency on spans.noveum.ai · 29 Sept 2026
Evaluation: NovaEval scores traces with calibrated scorers across 15+ categories, including a voice and audio suite.noveum.ai · 29 Sept 2026
Fix validation: NovaPilot backtests candidate fixes on failing calls, re-simulates them end to end, and delivers validated fixes as pull requests for human review.noveum.ai · 29 Sept 2026
Integrations: The tracing SDK has native integrations for LangChain, LangGraph, LiveKit, Pipecat, and CrewAI, and the site also lists OpenAI, Anthropic, and OpenTelemetry compatibility.noveum.ai · 29 Sept 2026
SDKs: Noveum says its open-source tracing SDKs support Python and TypeScript.noveum.ai · 29 Sept 2026
Deployment: Noveum offers managed cloud, VPC, BYO ClickHouse, and on-premise deployment, with Kubernetes and Helm deployment options also described on its pricing page.noveum.ai · 29 Sept 2026
Security: The maker lists GDPR and SOC 2 Type II as in progress, and says enterprise deployments include encryption in transit and at rest and fine-grained access controls.noveum.ai · 29 Sept 2026
Access controls: The homepage lists SSO/SAML, RBAC, and audit logging, while pricing specifies SSO/SAML for Scale and above.noveum.ai · 29 Sept 2026
Limits: Monthly plan credits reset each billing cycle and do not roll over, while purchased add-on credits never expire.noveum.ai · 29 Sept 2026
Support: The pricing page lists community support, priority support for Growth and above, and dedicated customer success for Enterprise.noveum.ai · 29 Sept 2026
Intended users: Noveum describes its audience as teams operating production chatbots, voice agents, and multi-agent workflows.noveum.ai · 29 Sept 2026
Product status: NovaGuard runtime guardrails are marked beta or coming soon on the maker’s site.noveum.ai · 29 Sept 2026