Flakiness.io

Input—per 1M tokens

Output—per 1M tokens

Context—tokens

WeightsClosed

About

Flakiness.io is ranked #12 of 30 in test analytics software on Inferse. It runs on Self-hosted, Web. Paid plans start at $49/mo.

Compared on test analytics software

Free plan: Yesflakiness.io
Paid from: $49/moflakiness.io
Supported frameworks: Playwright, Pytest, Vitest, Jest, CucumberJS, Bun, Rust, JUnit XMLflakiness.io
CI/CD integrations: GitHub Actions, GitLab CI/CDflakiness.io
Flaky-test detection: Yesflakiness.io
Failure analysis: Yesflakiness.io
Execution trend reports: Yesflakiness.io
Data retention: 180 daysflakiness.io
Self-hosted deployment: Yesflakiness.io

Facts

Purpose: Flakiness.io provides test analytics for GitHub and GitLab and tracks test performance across commits to detect regressions.flakiness.io · 2 Oct 2026
Flake detection: It classifies tests that flip between passing and failing on the same commit as flakes, and persistent outcome changes at a commit as regressions.flakiness.io · 2 Oct 2026
Test runners: The site lists Playwright, Pytest, Vitest, Jest, CucumberJS, Bun, Rust, and a JUnit XML bridge, plus a Node.js SDK for custom integrations.flakiness.io · 2 Oct 2026
CI: It says it works with any CI provider, ingests results as they arrive, merges shards, and keeps staging and production histories separate.flakiness.io · 2 Oct 2026
Sharding: It records test durations so compatible runners can balance shards using historical runtime; Playwright is the listed supported runner for this feature.flakiness.io · 2 Oct 2026
Reports and artifacts: Reports include test history, error grouping, system telemetry, and a test waterfall; uploaded artifacts can include logs, screenshots, videos, traces, and HTML files.flakiness.io · 2 Oct 2026
Repository access: The product follows connected GitHub or GitLab repository permissions for access to test analytics.flakiness.io · 2 Oct 2026
AI agents: The site describes compact failed-run context for coding agents and shows Claude Code, Codex, and Cursor.flakiness.io · 2 Oct 2026
Pricing model: The site says pricing is based on stored data rather than test runs or user seats.flakiness.io · 2 Oct 2026
Self-hosting: A self-hosted deployment uses one application container backed by PostgreSQL and an S3-compatible object store; licensing details are available by contacting the maker.flakiness.io · 2 Oct 2026
Security: The privacy policy lists encryption in transit, Cloudflare network protection, access controls, environment isolation, and monitoring; customers are responsible for securing self-hosted deployments and credentials.flakiness.io · 2 Oct 2026
Data limits: The privacy policy says customers must not upload HIPAA-regulated health information, payment card data, children's data under 13, or classified or export-controlled government information.flakiness.io · 2 Oct 2026
Support: The pricing page lists standard support for Free and Startup plans and priority support for Growth and Enterprise plans.flakiness.io · 2 Oct 2026
Maker: The site identifies Andrey Lushnikov as the creator and displays Degu Labs Inc in its copyright notice.flakiness.io · 2 Oct 2026