Free and open first
Best CI Failure Analysis And Flaky Test Tools in 2026
Teams use CI failure analysis and flaky-test tools to locate failed builds, identify tests that behave inconsistently, and examine trends across CI runs. This list is for people comparing hosted services, APIs, Linux or desktop options, and self-hosted software.
- 21 apps
- Research read 7 Oct 2026
- How the order is worked out
- 1
Buildkite
Free plan APIExtensionLinux+4Buildkite combines pipeline execution with test-result management and a choice of agent hosting. Its free and Pro plans have stated user and concurrency limits.
- 2
BuildPulse
Free plan APILinuxMac+2BuildPulse focuses on test reliability and CI health, with coverage tracking and runner options alongside flaky-test analysis.
- 3
Argos
Free plan APIWebArgos provides screenshot comparison plus support for text-based diffs and common testing integrations.
- 4
Flake
Free plan LinuxMacSelf-hosted+1Flake provides local detection, diagnosis, minimization, and replay for flaky tests, with GitHub Actions support for CI reporting.
- 5
Flakiness.io
Free plan Self-hostedWebFlakiness.io combines cross-commit test analysis with reports and uploaded run artifacts. Consider its storage and retention limits, or ask the maker about self-hosted licensing.
- 6
Mergify
Free plan APISelf-hostedWebChoose Mergify if your team wants pull request queues, CI insights, flaky-test tools, and configurable merge protections in one service.
- 7
Qualflare
Free plan AndroidAPIiPhone+4Qualflare brings manual test management, automated result collection, and AI-assisted failure analysis into one platform.
- 8
TestMu AI
Free plan AndroidAPIExtension+6TestMu AI combines AI-assisted test workflows with several deployment choices and a broad integration list.
- 9
Jenkins
Free plan LinuxMacSelf-hosted+2Jenkins offers a wide range of CI/CD workflows, deployment formats, and community plugins without a software fee.
- 10
Cloud-Radar
Free planCloud-Radar provides local template checks as well as functional testing through Taskcat and boto3.
- 11
Trunk Flaky Tests
Free plan Self-hostedWebTrunk Flaky Tests combines failure analysis, automatic quarantine, and test-run analytics, with a free tier for small teams.
- 12
Currents
Free trial APISelf-hostedWebCurrents combines shared Playwright diagnostics, CI orchestration, flaky-test controls, and reporting.
- 13
Daxtack
Free plan LinuxMacWeb+1 - 14
AetherCI
Free plan Web - 15
Harness CI
Free plan WebChoose Harness CI if you need web-based CI with hosted or self-hosted runner options and pull request checks.
- 16
FailBrief
Free plan Web - 17
FlaPy
Free plan Linux - 18
The Plumber
Free plan Web - 19
Pastry
Paid WebPastry focuses on flaky-test detection, prioritization, and controlled quarantine workflows. Its volume-based pricing and retention terms should be reviewed alongside the team’s test counts.
- 20
Datadog Test Optimization
Paid Web - 21
Develocity Flaky Tests
Paid Web
#1Places #1, #2, #3, #4, #5 on this list can be bought by the makers of the software on it. See the price
Compare free plans, trial periods, paid starting prices, and licences before choosing. Look for capabilities such as flaky-test detection, root-cause analysis, AI repair suggestions, test quarantine, CI integrations, and failure history.
Questions
Which tools have a free plan?
The list marks AetherCI, Argos, Buildkite, BuildPulse, Cloud-Radar, Daxtack, FailBrief, Flake, and Flakiness.io as having free plans.
Are there open-source options?
Open-source entries include Cloud-Radar and Flake.
Which tools offer free trials?
Buildkite shows a 30-day trial; BuildPulse, Currents, and Datadog Test Optimization show 14-day trials. Develocity Flaky Tests shows 30 days.
What platforms are covered?
Across the list, platform choices are web, Linux, self-hosted, macOS, Windows, and API.
What does pricing look like?
Examples of listed starting prices are $9/mo for FailBrief, $25/mo for Daxtack, $49/mo for Currents, and $99/mo for AetherCI and BuildPulse. Some pricing is on request.