FlakyGuard

What FlakyGuard is

FlakyGuard is a web service for finding and managing flaky tests in CI workflows. It tracks test pass and fail history, then uses statistical flip-rate analysis to flag tests that alternate between outcomes. Tests that cross its flakiness threshold are automatically quarantined but continue to run; once stable, they are un-quarantined. Failure analysis classifies causes such as timing, race conditions, resource contention, and environment problems, with a copy-and-paste fix suggestion tailored to each diagnosis. Team analytics show flakiness trends across repositories, test suites, and patterns.

FlakyGuard accepts JUnit XML and JSON test reports from any test framework. Its current CI support is GitHub Actions. The service lists Slack alerts and weekly digests, as well as GitHub Check annotations on pull requests. Setup is described as taking under two minutes without required configuration files or test-code changes. The free Open Source plan covers up to three repositories; Team costs $49 a month and covers up to 25 repositories. Enterprise adds unlimited repositories, advanced analysis, custom integrations, SSO, audit logs, dedicated support, and an SLA guarantee. The site invites teams to join a waitlist ahead of launch.

Who it suits

FlakyGuard suits software teams that need to identify unreliable tests and keep them running while isolating their impact on CI builds. It is especially relevant to teams using GitHub Actions that want failure diagnoses, tailored fix suggestions, and repository-level trend analytics.

Limits

The free Open Source plan covers up to three repositories and includes basic quarantine. The Team plan costs $49 a month and covers up to 25 repositories; Enterprise repository capacity is unlimited.

Getting started

1. Visit https://flakyguard.com/.
2. Join the waitlist to be among the first teams to use the product when it launches.
3. Use the web service with GitHub Actions, its currently supported CI platform.
4. Send JUnit XML or JSON test reports from your test framework.
5. Choose the Open Source plan for up to three repositories or Team for up to 25 repositories.

Verdict

Choose FlakyGuard if your team uses GitHub Actions and wants to detect, quarantine, and diagnose flaky tests without changing test code. Its free plan provides detection and basic quarantine for up to three repositories. Teams needing more repositories, advanced analysis, or enterprise controls should review the paid plans; the site is currently inviting teams to join a waitlist for launch.