Captain is an open-source command-line tool for improving test reliability and managing test execution. It measures reliability, identifies flaky tests, retries failures, and can quarantine flaky tests to help unblock builds. It tracks test runtimes and distributes test files across parallel jobs. Documented framework integrations include xUnit, ExUnit, Ginkgo, go test, Bun, Cucumber, Cypress, Jest, Karma, Mocha, Playwright, TestCafe, Vitest, PHPUnit, pytest, unittest, minitest, and RSpec. Its listed CI integrations include RWX, GitHub Actions, CircleCI, Buildkite, and GitLab. Framework integrations can send results to a web interface for reviewing tests and managing retries, quarantines, and suite partitioning. The free OSS plan includes file-based configuration, parallel partitioning, flaky-test tracking and quarantine, and retries. Pro costs $10 per million test results uploaded and adds flaky-test analytics and performance trends retained for 90 days. Feature availability differs by framework: xUnit does not include partitioning, while Karma does not list retries or partitioning. Captain is available for Linux, macOS, Windows, web, and API environments.
Who it is for
Captain suits development teams seeking to track flaky tests, retry or quarantine failures, and distribute test files across parallel jobs. Its many documented framework and CI integrations may suit teams using those tools.
What is good
- Free OSS plan includes retries and quarantine.
- Tracks test runtimes for parallel balancing.
- Web interface for analyzing test results.
- Pro includes 90-day performance trend retention.
What to know first
- Features vary by framework.
- xUnit integration lacks partitioning.
- Karma lists no retries or partitioning.
- Pro is $10 per million results uploaded.
Verdict
Captain combines flaky-test management with parallel test partitioning and a web interface for reviewing results. Check framework-specific feature coverage before relying on retries or partitioning.
Captain plans and pricing
All plansCompared on test flakiness management software
- Free plan
- Yes
- Flake detection
- Yes
- Quarantine workflow
- Yes
- Rerun policies
- Yes
- Supported frameworks
- xUnit, ExUnit, Ginkgo, go test, Bun, Cucumber, Cypress, Jest, Karma, Mocha, Playwright, TestCafe, Vitest, PHPUnit, pytest, unittest, Ruby Cucumber, minitest, RSpec
