OpenTest.AI

Free plan Self-hosted

What OpenTest.AI is

OpenTest.AI is a self-hosted, open-source project for local AI quality checks and portable JSON formats used in software testing. Its six quality skills cover recent-change bug fixes, broad scans, risk and confidence analysis, comparisons, and metrics. jank auto-fix can inspect code, documents, images, and Office files. jank_deep scans 12 quality dimensions, including correctness, security, reliability, performance, maintainability, and testing. jank_risk examines change impact, GenAI smells, user frustration, and business risk. jank_confidence applies statistical test-coverage analysis and estimates the time and cost of closing gaps. jank_diff compares APIs, documents, or local files while filtering out timestamps, dynamic IDs, and generated metadata. jank_stats reports token and cost totals, fixes by category, and estimated developer time and money saved. The skills work with AI clients including Claude Code, Cursor, Antigravity, Codex CLI, GitHub Copilot Chat, Aider, and Continue.dev. The project also analyzes screenshots, network and console logs, and DOM or accessibility trees with 33+ specialized AI testing profiles. It supports bug detection, persona feedback, and prioritized test-case generation; its v1 JSON test cases can be replayed by Playwright, Selenium, Cypress, or a human. The MIT-licensed plan is free forever and runs locally without an API key, cloud call, or account.

Who it suits

OpenTest.AI suits developers and teams who want local quality checks alongside AI coding clients, with no API key, cloud call, or account required. It also fits people who need portable test cases that can be replayed by common browser testing tools or a human.

What it does well

Six quality skills cover scans, risk, confidence, diffs, fixes, and metrics.
jank_deep scans 12 quality dimensions.
Works with seven listed AI clients and AGENTS.md-aware tools.
Runs locally without an API key, cloud call, or account.
Portable v1 JSON test cases support multiple replay options.

What to know first

Browser test generation is available, but API and mobile test generation are not.
Requires a self-hosted setup.

Limits

The listed plan is free forever. API test generation and mobile test generation are not available.

Plans

Plan	Billed and limits	Price
Open source · MIT	free forever · MIT licensed · no API key · no cloud call · no account	Free

As opentest.ai lists them, read 1 Oct 2026. The maker's own page has the final word.

Getting started

Visit the OpenTest.AI website.
Choose the Open source · MIT plan, which is free forever.
Use a compatible AI client, such as Claude Code, Cursor, Codex CLI, or Continue.dev.
Run the quality skills locally against an existing app.

Verdict

Choose OpenTest.AI if you want free, MIT-licensed quality skills that operate locally and support several AI clients. Its checks cover multiple file types and quality dimensions, while portable test cases can be replayed by several tools. Look elsewhere if API or mobile test generation is required.

Questions

How much does OpenTest.AI cost?

The Open source · MIT plan costs nothing, billed free forever.

Does it require an account or API key?

The skills are described as operating locally without an API key, cloud call, or account.

Which AI clients does it support?

Listed clients include Claude Code, Cursor, Antigravity, Codex CLI, GitHub Copilot Chat, Aider, Continue.dev, and AGENTS.md-aware tools.

Can its test cases be replayed in browser testing tools?

Yes. The test-case format can be replayed by Playwright, Selenium, Cypress, or a human.

Does it generate API or mobile tests?

API test generation and mobile test generation are both listed as unavailable.

Facts from OpenTest.AI's own pages

Additional services: The site says jank.ai also offers cloud browser testing, URL monitoring dashboards, autonomous hunt-and-fix loops, and human-eye reviews. · opentest.ai, 1 Oct 2026
AI client integrations: The skills work with Claude Code, Cursor, Antigravity, Codex CLI, GitHub Copilot Chat, Aider, Continue.dev, and AGENTS.md-aware tools. · opentest.ai, 1 Oct 2026
Auto-fix: jank auto-fix finds bugs in recent changes and can work on code, documents, images, and Office files. · opentest.ai, 1 Oct 2026
Bug detection: The open-source project analyzes screenshots, network logs, console logs, and DOM or accessibility trees using 33+ specialized AI testing profiles. · opentest.ai, 1 Oct 2026
Confidence analysis: jank_confidence uses statistical test-coverage analysis with t-tests, p-values, and sampling, and estimates the cost and time to close gaps. · opentest.ai, 1 Oct 2026
Local operation: The skills are described as pure-local and require no API key, cloud call, or account. · opentest.ai, 1 Oct 2026
Metrics: jank_stats reports cumulative tokens, cost, fixes by category, and estimated developer time and money saved. · opentest.ai, 1 Oct 2026
Open skills: The site lists six quality-check skills: jank auto-fix, jank_deep, jank_risk, jank_confidence, jank_diff, and jank_stats. · opentest.ai, 1 Oct 2026
Portable formats: OpenTest.AI publishes v1 JSON formats for bugs and test cases designed to move between finders, runners, fixers, and humans. · opentest.ai, 1 Oct 2026
Product purpose: OpenTest.AI provides local-first AI quality checks and portable JSON formats for AI-era software testing. · opentest.ai, 1 Oct 2026
Quality scan: jank_deep performs a full scan across 12 quality dimensions including correctness, security, reliability, performance, maintainability, and testing. · opentest.ai, 1 Oct 2026
Risk analysis: jank_risk traces changes across code blast radius, GenAI smells, user frustration, and business risk. · opentest.ai, 1 Oct 2026
Runner interoperability: The test-case format can be replayed by Playwright, Selenium, Cypress, or a human. · opentest.ai, 1 Oct 2026
Smart diff: jank_diff compares APIs, documents, or local files while ignoring timestamps, dynamic IDs, and generated metadata noise. · opentest.ai, 1 Oct 2026
Testing modes: The project supports bug detection, persona feedback, and prioritized test-case generation for pages or flows. · opentest.ai, 1 Oct 2026

Where OpenTest.AI stands on Freedom251

AI Test Case Generators#12 of 21