AUTOTEST

Free plan LinuxSelf-hostedWindows

What AUTOTEST is

AUTOTEST is an open-source GenAI tool that analyzes web pages and generates test cases and Python Selenium scripts. It can begin with a base URL and use breadth-first search to collect unique internal URLs up to a chosen depth. Generated tests can cover positive and negative scenarios, including login, registration, and form pages when test data is supplied. Page analysis combines LLM-based metadata extraction with Selenium selector functions as a fallback. The README identifies Selenium and Playwright as supported frameworks and describes Puppeteer support in the development branch. AUTOTEST uses LangChain’s abstraction layer to work with major open-source and closed-source LLMs; provider examples include OpenAI, Groq, and Anthropic. It is primarily a command-line tool, and it saves scripts and test reports in local folders. The listed prerequisites are Python 3.10.12 and an API key from an LLM provider. Generated tests can pause while a user resolves a CAPTCHA or another security challenge. LLM responses can be cached in SQLite, with a --no-cache option to regenerate tests or scripts. The project is distributed under the MIT License, and lists familiarity with web-page test cases and Selenium scripts among its prerequisites.

Who it suits

AUTOTEST suits users who want to generate web-page test cases and Python automation scripts from a command line. It is best suited to people comfortable with web test cases and Selenium scripts who can provide an LLM provider API key.

What it does well

Crawls unique internal URLs to a configurable depth.
Generates positive and negative test cases.
Supports Selenium and Playwright.
Works with open-source and closed-source LLMs through LangChain.
Can cache LLM responses in SQLite.

What to know first

The current version generates scripts only in Python.
Use requires Python 3.10.12 and an LLM provider API key.
The tool is primarily command-line based.

Limits

The current version generates Python scripts; support for other languages is under development. The listed prerequisites are Python 3.10.12 and an API key from an LLM provider.

Getting started

Open the AUTOTEST GitHub repository.
Install Python 3.10.12.
Obtain an API key from an LLM provider.
Configure the LLM provider, with OpenAI, Groq, and Anthropic among the examples.
Run AUTOTEST from the command line against a base URL.
Review generated scripts and test reports in the local folders.

Verdict

Choose AUTOTEST if you want an open-source command-line tool that analyzes pages and generates test cases and Python scripts. Look elsewhere if you need generated scripts in another language now or do not have an LLM provider API key and the listed Python prerequisite.

Questions

Is AUTOTEST free and open source?

AUTOTEST is free, and the software is distributed under the MIT License.

Which operating systems does AUTOTEST support?

Its listed platforms are Linux, Windows, and self-hosted.

Which LLM providers can AUTOTEST use?

It supports major open-source and closed-source LLMs through LangChain’s abstraction layer. Provider examples include OpenAI, Groq, and Anthropic.

Which testing frameworks does AUTOTEST support?

The README identifies Selenium and Playwright as supported. It describes Puppeteer support in the development branch.

What language are the generated scripts written in?

The current version generates Python scripts; support for other languages is under development.

Does AUTOTEST require a paid plan?

AUTOTEST is free. Its listed prerequisites include an API key from an LLM provider.

Facts from AUTOTEST's own pages

Caching: The README describes caching LLM responses in SQLite and a --no-cache option to regenerate test cases or scripts. · github.com, 4 Oct 2026
CLI and outputs: AUTOTEST is primarily CLI-based and stores generated scripts and test reports in local folders. · github.com, 4 Oct 2026
Crawling: It extracts unique internal URLs from a base URL using breadth-first search up to a configurable depth. · github.com, 4 Oct 2026
Frameworks: The README identifies Selenium and Playwright as supported frameworks and describes Puppeteer support in the dev branch. · github.com, 4 Oct 2026
Human intervention: Generated tests can pause for a user to resolve security challenges such as CAPTCHAs. · github.com, 4 Oct 2026
Intended users: The README lists understanding of web-page test cases and knowledge of Selenium scripts among the prerequisites. · github.com, 4 Oct 2026
Language limit: The README says the current version generates test scripts in Python; support for other languages is under development. · github.com, 4 Oct 2026
License: The software is distributed under the MIT License, which permits use, copying, modification, and distribution subject to its stated conditions. · github.com, 4 Oct 2026
LLM options: The README says it supports major open-source and closed-source LLMs through LangChain’s abstraction layer, with provider configuration examples including OpenAI, Groq, and Anthropic. · github.com, 4 Oct 2026
LLM providers: The README says its LangChain abstraction supports major open-source and closed-source LLMs and gives OpenAI, Groq, and Anthropic as provider examples. · github.com, 4 Oct 2026
Manual intervention: Generated tests can pause for a user to resolve a CAPTCHA or other stated security requirement. · github.com, 4 Oct 2026
Page analysis: It combines LLM-based page metadata extraction with Selenium selector functions as a fallback. · github.com, 4 Oct 2026
Purpose: AUTOTEST is an open-source GenAI tool that analyzes web pages and generates automated test cases and Python Selenium scripts. · github.com, 4 Oct 2026
Requirements: The README lists Python 3.10.12 and an API key from an LLM provider as prerequisites. · github.com, 4 Oct 2026
Security and compliance: The repository describes a manual CAPTCHA handling step but does not state security certifications or compliance claims. · github.com, 4 Oct 2026
Test coverage: It can generate positive and negative test cases, including for login, registration, and form pages when test data is supplied. · github.com, 4 Oct 2026
URL crawling: It recursively extracts unique internal URLs from a base URL using breadth-first search, up to a specified depth. · github.com, 4 Oct 2026
Usage: AUTOTEST is primarily a command-line tool and stores generated scripts and test reports in local folders. · github.com, 4 Oct 2026
What it does: AUTOTEST is an open-source GenAI tool that analyzes web pages and generates test cases and Python Selenium scripts. · github.com, 4 Oct 2026

Where AUTOTEST stands on Freedom251

AI Test Case Generators#7 of 21