AUTOTEST: Web Test Generation With an Open-Source CLI
github.com · checked 4 Oct 2026
Open-source command-line tool for turning web pages into automated test cases and Python Selenium scripts.
How it plugs in
Signal on AI Test Case Generators6.0#7 of 21
AUTOTEST is a self-hosted, open-source command-line tool for web test generation. It recursively gathers internal links, examines pages, and creates positive or negative test cases alongside Python Selenium scripts. It can use several language-model providers through LangChain, supports Selenium and Playwright, and saves scripts and reports locally. Generated tests may pause for CAPTCHA handling.

Review
In a line
AUTOTEST is an open-source GenAI tool for creating automated web tests. From existing web pages, it builds test cases and Python Selenium scripts.
What it does
Starting with a base URL, AUTOTEST uses breadth-first search to collect unique internal links through a selected depth. It examines each page, then creates positive and negative cases, including login, registration, and form tests when you provide test data.
It uses language-model page analysis and can fall back to Selenium selector functions. The current release generates scripts in Python.
How it connects
AUTOTEST runs on Linux or Windows in a self-hosted setup and is mainly used from a command line. It saves generated scripts and test reports in local folders.
Through LangChain, it can connect to major open-source and closed-source language models; the README gives OpenAI, Groq, and Anthropic as provider examples. The README identifies Selenium and Playwright as supported frameworks and describes Puppeteer support in the development branch.
Language-model responses can be cached in SQLite, or you can use the no-cache option to generate cases or scripts again.
Good fit
AUTOTEST suits teams that already have a web app and want generated browser tests from its pages. It can cover common flows such as sign-in, registration, and forms when suitable test data is available.
It may suit teams evaluating AI test case generators or browser tools such as Testsigma.
Watch for
The listed prerequisites include Python 3.10.12, an API key from a language-model provider, and a working self-hosted setup. The project expects users to understand web-page test cases and Selenium scripts.
Python is the only script language in the current version; support for other languages is still under development. Tests can stop while a person handles a CAPTCHA or another security challenge. The repository does not state security certifications or compliance claims.
Because it is primarily command-line based and writes to local folders, check that this workflow matches your team before choosing it.
Pricing
AUTOTEST is free, open-source software. It is distributed under the MIT License, which permits use, copying, modification, and distribution subject to its stated conditions.
An API key from a language-model provider is required to run it.
Verdict
Choose AUTOTEST if you want a no-license-cost tool that turns an existing website into browser-test cases and Python scripts, and you can manage a command-line, self-hosted setup. Its provider flexibility and local output are useful for teams already working with Selenium or Playwright.
Look elsewhere if you need scripts in another language today or stated security and compliance certifications.
Our take
AUTOTEST is suited to technically comfortable users seeking open-source web-test generation without a software subscription. It can map internal pages, create several common test scenarios, and generate Python scripts while supporting Selenium and Playwright workflows. The trade-offs are important: setup requires a specific Python version and a provider API key, operation centers on the command line, and generated tests may need human help with CAPTCHAs. Teams needing another script language or documented compliance should compare other tools before adopting it.
- Free, open-source software under the MIT License
- Recursively gathers internal URLs to a configurable depth
- Creates positive and negative web test cases
- Selenium and Playwright are listed as supported frameworks
- Works with several LLM providers through LangChain
- Current scripts are generated only in Python
- Python 3.10.12 and an LLM provider API key are prerequisites
- Primarily command-line based with local folders for output
- CAPTCHAs may require manual user intervention
- No security certifications or compliance claims are stated
- Pick it ifSelf-hosted teams generating browser tests from an existing website; Users comfortable with Python, Selenium, and command-line tools; Projects using OpenAI, Groq, Anthropic, or other LangChain providers
- Skip it ifYou need JavaScript, Java, or another script language now; Your procurement requires documented security certifications
Pricing
AUTOTEST is free, open-source software under the MIT License. An API key from a language-model provider is required to run it.
Questions
Is AUTOTEST free?
Yes. AUTOTEST is free, open-source software under the MIT License. Running it also requires an API key from a language-model provider.
What does AUTOTEST generate?
It creates web test cases and Python Selenium scripts. Positive and negative cases can include login, registration, and form scenarios when test data is supplied.
Which operating systems does AUTOTEST support?
The listed platforms are Linux and Windows. AUTOTEST is designed to run in a self-hosted setup.
Which language-model providers work with AUTOTEST?
Its LangChain layer supports major open-source and closed-source models. Provider examples in the README include OpenAI, Groq, and Anthropic.
Does AUTOTEST support Playwright?
Yes. The README names Selenium and Playwright as supported frameworks, and describes Puppeteer support in the development branch.
Can AUTOTEST handle CAPTCHAs?
Generated tests can pause so a user can resolve a CAPTCHA or another stated security challenge before continuing.
What are AUTOTEST's setup requirements?
The README lists Python 3.10.12 and an API key from an LLM provider. It also expects familiarity with web-page test cases and Selenium scripts.