FREEDOM251

Freedom251 › SEO tools

SiteOne Crawler

Free plan APILinuxMacSelf-hostedWindows

Visit SiteOne Crawler Alternatives Pricing

SiteOne Crawler's own site

What SiteOne Crawler is

SiteOne Crawler is a free, open-source website crawler and audit tool for reviewing SEO, performance, accessibility, security, best practices, and content. It produces an interactive HTML report or text and JSON output, and assigns a quality score from 0.0 to 10.0 across five areas: performance, SEO, security, accessibility, and best practices. It can save a static site copy for offline browsing, convert a site to Markdown, and generate llms.txt. An optional Chromium mode renders JavaScript-driven pages before crawling. The tool has desktop and command-line variants for Windows, macOS, and Linux, as well as API access and a self-hosted option. Its Rust binary has no runtime dependencies, so Node, Python, and Docker are not required. A CI/CD quality gate supports configurable thresholds, JUnit XML, GitHub annotations, and exit code 10 on failure. A free report-sharing service offers secure URLs with optional expiration and password protection. The default crawl uses three workers and no more than 10 requests per second combined. No account is required.

Who it suits

The maker identifies website owners, developers, QA engineers, administrators, DevOps practitioners, and consultants as intended users. It may suit people who need site analysis across a command line, desktop, API, or self-hosted setup.

What it does well

  • Free and open source; no account required
  • Supports Windows, macOS, and Linux
  • Exports HTML, text, and JSON reports
  • Can export a static copy for offline browsing
  • CI/CD quality gate supports configurable thresholds

What to know first

  • Chromium browser mode is optional
  • Default crawl rate is capped at 10 requests per second
  • Shared reports may have expiration and password protection

Limits

The free plan is listed as free and includes open-source crawling and analysis with CLI and desktop applications, plus HTML, text, and JSON reports. By default, crawls use three workers and no more than 10 requests per second combined.

Plans

PlanBilled and limitsPrice
FreeOpen-source website crawling and analysis · CLI and desktop application · HTML, text, and JSON reportsFree
SiteOne CrawlerFree, open-source alternative; no account requiredFree

As crawler.siteone.io lists them, read 21 Sept 2026. The maker's own page has the final word.

Getting started

  1. Visit https://crawler.siteone.io/.
  2. Choose the desktop or command-line version for Windows, macOS, or Linux.
  3. Use the free plan; no account is required.
  4. Enable the optional Chromium browser mode for JavaScript-driven sites.
  5. Use API access or a self-hosted setup if that fits your workflow.

Verdict

SiteOne Crawler covers multiple site-audit areas and offers reporting, export, and CI/CD features at no listed cost. Its default crawl rate and optional rendering mode are worth noting when planning a crawl.

Questions

How much does SiteOne Crawler cost?

The listed Free plan costs nothing. A second listing, SiteOne Crawler, is also free.

Do I need an account?

No account is required.

Which operating systems does it support?

Its native binary runs on Windows, macOS, and Linux, with desktop and command-line versions.

Does it offer API access or self-hosting?

Yes. API access and a self-hosted option are listed.

What can it analyze and export?

It analyzes SEO, performance, accessibility, security, best practices, and content. Reports can be interactive HTML, text, or JSON; it can also export static site copies, convert sites to Markdown, and generate llms.txt.

Can it crawl JavaScript-driven websites?

Yes. An optional Chromium browser mode renders pages so the crawler can process their post-render DOM.

Facts from SiteOne Crawler's own pages

AI integrations
Its opt-in AI assistant supports OpenAI, Anthropic, Google Gemini, vLLM, Ollama, LM Studio, and OpenAI-compatible endpoints. · crawler.siteone.io, 7 Oct 2026
API access
Yes · crawler.siteone.io, 21 Sept 2026
Audience
The maker identifies website owners, developers, QA engineers, administrators, DevOps practitioners, and consultants as intended users. · crawler.siteone.io, 7 Oct 2026
CI/CD
The built-in CI/CD quality gate supports configurable thresholds, JUnit XML, GitHub annotations, and exit code 10 on failure. · crawler.siteone.io, 7 Oct 2026
Default crawl rate
By default, it uses three workers and no more than 10 requests per second combined. · crawler.siteone.io, 7 Oct 2026
Free plan
Yes · crawler.siteone.io, 21 Sept 2026
JavaScript sites
Optional browser mode uses Chromium to render pages so JavaScript-driven sites can be crawled with their post-render DOM. · crawler.siteone.io, 7 Oct 2026
Markdown export
It can convert an entire website to Markdown and generate llms.txt. · crawler.siteone.io, 7 Oct 2026
Offline copy
It can export a static copy of a website for offline browsing. · crawler.siteone.io, 7 Oct 2026
Purpose
SiteOne Crawler crawls websites and analyzes SEO, performance, accessibility, security, best practices, and content, then produces an interactive HTML report or text and JSON output. · crawler.siteone.io, 7 Oct 2026
Quality scoring
It assigns a 0.0–10.0 quality score across performance, SEO, security, accessibility, and best practices. · crawler.siteone.io, 7 Oct 2026
Report sharing
A free report-sharing service can provide a secure URL with optional expiration and password protection. · crawler.siteone.io, 7 Oct 2026
Runtime dependencies
The Rust binary has zero runtime dependencies, with no Node, Python, or Docker required. · crawler.siteone.io, 7 Oct 2026
Site audit
Yes · crawler.siteone.io, 21 Sept 2026
Support
The maker lists GitHub Issues for bugs and feature requests and GitHub Discussions for questions and discussion. · crawler.siteone.io, 7 Oct 2026
Supported systems
The single native binary runs on Windows, macOS, and Linux, with desktop and command-line variants. · crawler.siteone.io, 7 Oct 2026

Where SiteOne Crawler stands on Freedom251

Look at these too