CrawlZilla

What CrawlZilla is

CrawlZilla is a cloud-based SEO crawler for technical site analysis, available on the web and through an API. It offers Spider, List, and Subdomain crawl modes and can process HTML, images, JavaScript, CSS, and PDFs. Each URL can include more than 40 data points, including titles, canonicals, hreflang, schema, and Open Graph data. An internal-link graph helps find orphan pages and show PageRank flow, while headless Chrome renders JavaScript pages. Lighthouse audits report Performance, Accessibility, Best Practices, and SEO scores, as well as Core Web Vitals. Page Monitor checks URLs on a chosen schedule, tracks changes across 12 or more SEO fields, and can send email alerts. The REST API uses HTTPS, returns JSON, and authenticates with bearer tokens. The free plan allows 10,000 URLs per session, 10 requests per second, three Lighthouse audits per crawl, and 20 monitored URLs. Premium costs £39.99 a month. The maker says its distributed cloud infrastructure supports crawls of 100 million or more URLs, without software installation or server management.

Who it suits

It suits SEO teams and site managers who need technical crawls, scheduled page monitoring, or API access. Its free plan has defined crawl, audit, and monitoring limits.

Limits

The Free plan allows 10,000 URLs per session, 10 requests per second, 3 Lighthouse audits per crawl, and 20 monitored URLs. The listed general crawl limit is 100,000 pages per crawl.

Getting started

1. Open https://crawl-zilla.com/.
2. Choose the Free plan or review the available plan limits.
3. Use CrawlZilla through the web interface or its API.
4. For API requests, use HTTPS, JSON, and bearer-token authentication.

Verdict

CrawlZilla brings crawling, page analysis, Lighthouse audits, and scheduled monitoring into a cloud service with web and API access. The free plan provides a starting point, while higher stated scale and limits vary by plan.