Website Crawler is a cloud-based analyzer, scraper, and data extractor that crawls pages and reports on-page SEO issues. Its checks include broken links, canonical links, duplicate titles and meta tags, missing image alt tags, thin content, and heading structure problems. It offers Chrome and HTML crawl modes for JavaScript-heavy sites; HTML mode processes raw HTML only. For custom extraction, users can set CSS or XPath selectors and JavaScript snippets. Crawl results can be exported as CSV, Markdown, or JSON, and the API returns structured JSON. The service also offers uptime monitoring and alerts for downtime and SSL certificate expiry; paid-plan monitoring intervals range from five minutes to one minute. Integrations include read-only Google Search Console access and Slack notifications to a selected channel. The free Basic plan allows 10 pages per day and one project. Paid plans start with Starter at 10.00 USD per month. Crawling covers publicly available HTML-page information and does not automatically fill in or submit forms.
Who it is for
It may suit website owners auditing pages, people analyzing CMS or custom-built sites, and researchers or students assembling web datasets. Teams needing custom extraction can use CSS or XPath selectors, JavaScript snippets, or the API.
What is good
- Reports on several on-page SEO issues.
- Supports CSS, XPath, and JavaScript-based extraction.
- Exports crawl data in three listed formats.
- Free Basic plan allows 10 pages per day.
- Offers uptime and SSL-expiry alerts.
What to know first
- HTML mode processes raw HTML only.
- Free Basic is limited to one project.
- Does not automatically fill in or submit forms.
- Free plan permits 10 pages per day.
Verdict
Website Crawler brings page audits, custom extraction, and monitoring together, with a free plan for small daily crawls. Its scope is limited to publicly available HTML-page information, and it will not submit forms.
Website Crawler plans and pricing
All plansCompared on SEO tools
- Free plan
- Yes
- Paid from
- $20/mo
- Scheduled audits
- Yes
- JavaScript crawling
- Yes
- On-page audits
- Yes
- Search visibility audits
- Yes
- API access
- Yes
