Website Crawler
What Website Crawler is
Website Crawler is a cloud-based analyzer, scraper, and data extractor that crawls pages and reports on-page SEO issues. Its checks include broken links, canonical links, duplicate titles and meta tags, missing image alt tags, thin content, and heading structure problems. It offers Chrome and HTML crawl modes for JavaScript-heavy sites; HTML mode processes raw HTML only. For custom extraction, users can set CSS or XPath selectors and JavaScript snippets. Crawl results can be exported as CSV, Markdown, or JSON, and the API returns structured JSON. The service also offers uptime monitoring and alerts for downtime and SSL certificate expiry; paid-plan monitoring intervals range from five minutes to one minute. Integrations include read-only Google Search Console access and Slack notifications to a selected channel. The free Basic plan allows 10 pages per day and one project. Paid plans start with Starter at $10 a month. Crawling covers publicly available HTML-page information and does not automatically fill in or submit forms.
Who it suits
It may suit website owners auditing pages, people analyzing CMS or custom-built sites, and researchers or students assembling web datasets. Teams needing custom extraction can use CSS or XPath selectors, JavaScript snippets, or the API.
What it does well
- Reports on several on-page SEO issues.
- Supports CSS, XPath, and JavaScript-based extraction.
- Exports crawl data in three listed formats.
- Free Basic plan allows 10 pages per day.
- Offers uptime and SSL-expiry alerts.
What to know first
- HTML mode processes raw HTML only.
- Free Basic is limited to one project.
- Does not automatically fill in or submit forms.
- Free plan permits 10 pages per day.
Plans
| Plan | Billed and limits | Price |
|---|---|---|
| Basic | 10 pages / day · No monthly quota · 1 project | Free |
| Starter | $10 / Month · 2,000 pages / month · 3 projects · $5 per 1000 pages | $10 a month |
| Growth | $20 / Month · 10,000 pages / month · 10 projects · $2 per 1000 pages | $20 a month |
| Scale | $60 · 50000 pages / month · 50 projects · $1.2 per 1000 pages | $60 a month |
| Enterprise | Starting around $90 / month · Up to 1M pages / mo · 100 projects · Unlimited team members | On request |
As websitecrawler.org lists them, read 29 Sept 2026. The maker's own page has the final word.
Verdict
Website Crawler brings page audits, custom extraction, and monitoring together, with a free plan for small daily crawls. Its scope is limited to publicly available HTML-page information, and it will not submit forms.
Facts from Website Crawler's own pages
- API access
- Yes · websitecrawler.org, 21 Sept 2026
- Crawl scope limit
- The service works with publicly available information on HTML pages and does not automatically fill in or submit forms. · websitecrawler.org, 29 Sept 2026
- Custom extraction
- Users can configure extraction with CSS or XPath selectors and JavaScript snippets. · websitecrawler.org, 29 Sept 2026
- Exports and API
- Crawl data can be exported in CSV, Markdown, or JSON, and the API retrieves structured JSON data. · websitecrawler.org, 29 Sept 2026
- Free plan
- Yes · websitecrawler.org, 21 Sept 2026
- Free-plan limits
- The free plan allows 10 URLs per day, while features marked Demo expose data for only five URLs on the project page and five records in settings. · websitecrawler.org, 29 Sept 2026
- Integrations
- The privacy policy describes Google Search Console integration with read-only account access and a Slack integration for notifications to a selected channel. · websitecrawler.org, 29 Sept 2026
- Intended users
- The maker describes the service for website owners, people analyzing CMS or custom-built sites, and researchers or students needing web datasets for AI projects. · websitecrawler.org, 29 Sept 2026
- JavaScript crawling
- It can render JavaScript-heavy sites and offers Chrome and HTML crawl modes; HTML mode processes raw HTML only. · websitecrawler.org, 29 Sept 2026
- Monitoring
- The service offers uptime monitoring and alerts for downtime and SSL certificate expiry; paid plan monitoring intervals range from five minutes to one minute. · websitecrawler.org, 29 Sept 2026
- Product
- Website Crawler is a cloud-based website analyzer, scraper, and data extractor that crawls site pages and reports on-page SEO issues. · websitecrawler.org, 29 Sept 2026
- Security and privacy
- The privacy policy says collected crawl data is assigned to the crawl-job starter, user data is not sold or shared with third-party companies, and account data is removed when the account is deleted. · websitecrawler.org, 29 Sept 2026
- SEO audits
- The service identifies issues including broken links, canonical links, duplicate titles and meta tags, missing image alt tags, thin content, and heading structure problems. · websitecrawler.org, 29 Sept 2026
- Paid from
- 20 · websitecrawler.org, 21 Sept 2026
- Support
- The maker says it provides email support on weekdays and weekends and replies within two to three hours. · websitecrawler.org, 29 Sept 2026
Where Website Crawler stands on Freedom251
- SEO tools#84 of 245
- SEO Audit Software#23 of 35