Crawly
by Crawly
What Crawly is
Crawly is a free native macOS SEO crawler for auditing websites. It detects 19 issue types, including broken pages, redirect chains, missing titles, duplicate H1s, and mixed content. Comparing two crawls shows added, removed, and changed URLs, including title, H1, status-code, and indexability changes. Crawl settings include depth and page limits, robots.txt handling, user-agent selection, list mode, and up to 10 concurrent pages by default. Users can extract text or attributes with CSS selectors and search raw HTML with regular expressions. Crawly audits HSTS, Content-Security-Policy, X-Frame-Options, Referrer-Policy, and X-Content-Type-Options headers. An MCP server connects with Claude Code, Cursor, and Codex, according to the maker. Crawl data is kept in a local SQLite database, and the site says it never leaves the Mac. The app supports Apple Silicon and Intel Macs running macOS 12 Monterey or later.
Who it suits
It suits SEO professionals and Mac teams who need local website crawling and control over crawl settings. It is also aimed at users working with Claude Code, Cursor, or Codex through MCP.
What it does well
- Free plan includes all features
- Unlimited URLs per crawl
- Compares crawl changes
- Local SQLite data storage
- MCP server available
What to know first
- Requires macOS 12 Monterey or later
- Mac-only native application
- No free trial is offered
- Up to 10 concurrent pages by default
Plans
| Plan | Billed and limits | Price |
|---|---|---|
| Free | £0/ forever; everything included; no tiers or upsells · Unlimited URLs per crawl | Free |
| Free forever | forever · Unlimited URLs · all features included · no trial period | Free |
As getcrawly.com lists them, read 22 Sept 2026. The maker's own page has the final word.
Verdict
Crawly offers a feature-complete free crawler with issue detection, crawl comparison, custom extraction, and security-header checks. Its local storage and Mac requirement define the main fit.
Facts from Crawly's own pages
- API access
- Yes · getcrawly.com, 22 Sept 2026
- Backlink analysis
- Yes · getcrawly.com, 22 Sept 2026
- Company and location
- Crawly is built by Limely Ltd, a UK web agency, and the site says it was built in Chester, England. · getcrawly.com, 12 Oct 2026
- Crawl comparison
- It can compare two crawls and show added, removed and changed URLs, including changes to titles, H1s, status codes and indexability. · getcrawly.com, 12 Oct 2026
- Crawl controls
- The crawler supports configurable depth and page limits, robots.txt settings, user agent selection, list mode and up to 10 concurrent pages by default. · getcrawly.com, 12 Oct 2026
- Custom extraction
- Users can extract page text or attributes with CSS selectors and search raw HTML with regular expressions. · getcrawly.com, 12 Oct 2026
- Free plan
- Yes · getcrawly.com, 22 Sept 2026
- Headquarters
- Chester, England · getcrawly.com, 28 Sept 2026
- Integrations
- Crawly includes an MCP server for Claude Code and the maker says it connects with Claude Code, Cursor and Codex via MCP. · getcrawly.com, 12 Oct 2026
- Intended users
- The maker describes Crawly as a free alternative for Mac teams and says it is built for professionals who need control over how their sites are crawled. · getcrawly.com, 12 Oct 2026
- Issue detection
- It automatically detects 19 SEO issue types, including broken pages, redirect chains, missing titles, duplicate H1s and mixed content. · getcrawly.com, 12 Oct 2026
- Local data
- Crawl data is stored locally in a SQLite database on the user's Mac; the about page says data never leaves the Mac. · getcrawly.com, 12 Oct 2026
- Platform requirements
- Crawly is a native Mac app for Apple Silicon and Intel and requires macOS 12 Monterey or later. · getcrawly.com, 12 Oct 2026
- Product
- Crawly is a native macOS SEO crawler for crawling and auditing websites. · getcrawly.com, 12 Oct 2026
- Security auditing
- Crawly audits pages for HSTS, Content-Security-Policy, X-Frame-Options, Referrer-Policy and X-Content-Type-Options headers. · getcrawly.com, 12 Oct 2026
- Site audit
- Yes · getcrawly.com, 22 Sept 2026
- Support
- The maker directs users to its support page or GitHub issues for questions and feedback. · getcrawly.com, 12 Oct 2026
Where Crawly stands on Freedom251
- SEO tools#103 of 245