Screaming Frog SEO Spider
The industry leading website crawler for Windows, macOS and Linux, trusted by thousands of SEOs and agencies worldwide for technical SEO site audits.·screamingfrog.co.uk
Screaming Frog SEO Spider is a downloadable website crawler that audits sites for over 300 SEO issues to improve SEO and UX. It analyses page titles, meta data, redirects, duplicate content, robots directives, structured data and more, and can render JavaScript-heavy sites using integrated Chromium. It integrates with Google Analytics, Search Console and PageSpeed Insights, and supports scheduling, crawl comparison and custom extraction for technical SEO audits.
What it's for
Features 20
- AI integration with OpenAI, Gemini, Ollama and Anthropic
- AMP crawling and validation
- Analyse page titles and meta data
- Audit hreflang attributes
- Crawl comparison
- Crawl scheduling
- Custom crawl configuration
- Custom JavaScript execution during crawl
- Custom robots.txt testing
- Custom source code search and custom extraction (XPath, CSS Path, regex)
- Discover exact and near duplicate pages
- Find broken links, errors and redirects
- Generate XML Sitemaps
- JavaScript rendering via integrated Chromium
- Mobile usability checks
- Review meta robots and directives
- Save and open crawls
- Site visualisations (crawl and directory tree diagrams)
- Spelling and grammar checks in over 25 languages
- Structured data extraction and validation
At a glance
Integrations
Pricing
The annual licence price is displayed as $279/year, £199/year, or €245/year depending on the page/currency shown, apparently via a currency selector rather than distinct regional prices being clearly reconciled.
Downloadable without sign-up or email capture.
Crawl Limit - 500 URLs; crawl configuration, saving of crawls, and advanced features such as JavaScript rendering, custom extraction and API integrations are restricted
Licence lasts 1 year, then requires renewal. Licences are per user. Volume discounts: 5-9 licences €235/licence/year, 10-19 licences €219/licence/year, 20+ licences €209/licence/year. The same annual licence price is shown variously as $279/year, £199/year, or €245/year on different pages, likely reflecting a currency selector.
Crawl Limit - Unlimited* (dependent on allocated memory and storage)
Bulk licence discounts: 5 to 9 licences €235 per licence/year, 10 to 19 licences €219 per licence/year, 20+ licences €209 per licence/year.