KWT Spider
The Cross-Platform Technical SEO Crawler Built for Modern Search·kwtspider.com
KWT Spider is a desktop technical SEO crawler for Windows, macOS, and Linux that discovers pages, audits HTTP status, canonicals, titles, headings, content, images, schema, and links across 29+ data tabs. Version 3.0 adds an SQLite large-site storage mode for crawling 50,000+ URLs, an Offline mode for auditing local static folders before deployment, resumable crawl sessions, and GEO/generative-engine citation scoring (0-100) for AI-answer readiness. It exports CSV, Excel, and HTML reports and generates XML/HTML sitemaps plus an llms.txt file, running entirely on the user's machine with no cloud account required.
What it's for
Features 20
- 29+ granular diagnostic data tabs
- Bulk export of All URLs, Internal, External, Images, Canonicals, Issues
- Canonical validation and Canonical Map
- Chart PNG export (Status, Depth, Indexability)
- Compare Projects (before/after migration diffing)
- Configurable User Agent (Chrome, Googlebot, Bingbot, Mobile Googlebot, Custom)
- CSV, Excel, and HTML report exports
- Duplicate/near-duplicate content detection with match %
- GEO / generative engine citation scoring (0-100)
- Offline pre-flight audits of local static folders (HTML/PHP/ASP)
- Page Speed and Security (HTTPS, mixed content) checks
- Respect robots.txt / crawl images / follow nofollow controls
- Resumable crawl sessions (pause/resume, checkpoint)
- Save/Load crawl sessions
- Scheduled crawls (weekly or daily recurring)
- Schema/structured data validation and rich-result eligibility checks
- SQLite storage mode for crawling 50,000+ URLs
- Three crawl modes: Spider, List, and Offline
- URL Inspector, Redirect Checker, Robots Tester, Sitemap Tester tools
- XML/HTML sitemap generation plus llms.txt generation
At a glance
Pricing
The only paid tier shown is a $99 USD 'per 1 year' licence tied to one machine; the site's own text is inconsistent about whether this is a one-time purchase or a recurring annual licence.
Called 'demo' and 'trial' interchangeably on the pages; no time limit stated, limits are feature/crawl-size based.
Crawl threshold of 250 URLs per session (demo default); session data is memory-only and discarded on close; export, save/load, compare, and sitemap generation are locked or preview-only; GEO engine shows surface score preview only
Purchased by contacting the vendor with a preferred payment method (PayPal, bank transfer); licence key sent by email after payment. Buy-Now page describes this as a '1 Year Licence' while the About page separately describes conversion via a 'one-time key' with 'No ongoing subscription' — these statements conflict.
One licence, tied to one machine, valid one year