Botective
A comprehensive database for identifying web crawlers, AI bots, and scrapers.·botective.com
Botective provides a curated dataset of user-agent strings and IP ranges for 170+ known web crawlers, AI bots, and scrapers. It includes a browser-based Logs Analyzer tool that lets users paste server logs or IP addresses to identify which bots are crawling their site. The dataset is sold as a one-time purchase and updated periodically with new bot signatures and IP ranges.
What it's for
Features 15
- 36% of bots with IP data
- 8766 IP addresses tracked
- Block unwanted bots
- Changelog tracking IP/bot dataset updates
- Coverage of AI company bots (OpenAI, Anthropic, Cohere, Perplexity)
- Coverage of monitoring service bots (Pingdom, UptimeRobot, Datadog)
- Coverage of search engine bots (Google, Bing, Baidu, DuckDuckGo)
- Coverage of SEO tool bots (Ahrefs, Semrush, Moz)
- Coverage of social media platform bots (Facebook, Twitter, LinkedIn)
- Dataset covering 171 bots
- Identify which bots are crawling your site
- JSON-formatted bot profiles with user-agents and IP ranges
- Logs Analyzer tool to paste server logs or IP addresses and identify bots
- Reduce server load and bandwidth costs
- Regularly updated with new bot signatures and IP ranges
At a glance
Resources
Pricing
Dataset is a one-time purchase of $99 (not a subscription); each future dataset update must be purchased separately.
One-time purchase of $99; each subsequent update is sold separately; 7-day refund if technical issue; no reselling or redistribution.
170+ bots dataset; each update sold separately