Skip to content
AppClap
Botective is unclaimed —
B

Botective

A comprehensive database for identifying web crawlers, AI bots, and scrapers.·botective.com

Visit

Botective provides a curated dataset of user-agent strings and IP ranges for 170+ known web crawlers, AI bots, and scrapers. It includes a browser-based Logs Analyzer tool that lets users paste server logs or IP addresses to identify which bots are crawling their site. The dataset is sold as a one-time purchase and updated periodically with new bot signatures and IP ranges.

What it's for

Identify which bots are crawling your siteBlock unwanted botsReduce server load and bandwidth costsAnalyze server logs to detect crawlers and botsImplement bot detectionManage crawler trafficStudy web automation

Features 15

  • 36% of bots with IP data
  • 8766 IP addresses tracked
  • Block unwanted bots
  • Changelog tracking IP/bot dataset updates
  • Coverage of AI company bots (OpenAI, Anthropic, Cohere, Perplexity)
  • Coverage of monitoring service bots (Pingdom, UptimeRobot, Datadog)
  • Coverage of search engine bots (Google, Bing, Baidu, DuckDuckGo)
  • Coverage of SEO tool bots (Ahrefs, Semrush, Moz)
  • Coverage of social media platform bots (Facebook, Twitter, LinkedIn)
  • Dataset covering 171 bots
  • Identify which bots are crawling your site
  • JSON-formatted bot profiles with user-agents and IP ranges
  • Logs Analyzer tool to paste server logs or IP addresses and identify bots
  • Reduce server load and bandwidth costs
  • Regularly updated with new bot signatures and IP ranges

At a glance

TypeWeb app
DeploymentCloud
PlatformsWeb
Forcybersecurity professionals, web developers, system administrators, academic researchers, companies needing to identify and manage bot traffic

Resources

Pricing

Dataset is a one-time purchase of $99 (not a subscription); each future dataset update must be purchased separately.

Bot DatasetQuote

One-time purchase of $99; each subsequent update is sold separately; 7-day refund if technical issue; no reselling or redistribution.

170+ bots dataset; each update sold separately

Last checked 28 days ago·