cloudflare-bot-directory
Cloudflare Radar verified bots directory — 500+ crawlers and search-engine user agents as data.
- 21
- JavaScript
- 5 d ago
Cloudflare Radar verified bots directory — 500+ crawlers and search-engine user agents as data.
🤔 Is this Web request from a real search engine🕷 or from an impersonating agent 🕵️♀️?
Collection of IP addresses used by legitimate crawlers and services: Googlebot, Bingbot, AhrefsBot, UptimeRobot, Pingdom, Cloudflare, Bunny CDN, Stripe, Shodan, FacebookBot, TelegramBot, and more.
Play Framework filter: allow only legitimate search bots to access the site