Cloudflare has created a bot-busting AI to make life hell for AI crawlers.
The network-taming company built the tool after noticing that almost one percent of all requests to access web content that it can see now come from AI crawler bots. Those bots are probably scraping data that’s gathered up to train AI models.
Web site operators can in theory block AI crawlers using various means such as a robots.txt file or changing web server settings to disallow visits from bots. Some even use…
Article Source
https://www.theregister.com/2025/03/21/cloudflare_ai_labyrinth/
