Post #1614039
2026-01-08 07:38 UTC
@dsalo It's really our responsibility to mitigate it for you :) We've found using tools like Anubis if particular sites are getting crushed is useful, but it is pretty much a game of whack-a-mole. We can;t block huge swaths of the internet given our business, but having pretty awesome customers who understand is always the best medicine!
Replies (1)
-
@suzannealdrich@hachyderm.io 2026-01-08 15:17
@jimgroom Cloudflare has a tool for granularly blocking the LLMs for you. We provide intelligence on which crawler is which, and you can use our firewall to control which bots get in. I’m a Sr. Solutions Engineer and longtime customer of (paid) Reclaim. Let me know if I can help. https://blog.cloudflare.com/cloudflare-ai-audit-control-ai-content-crawlers/ @dsalo