Post #654499

New #Documentation: Blocking requests from #Cloudflare's automated browser #crawl endpoint Cloudflare recently announced an endpoint on their Browser Rendering service which allows users to make one API request to trigger a crawl of an entire site. This documentation details how to block the resulting request. https://www.bentasker.co.uk/posts/documentation/general/blocking-cloudflares-automated-crawl-endpoint.html