New #Documentation: Blocking requests from #Cloudflare's automated browser #crawl endpoint

Cloudflare recently announced an endpoint on their Browser Rendering service which allows users to make one API request to trigger a crawl of an entire site.

This documentation details how to block the resulting request.

https://www.bentasker.co.uk/posts/documentation/general/blocking-cloudflares-automated-crawl-endpoint.html