Post #837864

Found out about a project with millions of randomly generated links. The author explained how #Facebook's scraping bot hit it's page 38 million times. All while the company itself claims that their bot only crawls pages that are shared on their platforms. Why is there so much dishonesty in some hyperscaling tech companies? Other crawlers are also listed in a short write-up by the author. #infosec #crawler #llm #meta