Post #3977518

@danlyke@researchbuzz.masto.host Yeah, we've gone past the 50% mark wrt internet traffic. Now more than half of it is bots scraping stuff and (more than likely) not caring about robots.txt. If they can't respect a simple .txt file, chances are very high that they can't sanitise the data that lies behind it. So, yeah, let's wait for them to choke on all the generated bullshit... whether that's their own effluent or stuff that the defenders put out there.