@fullywoolly@mastodon.social @kajer@infosec.exchange @ai6yr@m.ai6yr.org Yeah, exactly; this stuff is like whack-a-mole.  That's why more people should self-host; that way, you can start by blocking the ASN and then go from there.  Then you're still playing whack-a-mole but with an unfair advantage; at least that's something.  Obviously, they're supposed to respect robots.txt anyway, and some of them actually do.  Honestly, if I were still able to federate properly with only a .onion and without an actual URL, I would do that instead, and this is probably the biggest reason why (and yes, I tried, and no, I couldn't figure out how to make it work, and then I finally gave up and just got a real domain name like a normal person, just because I had to (also, .onion is literally free, so there's also that)).