@beachcomber@social.leecalvin.xyz
Post #2888734
2025-12-08 02:00 UTC
@rtyler@hacky.town Yep. This is literally the contents of my robots.txt nowadays, at least on one of my sites:
User-agent: *
Disallow: /
Replies (2)
-
@MaxED9@mastodon.social 2025-12-08 06:23
@beachcomber@social.leecalvin.xyz @rtyler@hacky.town unfortunately robots.txt will not prevent and was never meant to be. And has no function anymore. https://www.heise.de/en/background/Obituary-Farewell-to-robots-txt-1994-2025-10766991.html?seite=all
-
@owl@gts.u8.is 2025-12-08 10:23
@beachcomber@social.leecalvin.xyz @rtyler@hacky.town I wish that would discourage them :exhausted_owl: