Post #2888735
2025-12-08 06:23 UTC
@beachcomber@social.leecalvin.xyz @rtyler@hacky.town unfortunately robots.txt will not prevent and was never meant to be.
And has no function anymore.
https://www.heise.de/en/background/Obituary-Farewell-to-robots-txt-1994-2025-10766991.html?seite=all
Replies (0)
No replies.