@gglockner@social.seattle.wa.us
Post #2881835
2026-04-29 17:22 UTC
@mlanger@mastodon.world A robots.txt file is voluntary. Considering that Facebook keeps persisting despite that my firewall blocks their attempts, I have no reason to believe they would respect a robots.txt file.
As I'm watching them try again and again, my only reaction is "WTF?”.
Replies (3)
-
@bhhaskin@social.bitsofsimplicity.com 2026-04-29 17:23
@gglockner@social.seattle.wa.us @mlanger@mastodon.world it's for sure scraping for AI training. Only thing that makes sense.
-
@KevinFreitas@mastodon.social 2026-04-29 17:28
@gglockner@social.seattle.wa.us @mlanger@mastodon.world Has anyone ever filed a restraining order against a corp from accessing their site? Seems we’ve reached the time this may be necessary. (shouldn’t be, of course)
-
@mlanger@mastodon.world 2026-04-29 18:49
@gglockner@social.seattle.wa.us You can't set up your .htaccess file to block the IP addresses?