Post #2686070
2025-05-12 13:30 UTC
@tdp_org@mastodon.social So crawlers definitely not identifying themselves appropriately, if I get your point correctly?
In other words, these crawlers could be anybody, and are lying about their origin?
Replies (1)
-
@tdp_org@mastodon.social 2025-05-12 13:32
@gimulnautti@mastodon.green Yeah. Someone is spoofing the bot user agents. Not sure why, maybe the think they'll be allowed access to content they otherwise wouldn't? Seems an odd thing to do to me.