Post #2676132
2026-04-23 17:07 UTC
@jsstaedtler@mastodon.art i was more suggesting that your site code needs to start 404ing for tags that should not return results
e.g. putting in the year 2030 should not generate results, yet it does.
https://bigraccoon.ca/gallery?tag=Year%3A%2030
you can put anything you want after tag=, and it will generate results
this is effectively feeding scrapers unlimited valid URLs every time.
Replies (1)
-
@jsstaedtler@mastodon.art 2026-04-23 17:23
@vga256@mastodon.tomodori.net Ah, you're absolutely right: if the query includes tags that don't even exist, I can tell it to jog off. That's a pretty easy task. Sadly, the bots are following actual links on legit gallery pages. Every tag is a link with a valid query, and the query just grows longer as you click through them. That's where I figure I need to set a limit.