2026-01-23 01:47 UTC
@markmcb@mas.to those are super icky compared to making good websites :\
But it's not really my business, i understand the tradeoff and how much of a minority i am compared to crawlers
Replies (1)
-
@markmcb@mas.to 2026-01-23 03:10
@wyatt@soc.megatokyo.moe It's a good point. I updated the article to include the setup for an exclusion-based approach instead of the inclusion-based approach I mentioned. The more I think about it, it's probably the better option for a few reasons, including the one you mentioned. Thanks for pointing it out.