@WeirdWriter@caneandable.social
Post #4360719
2026-08-03 15:27 UTC
This is why I always maintain the best way is to go the other way, allow all scraping ingestion etc etc etc even though your server may take a huge hit from the traffic, but this blogger does it and he doesn't have a high bill https://starbreaker.org/colophon.html @raulmatias@mstdn.social
Replies (1)
-
@raulmatias@mstdn.social 2026-08-03 15:31
@WeirdWriter@caneandable.social Not all people want or can afford beefy servers. There are also some webmasters who block crawlers/scrapers out of principle.