Post #3248945
2026-03-27 10:40 UTC
@vrandecic@mas.to @kaffeeringe@social.tchncs.de is there anything that can be done about those "residential proxy" crawlers? They have made running a mediawiki on a small vps virtually impossible 😥. As if the intention is to kill the practice of sharing information openly.
Replies (2)
-
@vrandecic@mas.to 2026-03-27 11:22
@openrisk@mastodon.social @kaffeeringe@social.tchncs.de I literally have the same problem. My website is basically dead because of that. :'( I don't know. I'll see if I can figure something out.
-
@samwilson@wikis.world 2026-03-27 13:44
@openrisk@mastodon.social @vrandecic@mas.to @kaffeeringe@social.tchncs.de I find blocking them from almost all non-reading pages helps a lot. There's some info at https://www.mediawiki.org/wiki/Manual:Handling_web_crawlers#Apache