Post #806980
2026-03-27 08:41 UTC
While Wikimedia content is free, the infrastructure that serves it is not.
Thanks to improvements in bot detection, more than *2 billion* requests per day get currently blocked, which would have otherwise caused further strain on the infrastructure.
https://diff.wikimedia.org/2026/03/26/quo-vadis-crawlers-progress-and-whats-next-on-safeguarding-our-infrastructure/
Replies (2)
-
@kaffeeringe@social.tchncs.de 2026-03-27 09:57
@vrandecic@mas.to I run several MediaWikis - Crawlers follow every single link, deep into the history of every article. It's totally crazyy.
-
@agowa338@chaos.social 2026-03-27 12:29
@vrandecic@mas.to Only one thing gets overlooked here, blocking requests also requires infrastructure and resources...