Post #3474261
2026-06-28 09:23 UTC
Replies (2)
-
@Dragon@toast.dragon2611.net 2026-06-28 10:02
@drgeo@mamot.fr @doctormo@floss.social scrapers trying to get content for training AIs but they often don't respect site owners wishes as well as assuming everyone has the infrastructure budget of Google. Some of them don't politely crawl the site with a slow rate of requests they bombard it causing a DOS/DDOS (overwhelming the site and taking it offline)
-
@cartocalypse@norden.social 2026-06-28 10:07
@drgeo@mamot.fr @Dragon@toast.dragon2611.net @doctormo@floss.social Some malicious actors (and I am honestly freaking out why they have not been exposed yet) are accessings websites from millions of different machines with no identification or recognisable patterns. They access every URL, many times, regardless of content or anything, and overload people's servers. Because they come from without any throttles, from so many machines and without any shared bits of information, you can only block them with complicated extra processes.