Post #2972663
2024-12-27 14:10 UTC
@khobochka@mastodon.social This is terrible. I updated the crawler blocklist on the robots.txt of my web and they seem to havemultiplied the crawl attempts x10 times. :blobdisapproval:
Replies (2)
-
@khobochka@mastodon.social 2024-12-27 14:42
@kurio@sunny.garden it's heartbreaking that people who run human-centric infra such as personal and federated servers, which is hard enough as it is, have to make an additional inhuman effort to fight off an army of corporate cloud-scale bullshit-generating lawnmowers :sadness: 😡
-
@drwho@hackers.town 2024-12-28 18:21
@kurio@sunny.garden @khobochka@mastodon.social Because you had the audacity to add them to the file.