Post #1846066

@palomakop I run Forgejo on a cheap VPS and the crawlers were there, but I decided that I don't need to have web frontend to the complete history, so I just serve 403 for browsing individual commits based on a URL pattern match and used to make the load rather low (they all tended to look into all the past revisions). Didn't even bother with Anubis, mostly because I was lazy to learn it and didn't want to wait for the challenges. I don't know why or when, but apparently they don't scrape me anymore? It used to be a constant stream in the logs (several in a second), now I see like one request in the 5 minutes. (Thank you for making me update my mental picture of how the bot abuse goes now!)