Post #2280350
2026-04-19 03:42 UTC
Replies (3)
-
@AlanJP@mastodon.social 2026-04-19 07:27
@grimmy@mastodon.social Have you looked at Iocaine? I think it's safe to say that @algernon@come-from.mad-scientist.club (the creator of iocaine) is passionate about stopping AI crawlers. https://iocaine.madhouse-project.org
-
@alexia@shrimp.starlightnet.work 2026-04-19 08:02
@grimmy@mastodon.social I can highly recommend Iocaine. Can be plugged into Caddy as a template (such that you can just import iocaine on your desired service), the default config is powerful enough to block a lot already but there is a more powerful config maintained by the developer as well. I've been using it to keep scrapers away from upstream resources which are heavier to serve, and poisoning any scrapers with markov-generated garbage :)
-
@gerowen@mastodon.social 2026-04-19 09:24
@grimmy@mastodon.social I added some filters to my Apache config to block certain user agent strings, and added a Fail2Ban jail/filter to block the IP if it has a certain user agent string. This isn't perfect though as the user agents can change, or they can just lie, so I also installed Anubis as an additional reverse proxy in front of my web services. https://github.com/TecharoHQ/anubis