Post #2686042
2025-05-12 10:11 UTC
@tdp_org@mastodon.social does the filter just match known crawler user agents against their known origin networks?
Replies (1)
-
@tdp_org@mastodon.social 2025-05-12 10:49
@kfh@chaos.social Yeah, more or less. It identifies the crawler/bot via the user-agent string then validates that the source ASN is in the valid ASN list for that crawler. Not perfect but definitely reduces the spam!