Post #4363802

2026-08-03 20:42 UTC

@ariadne@social.treehouse.systems @whitequark@social.treehouse.systems It's unfortunate for everyone, as it makes it very hard to block.

Replies (2)

@JessTheUnstill@infosec.exchange 2026-08-03 20:43

May the whole corporation Bright Data rot in piss. @rl_dane@polymaths.social @ariadne@social.treehouse.systems @whitequark@social.treehouse.systems

Open ##4363801
@algernon@come-from.mad-scientist.club 2026-08-04 07:24

@rl_dane@polymaths.social @ariadne@social.treehouse.systems @whitequark@social.treehouse.systems 'tis not very hard, because the bots are dumb. Serve identifiable bots garbage, with poisoned urlsAnything that hits a poisoned url gets 12 hours on the firewall. TVs gone! You see, most bots follow a crawling queue. Fill it with urls you can identify, and you can IP ban them on first hit, regardless of how well they try to hide. This got me down from 100mill requests/day to 3mill (could go below 1m, if I blocked more aggressively, but I want to keep their queues poisoned). Poisoning a model is hard. But poisoning crawler queues is trivial, and makes 'em easy to block. Fuck Blright Data & its ilk though.

Open ##4372822