Post #3474263
2026-06-28 11:01 UTC
@doctormo@floss.social
@Dragon@toast.dragon2611.net
> scrapers ... don't respect site owners wishes
Though they do respect a magic incantations in the meta headers:
```
```
(Tested on my small shared hosting that came cheap but with 1TB/mo limit what scrappers started to suck in less than a day.)
@drgeo@mamot.fr
@algernon@journa.host
Replies (1)
-
@Dragon@toast.dragon2611.net 2026-06-28 11:11
@ohir@social.vivaldi.net @doctormo@floss.social @drgeo@mamot.fr @algernon@journa.host Interesting guess they don't want to ingest AI generated "content"