Post #4472958
2026-08-09 23:46 UTC
All that is to say, if it is possible to block crawlers at all, it seems the primary reason we have not all done so is because we are all holding ourselves hostage to the idea of future, human traffic.
And unfortunately, that arrangement is called an advertisement. (I find that as distasteful as you do, I promise).
And the more I think about it, the more absurd it seems that, say, a classic banner ad circa 1995 would contain all of a websites content, too.
What if one were to separate them?
Replies (1)
-
@Haste@mastodon.social 2026-08-09 23:48
The spark for this idea is the, I dunno what you call them but, the maze-traps that people use for LLM’s currently, which poison those systems by creating fake content. That’s clever and seems like a good start, but now you’ve got good stuff and bad living in the same place. It seems like it might create accessibility nightmares, or feed a real human garbage if it hits a false positive, or else just be circumvented as corporations get more greedy.