Post #1559016

@InsertUser @pietervdvn @osm_tech One of the most maddening things about all this is I go out of my way on all of my sites to provide a detailed sitemap and all of the link traversal hints to tell bots what links to not bother with because they give nothing of added value, and then the AI scrapers just go ahead and hammer everything en masse anyway, all to try to extract one last shred of additional information from my sites. I'm so sick of it.