Post #2725958

@aaron@chirp.zadzmo.org This... I like this... Seems like a fun way to test a web crawler, but that made me think about robots.txt. You could for instance disallow the way back machine from entering it, but allow for all others. Not sure in practice what that'd result in, but seems interesting.