Post #4306391

i know it's not entirely possible, but is there any way to make a web page (as a subpath on an existing domain or a new subdomain) that is relatively hidden from crawlers, including even regular search engines? i don't currently plan to link to it, though of course i can't stop anyone from doing that if they come across it. is robots.txt still better than nothing?