Post #406621

Curl to see if a site allows scraping. wget to mirror entire site for offline viewing and lynx or w3m to read everything that was mirrored and navigate the site offline really good for html heavy sites javascript does not render but that is a good thing.