It's hard to overstate how useful it is to be able to watch a web archiving crawler do its work (the actual browser windows) while also being able to inspect, edit and click on the the queue of URLs yet to be crawled. Maybe there are other solutions to this, but I've yet to see any software do better at this than @webrecorder@digipres.club's Browsertrix https://browsertrix.com. I've found it's especially important when you are using a browser "profile" to be able to crawl otherwise unavailable content.