Post #2092595

2026-05-03 17:14 UTC

Idly wondering how folks who are deep into personal web archiving (i.e. keeping full clones of pages or sites they&#39;ve bookmarked) handle sharing those snapshots with friends or the general public, especially in this age of abusive bot scrapers. Guessing the answer is &quot;keep it all behind lock and key, and deal with the friction that represents on both ends&quot;? Maybe some form of ephemeral/unguessable/unlisted sharing URL? (and obviously, bespoke tactics like Anubis.) I&#39;m putting the cart before the horse here, obviously, as I don&#39;t even have ArchiveBox or w/e set up yet 😅

Replies (4)

@SnoopJ@hachyderm.io 2026-05-03 17:18

@bitprophet@social.coop mine are all unlisted but it's not like I'm archiving entire sites, mostly just individual pages Feels like the same threat surface for abuse by scrapers, and if it became a problem I'd expand the context of my Anubis setup to have them fuck off (right now it only applies to my Gitea instance)

Open ##2693396
@mwinters@floss.social 2026-05-03 18:38

@bitprophet@social.coop I use SingleFile -> LinkWarden. If I want to share with someone I can just send them the file or upload it to a temporary URL. I don't have a use case where I want / need to share my entire personal archive. If I did, it would require login.

Open ##2693400
@jessamyn@glammr.us 2026-05-03 19:14

@bitprophet@social.coop I download it all and keep it on a hard drive at home.

Open ##2693406
@rlonstein@social.stonetools.tech 2026-05-03 19:42

@bitprophet@social.coop People are sharing them? * https://github.com/bit-r/monolith-website-download * https://github.com/yt-dlp/yt-dlp and just keep them in my docs directory...

Open ##2693407