← Feed
@papiris@hachyderm.io
Post #852576
2026-02-08 10:14 UTC
I want to be part of a flat collective/network of folks / orgs working together to provide resilient e2ee data storage using free software.
Like a file backup / object storage federation of sorts.
I want it to be scalable, i.e. folks and orgs who have spare storage capacity can contribute this capacity to the collective, effectively increasing the collective's total storage capacity. The collective should gracefully handle nodes dropping off or quitting the collective, and re-joining.
The API should be well-known, preferably something like S3, so the collective/network easily integrates as a backend for existing software.
I think there should be some way to 'balance the books' so to speak, to avoid selfish behavior like a participant providing 3GiB of storage and using 3TiB.
The balancing can be in-software, e.g. each participant gets an identity which the software uses to identify how much the participant contributes and utilizes across all their nodes.
The balancing can also be out-of software, through a member system or similar.
Would be nice with a social aspect.
Is there already something like this?
What software would be good for building something like this?
@deuxfleurs would #garage fit this use case?
If I understand correctly, Garage can scale to many nodes in many locations/zones, but 3-4 zones (one of which can be a hot spare) is recommended. If a garage cluster consists of 50 zones with 150 nodes total, will chunks be spread across zones in a way that isn't limited by low-capacity zones? Does the total storage capacity of the cluster depend on whichever location has the least capacity?
Another option I found earlier is @peergos, but I'm fairly lacking in knowledge about the project. Being p2p, would that fit this use case better?
#techCollective #democracy #privacy #digitalIndependence #e2ee #anarchism #p2p
Replies (4)
-
@deuxfleurs@mastodon.tedomum.net @peergos@mastodon.social I asked whether Garage would suit this usecase, in the Garage matrix chat. LX kindly provided this reply (quoted with permission):
"""
Here would be the main limitations to doing so:
- Garage will not run very well with more than 20-30 nodes
- Each Garage node is a full admin of the cluster, so everyone sysadmin has to be 100% trusted
My suggestion would be to go with a two-tiered social structure: a small tighly-knit group of sysadmins that manage the service for a larger group of users (including their non-technical friends, etc)
"""
Open ##2192107
-
@papiris@hachyderm.io
Autonomi ticks many of your boxes (certainly the goals if not how you envisage it working). Anyone can contribute storage and in exchange use capacity for their own data storage. The good part is it's a simple download, the part folk may baulk at is it uses a token to provide the 'balance', a viable and sustainable model.
It's not ready yet, but you can try it, publish and view websites and try early apps - secure, e2ee, private etc.
See https://toast.happybeing.com
@deuxfleurs@mastodon.tedomum.net @peergos@mastodon.social
Open ##2192108
-
@papiris@hachyderm.io @deuxfleurs@mastodon.tedomum.net @peergos@mastodon.social
go for it
Open ##2192109
-
@deuxfleurs@mastodon.tedomum.net @peergos@mastodon.social @papiris@hachyderm.io Like a collectively owned storj?
Open ##2192110