you are viewing a single comment's thread
view the rest of the comments
[–] 11 points 7 months ago (1 child)

I have 3gb of space to share. Are there 150 other people like me that want to do some distributed hosting? What technology can handle this?

  • source
  • hideshow 2 child comments
  • [–] 20 points 7 months ago (1 child)

    Torrents manage this without any extra tech. Just grab the .torrent file, and only select the files you have space for. Download them then seed, and get your 150 friends to do different files. If I then go to download a file that's in your batch, the download will happen from your server (and whoever else is seeding these files), and if I go to download a file that's on one of your 150 others' server it'll download from there.

  • source
  • parent
  • hideshow 2 child comments
  • [–] -2 points 7 months ago* (last edited 7 months ago) (1 child)

    Yes, almost. But i want it to seem like i have all 400tb on my 3tb drive. I want the cache to handle downloads automatically and I want an even spread of files so that none get lost.

    Torrents give me:

    • Chunking
    • Redundancy via multiple seeders
    • Partial downloads

    But they do not give me:

    • A unified filesystem view
    • Automatic caching & eviction
    • Guarantees that every file stays available
    • User side load balancing or placement control
    • A way to say “this file must exist on N peers”

    Maybe I should be typing this into a LLM.

    Edit: ChatGPT is suggesting an IPFS Cluster

    Edit 2: If the torrents stays active I can remove some requirements

  • source
  • parent
  • hideshow 2 child comments
  • [–] 4 points 7 months ago (1 child)

    Ahh fair enough! Yeah, not sure about all that.

    A very long time ago I remember there being FUSE filesystems that allow you to mount a .torrent like a network drive. I have no idea if these are still kicking though. Still doesn't provide all of your extra bullet points but might be a good start to the rabbit hole

  • source
  • parent
  • hideshow 2 child comments