[Long Term] Deduplicating castore-based backend #6

Open
opened 2024-08-31 15:56:59 +00:00 by raito · 0 comments
Owner

Currently, users are expected to go directly to the S3 to download the stuff.

As Tvix is used in this project, we can be smarter:

  • perform a deduplicating castore mirroring by interposing a castore on our object store backend
  • offer a web server that will handle dumb downloads

For smart clients, it's unclear to me if ISOs chunks well, but it could be fascinating to say "use this weird program to download this 1GiB ISO by exchanging only 300MiB".

Currently, users are expected to go directly to the S3 to download the stuff. As Tvix is used in this project, we can be smarter: - perform a deduplicating castore mirroring by interposing a castore on our object store backend - offer a web server that will handle dumb downloads For smart clients, it's unclear to me if ISOs chunks well, but it could be fascinating to say "use this weird program to download this 1GiB ISO by exchanging only 300MiB".
Sign in to join this conversation.
No labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: the-distro/channel-scripts#6
No description provided.