the-distro/infra

Fork 5

WIP: single node Ceph on bm-5 #157

Draft

raito wants to merge 2 commits from single-node-ceph into main

raito commented

2024-12-23 22:22:52 +00:00

Owner

This provisions a single node Ceph on bm-5 with a RGW gateway.

Most of this PR is automation and storage architecture design, that is:

3 partitions per NVMe device: 2 partitions for 2 OSDs on which various indexes and metadata will be put for the RGW.
1 disk per HDD: 1 disk par OSD on which the bulk data will be put for the RGW.
HTTPS frontends with NGINX caching which spills on the 3rd NVMe partition.

Sizing is still yet-to-be decided, but this should allow multi-tiering for the caches. Open to debate the design, this is a first proposal.

I plan to have copies=2 for cache data and copies=3 for FOD information.

This provisions a single node Ceph on bm-5 with a RGW gateway. Most of this PR is automation and storage architecture design, that is: - 3 partitions per NVMe device: 2 partitions for 2 OSDs on which various indexes and metadata will be put for the RGW. - 1 disk per HDD: 1 disk par OSD on which the bulk data will be put for the RGW. - HTTPS frontends with NGINX caching which spills on the 3rd NVMe partition. Sizing is still yet-to-be decided, but this should allow multi-tiering for the caches. Open to debate the design, this is a first proposal. I plan to have copies=2 for cache data and copies=3 for FOD information.

raito added 2 commits 2024-12-23 22:22:59 +00:00

feat(services/ceph): init 36290942ea

This initialize our Ceph cluster module.

This relies on nixpkgs work
.
This takes inspiration from
https://gist.github.com/nh2/13425a1f18b4c1ce82edb63c10b163c9
for some of the convergence logic.

Finally, it implements a quite ambitious workload-specific module for
our needs.

Signed-off-by: Raito Bezarius <masterancpp@gmail.com>

feat(services/baremetal/storage): use our Ceph module fba720abdb

Signed-off-by: Raito Bezarius <masterancpp@gmail.com>

This pull request is marked as a work in progress.

This branch is out-of-date with the base branch

View command line instructions

Checkout

From your project repository, check out a new branch and test the changes.

git fetch -u origin single-node-ceph:single-node-ceph

git checkout single-node-ceph

Merge

Merge the changes and update on Forgejo.

Warning: The "Autodetect manual merge" setting is not enabled for this repository, you will have to mark this pull request as manually merged afterwards.

git checkout main

git merge --no-ff single-node-ceph

git checkout single-node-ceph

git rebase main

git checkout main

git merge --ff-only single-node-ceph

git checkout single-node-ceph

git rebase main

git checkout main

git merge --no-ff single-node-ceph

git checkout main

git merge --squash single-node-ceph

git checkout main

git merge --ff-only single-node-ceph

git checkout main

git merge single-node-ceph

git push origin main

No reviewers

No milestone

No project

No assignees

1 participant

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: the-distro/infra#157

No description provided.