the-distro/infra
8
1
Fork 8
Code Issues 40 Pull requests 8 Projects Releases Packages Wiki Activity Actions

WIP: hv0{1,2}-{lix,floral}: init #237

Closed
raito wants to merge 12 commits from hyp01 into main
pull from: hyp01
merge into: the-distro:main
Conversation 2 Commits 12 Files changed 19 +2315 -42
raito commented 2025-07-18 01:02:24 +00:00
Owner
Copy link

3 hypervisors gets introduced.

2 in EU (France & Germany), 1 in the US (SEA01 location).

Planned usecases:

  • Migration of fragile Lix services to the hypervisor.
  • Migration of Digital Ocean (expensive) services to the hypervisor (lix.systems being the last one to move).
  • Increased redundancy.
  • Services that can afford to be high latency to EU and are lacking capacity in the EU continent.
  • Services that need to be low latency on the American continent (e.g. Lix's Gerrit or Lix's S3).

Remaining actions:

  • redesign the hypervisor abstraction: maybe it should stay away from the baremetal abstraction?
  • add microvm.nix or another hypervisor technology
  • macvtap configuration
  • configure the data disks with ZFS or similar.
  • add some abstraction to boot VMs easily.

Design proposals:

  • Public reverse proxy service (all other VMs have IPv6-only and PROXY PROTOCOL to avoid dealing with NAT?)
  • Explore snapshots under microvm.nix (if chosen)
  • Explore live migration under microvm.nix (if chosen)
3 hypervisors gets introduced. 2 in EU (France & Germany), 1 in the US (SEA01 location). Planned usecases: - Migration of fragile Lix services to the hypervisor. - Migration of Digital Ocean (expensive) services to the hypervisor (lix.systems being the last one to move). - Increased redundancy. - Services that can afford to be high latency to EU and are lacking capacity in the EU continent. - Services that need to be low latency on the American continent (e.g. Lix's Gerrit or Lix's S3). Remaining actions: - redesign the hypervisor abstraction: maybe it should stay away from the baremetal abstraction? - add microvm.nix *or* another hypervisor technology - macvtap configuration - configure the data disks with ZFS or similar. - add some abstraction to boot VMs easily. Design proposals: - Public reverse proxy service (all other VMs have IPv6-only and PROXY PROTOCOL to avoid dealing with NAT?) - Explore snapshots under microvm.nix (if chosen) - Explore live migration under microvm.nix (if chosen)
This is in preparation to receive the R440.

Signed-off-by: Raito Bezarius <masterancpp@gmail.com>
Now we have more than one host platform, let's generalize the hardware
logic to support the split and factorize things.

The networking configuration could be improved but that's a work for
later.

Signed-off-by: Raito Bezarius <masterancpp@gmail.com>
Signed-off-by: Raito Bezarius <masterancpp@gmail.com>
raito changed title from hypervisor01: init to WIP: hypervisor01: init 2025-07-18 02:27:50 +00:00
raito changed title from WIP: hypervisor01: init to WIP: hv0{1,2}-{lix,floral}: init 2025-07-25 00:37:15 +00:00 
[root@test01:~]# systemd-analyze time
Startup finished in 206ms (kernel) + 3.371s (initrd) + 2.307s (userspace) = 5.885s
multi-user.target reached after 2.294s in userspace.

Signed-off-by: Raito Bezarius <masterancpp@gmail.com>
raito commented 2025-08-22 00:05:44 +00:00
Author
Owner
Copy link

superseded by #269.

superseded by #269.
raito closed this pull request 2025-08-22 00:05:44 +00:00
raito commented 2025-08-22 02:03:18 +00:00
Author
Owner
Copy link

superseded by #271.

superseded by https://git.lix.systems/the-distro/infra/pulls/271.

Pull request closed

Please reopen this pull request to perform a merge.
Sign in to join this conversation.
Reviewers
No reviewers
Labels
Clear labels   
Compat/Breaking

Breaking change that won't be backward compatible

  
Difficulty
Architectural
Requires changes in multiple pieces of the stack: the Nix interpreter, etc.

  
Difficulty
Easy
Infrastructure beginner friendly tasks

  
Difficulty
Hard
Requires prior knowledge, research and design

  
Help Wanted

Looking for a first task to pick? This one is looking for somefew to do it as well!

  
Kind
Bug
Something is not working

  
Kind
Documentation
Documentation changes

  
Kind
Enhancement
Improve existing functionality

  
Kind
Feature
New functionality

  
Kind
Testing
Issue or pull request related to testing

  
Priority
Critical
The priority is critical

  
Priority
High
The priority is high

  
Priority
Low
The priority is low

  
Priority
Medium
The priority is medium

  
Reviewed
Confirmed
Issue has been confirmed

  
Reviewed
Duplicate
This issue or pull request already exists

  
Reviewed
Invalid
Invalid issue

  
Reviewed
Won't Fix
This issue won't be fixed

  
Security

This is a security issue

  
Silenced Alert

This issue was created to track a silenced alert which needs remediation work.

  
Status
Abandoned
Somebody has started to work on this but abandoned work

  
Status
Blocked
Something is blocking this issue or pull request

  
Status
Need More Info
Feedback is required to reproduce issue or to continue work

  
Status
Postponed
We can do this later

  
Tracking Issue

Umbrella issue of many things at the same time

No labels
Compat/Breaking
Difficulty
Architectural
Difficulty
Easy
Difficulty
Hard
Help Wanted
Kind
Bug
Kind
Documentation
Kind
Enhancement
Kind
Feature
Kind
Testing
Priority
Critical
Priority
High
Priority
Low
Priority
Medium
Reviewed
Confirmed
Reviewed
Duplicate
Reviewed
Invalid
Reviewed
Won't Fix
Security
Silenced Alert
Status
Abandoned
Status
Blocked
Status
Need More Info
Status
Postponed
Tracking Issue
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: the-distro/infra#237
No description provided.
Delete branch "hyp01"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?