Remove hydra-eval-jobs in favor of nix-eval-jobs #2

Merged
delroth merged 7 commits from nix-eval-jobs into main 2024-07-17 11:07:14 +00:00
Member

Still TODO:

  • Deprecating more of the "constituents" feature which we can't support with nix-eval-jobs (and isn't used on h.n.o anyway).
  • Finding a way to forbid IFD per-eval (h-e-j has a flag, n-e-j doesn't)

Future improvements: actually streaming the n-e-j results instead of parsing the whole output at once at the end!

Still TODO: - Deprecating more of the "constituents" feature which we can't support with nix-eval-jobs (and isn't used on h.n.o anyway). - ~~Finding a way to forbid IFD per-eval (h-e-j has a flag, n-e-j doesn't)~~ Future improvements: actually streaming the n-e-j results instead of parsing the whole output at once at the end!
delroth added 6 commits 2024-07-16 08:36:18 +00:00
For consistency with other Lix forks of Nix ecosystems projects, e.g.
nix-eval-jobs.
treewide: start removing tests related to constituents
Some checks failed
Test / tests (push) Waiting to run
Test / tests (pull_request) Has been cancelled
c7bc61762f
The feature cannot easily be ported to nix-eval-jobs since it requires
deep integration into the evaluator, and h.n.o doesn't use it. Later
more of this will be ripped out.
delroth force-pushed nix-eval-jobs from c7bc61762f to a4c2976c5d 2024-07-17 06:20:34 +00:00 Compare
delroth force-pushed nix-eval-jobs from a4c2976c5d to 370a4bf138 2024-07-17 06:32:40 +00:00 Compare
delroth added 1 commit 2024-07-17 10:20:49 +00:00
hydra-eval-jobset: incrementally ingest eval results
Some checks failed
Test / tests (push) Has been cancelled
Test / tests (pull_request) Has been cancelled
b0e9b4b2f9
nix-eval-jobs streams output, unlike hydra-eval-jobs. Now that we've
migrated, we can use this to:

1. Use less RAM by avoiding buffering a whole eval's worth of metadata
   into a Perl string and an array of JSON objects.
2. Make evals latency a bit lower by allowing the queue runner to start
   ingesting builds faster.
delroth changed title from WIP: Remove hydra-eval-jobs in favor of nix-eval-jobs to Remove hydra-eval-jobs in favor of nix-eval-jobs 2024-07-17 11:06:53 +00:00
delroth merged commit b0e9b4b2f9 into main 2024-07-17 11:07:14 +00:00
delroth deleted branch nix-eval-jobs 2024-07-17 11:07:14 +00:00
Sign in to join this conversation.
No reviewers
No labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: lix-project/hydra#2
No description provided.