de02c833d0
Merge pull request 'better gerrit integration' ( #5 ) from better-gerrit into gerrit
...
Reviewed-on: #5
2024-03-11 07:57:50 -06:00
5cdef7efb6
fix status reporting to gerrit
...
also adjust labels from split verified to single verified, split labels
were only useful during the pre-ci hours
2024-03-11 14:44:09 +01:00
51f7b52149
pre-filter drv_info into all_deps
...
otherwise failure reporting is *enormous* with the entirety of a full
derivation info dump in there
2024-03-11 13:07:35 +01:00
13a67b483a
fix interrupt()
...
can't interrupt with things to interrupt. this is technically duplicated
information but keeping parts of the code close to Trigger seems useful.
2024-03-11 13:05:12 +01:00
9933971ab0
re-enable the gerrit status reporter
2024-03-11 09:06:29 +01:00
29a2ef63e2
show hydra job count in trigger step
...
previously we immediately triggered all jobs, now we no longer do.
showing the total count at least somewhere is nice to have a rough
indication of how much longer a build may still need to run.
2024-03-11 09:05:28 +01:00
9a15348984
Fix up a few loose ends
2024-03-11 08:08:55 +01:00
4d73275123
Add build result tracking, schedule newly available builds
2024-03-11 08:08:53 +01:00
28ca39af25
WIP: Replace Trigger with custom logic
2024-03-11 08:06:37 +01:00
e9874c3d98
wip: dependency-tracked build triggering
2024-03-11 07:53:56 +01:00
f869b52a8d
use build-local gc-root directory
...
without this two builds can interfere with each other if:
- builds 1 and 2 start
- build 1 is starved of workers
- build 2 finishes, removes the shared gcroots directory
- gc runs
- build 1 schedules more builds whose .drvs have now been removed
using a dedicated directory for each build fixes this.
we now also need to set alwaysRun on the cleanup command or we risk
littering the system with stale gc roots when a build fails.
2024-03-11 06:48:41 +01:00
156e6e3dea
remove skipped-builds builder
...
run all of them on the normal build worker. this significantly
simplifies the overall scheduler/builder config and removes a
triplication of possible builds paths.
2024-03-11 06:27:32 +01:00
753df8e340
remove cachix
...
we aren't using it and it's somewhat in the way of our efforts to
improve scheduling and stuff.
2024-03-11 06:26:39 +01:00
0b2545b036
remove unused GitWithRetry
2024-03-11 06:26:39 +01:00
fdfeef8ad4
remove retry logic
...
retries don't help us very much, in fact they mostly hurt by repeating
builds that failed for non-transient reasons. retries could help with
workers dropping while running a build, but those rare cases are better
to restart manually than to pend at least twice the ci time for commits
that simply do not build cleanly.
2024-03-11 06:26:38 +01:00
e1dfa0e545
Remove cachix from dependencies
...
The rest of the Cachix infrastructure is intact. For now.
2024-03-10 13:03:16 +00:00
ec2ef903ab
use .#hydraJobs rather than .#checks
2024-03-08 23:28:49 +00:00
c487ada514
review callback: Set labels, render list of failed checks in reporter
2024-03-07 04:40:58 +00:00
18d537e5d4
nix/coordinator(reporting): re-enable reviewCB, disable summaryCB, skip evaluations
...
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-04 20:50:12 +01:00
322944f8d1
nix/coordinator(reporting): disable startCB and reviewCB
...
excessive noise.
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-04 20:37:13 +01:00
9a67a1f2cc
nix/coordinator: enable reporting to Gerrit
...
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-03 02:58:25 +01:00
2bcc0ee4e9
nix/coordinator: hardcode remaining github properties to lix
...
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 23:22:36 +01:00
3895b90493
nix/coordinator: disable reporter
...
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 23:07:36 +01:00
670a1d1281
nix/coordinator: fix repourl
...
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 23:07:36 +01:00
e92a2225f7
nix/coordinator: use a special key for service account
...
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 23:07:33 +01:00
94e3d7aeda
nix/coordinator: support specific private SSH keys
...
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 23:07:33 +01:00
9f98533dd7
nix/worker: rename master → coordinator
...
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 22:09:56 +01:00
5a8ab145e6
buildbot: add repourl
...
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 22:09:56 +01:00
7ad9c1a378
nix/coordinator: introduce OAuth2 client secret
...
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 22:09:56 +01:00
81bd57ffac
nix/coordinator: instantiate the GerritNixConfigurator
...
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 22:09:56 +01:00
101612eb70
nix/coordinator: fix various errors
...
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 22:09:56 +01:00
7ace78107c
buildbot: further Gerritification
...
- `BuildTrigger` still depends on `github` properties.
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 22:09:56 +01:00
5f7b3e0cdb
buildbot: instantiate fully LixSystemsOAuth2
...
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 22:09:56 +01:00
beea96da2c
nix/coordinator: simplify the module
...
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 18:45:19 +01:00
329d9dd6d4
nix/coordinator: rename it into what this really is
...
No need to use legacy names.
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 18:45:19 +01:00
acfd225e6d
buildbot/__init__.py: rework the file for gerrit usecase, our oauth2 instance
...
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 18:45:19 +01:00
github-actions[bot]
7a44c9f71c
flake.lock: Update
...
Flake lock file updates:
• Updated input 'nixpkgs':
'github:Nixos/nixpkgs/6d8aba54f305eb12a57d92ad4eaeb42049961f19' (2024-02-24)
→ 'github:Nixos/nixpkgs/96990c69fd59e807cee8ff874d0526c70dffdf8f' (2024-02-28)
• Updated input 'treefmt-nix':
'github:numtide/treefmt-nix/36fd6923c122a983bc3915692e6cb3ff341ef083' (2024-02-23)
→ 'github:numtide/treefmt-nix/e497a9ddecff769c2a7cbab51e1ed7a8501e7a3a' (2024-02-25)
2024-02-29 01:34:25 +00:00
github-actions[bot]
3e67b49a18
flake.lock: Update
...
Flake lock file updates:
• Updated input 'nixpkgs':
'github:Nixos/nixpkgs/591f9cbebeef5dfdcb24997a3069d7f29c365ab9' (2024-02-21)
→ 'github:Nixos/nixpkgs/6d8aba54f305eb12a57d92ad4eaeb42049961f19' (2024-02-24)
• Updated input 'treefmt-nix':
'github:numtide/treefmt-nix/e504621290a1fd896631ddbc5e9c16f4366c9f65' (2024-02-19)
→ 'github:numtide/treefmt-nix/36fd6923c122a983bc3915692e6cb3ff341ef083' (2024-02-23)
2024-02-25 01:40:35 +00:00
github-actions[bot]
271610c98e
flake.lock: Update
...
Flake lock file updates:
• Updated input 'nixpkgs':
'github:Nixos/nixpkgs/28d6a724f54085377102db7c3278ba82a0a5255f' (2024-02-17)
→ 'github:Nixos/nixpkgs/591f9cbebeef5dfdcb24997a3069d7f29c365ab9' (2024-02-21)
• Updated input 'treefmt-nix':
'github:numtide/treefmt-nix/ac599dab59a66304eb511af07b3883114f061b9d' (2024-02-07)
→ 'github:numtide/treefmt-nix/e504621290a1fd896631ddbc5e9c16f4366c9f65' (2024-02-19)
2024-02-22 01:35:00 +00:00
github-actions[bot]
064e545c12
flake.lock: Update
...
Flake lock file updates:
• Updated input 'nixpkgs':
'github:Nixos/nixpkgs/4dec2a6e52b5d910b428468680707f7f73a1219f' (2024-02-14)
→ 'github:Nixos/nixpkgs/28d6a724f54085377102db7c3278ba82a0a5255f' (2024-02-17)
2024-02-18 01:39:52 +00:00
github-actions[bot]
b1dd56c5b5
flake.lock: Update
...
Flake lock file updates:
• Updated input 'nixpkgs':
'github:Nixos/nixpkgs/8f9789aa7fe8fab4cc1bb41b7c7331cac9a36bbf' (2024-02-10)
→ 'github:Nixos/nixpkgs/4dec2a6e52b5d910b428468680707f7f73a1219f' (2024-02-14)
2024-02-15 01:36:35 +00:00
github-actions[bot]
f0a9986934
flake.lock: Update
...
Flake lock file updates:
• Updated input 'nixpkgs':
'github:Nixos/nixpkgs/5ef42fcd84b2baa16f43554f1c1f1d614e23ef9a' (2024-02-07)
→ 'github:Nixos/nixpkgs/8f9789aa7fe8fab4cc1bb41b7c7331cac9a36bbf' (2024-02-10)
2024-02-11 01:41:20 +00:00
github-actions[bot]
b985888b5c
flake.lock: Update
...
Flake lock file updates:
• Updated input 'nixpkgs':
'github:Nixos/nixpkgs/4f301350dacb4eb0a93578ef3b07c8a996c777e7' (2024-02-03)
→ 'github:Nixos/nixpkgs/5ef42fcd84b2baa16f43554f1c1f1d614e23ef9a' (2024-02-07)
• Updated input 'treefmt-nix':
'github:numtide/treefmt-nix/c6153c2a3ff4c38d231e3ae99af29b87f1df5901' (2024-01-28)
→ 'github:numtide/treefmt-nix/ac599dab59a66304eb511af07b3883114f061b9d' (2024-02-07)
2024-02-08 01:35:59 +00:00
github-actions[bot]
62974e991d
flake.lock: Update
...
Flake lock file updates:
• Updated input 'flake-parts':
'github:hercules-ci/flake-parts/60c614008eed1d0383d21daac177a3e036192ed8' (2024-01-29)
→ 'github:hercules-ci/flake-parts/b253292d9c0a5ead9bc98c4e9a26c6312e27d69f' (2024-02-01)
• Updated input 'nixpkgs':
'github:Nixos/nixpkgs/632751bf0ceeefc74af7a9d2335ea923ad9c831a' (2024-01-31)
→ 'github:Nixos/nixpkgs/4f301350dacb4eb0a93578ef3b07c8a996c777e7' (2024-02-03)
2024-02-04 01:40:25 +00:00
github-actions[bot]
49fd61bd99
flake.lock: Update
...
Flake lock file updates:
• Updated input 'flake-parts':
'github:hercules-ci/flake-parts/07f6395285469419cf9d078f59b5b49993198c00' (2024-01-11)
→ 'github:hercules-ci/flake-parts/60c614008eed1d0383d21daac177a3e036192ed8' (2024-01-29)
• Updated input 'nixpkgs':
'github:Nixos/nixpkgs/7ac72b3ee2af9bab80d66addd9b237277cc975c5' (2024-01-26)
→ 'github:Nixos/nixpkgs/632751bf0ceeefc74af7a9d2335ea923ad9c831a' (2024-01-31)
• Updated input 'treefmt-nix':
'github:numtide/treefmt-nix/fbef7c773be115ed33f37e97256a9e8f6312b925' (2024-01-26)
→ 'github:numtide/treefmt-nix/c6153c2a3ff4c38d231e3ae99af29b87f1df5901' (2024-01-28)
2024-02-01 01:40:13 +00:00
github-actions[bot]
65528353e5
flake.lock: Update
...
Flake lock file updates:
• Updated input 'nixpkgs':
'github:Nixos/nixpkgs/5cd2baa57a9ff2d84f2615700434fa04f3067fdb' (2024-01-24)
→ 'github:Nixos/nixpkgs/7ac72b3ee2af9bab80d66addd9b237277cc975c5' (2024-01-26)
• Updated input 'treefmt-nix':
'github:numtide/treefmt-nix/23f601bfdef75e21fe8854e24a043bb642201794' (2024-01-24)
→ 'github:numtide/treefmt-nix/fbef7c773be115ed33f37e97256a9e8f6312b925' (2024-01-26)
2024-01-28 01:41:22 +00:00
github-actions[bot]
4cbe42c048
flake.lock: Update
...
Flake lock file updates:
• Updated input 'nixpkgs':
'github:Nixos/nixpkgs/b4ee3c3cc4b63315702e09858f6b517bdd249b3f' (2024-01-19)
→ 'github:Nixos/nixpkgs/5cd2baa57a9ff2d84f2615700434fa04f3067fdb' (2024-01-24)
• Updated input 'treefmt-nix':
'github:numtide/treefmt-nix/8cd95da6c30852adb2a06c4b6bdacfe8b64a0a35' (2024-01-19)
→ 'github:numtide/treefmt-nix/23f601bfdef75e21fe8854e24a043bb642201794' (2024-01-24)
2024-01-25 01:46:29 +00:00
github-actions[bot]
6823a26b26
flake.lock: Update
...
Flake lock file updates:
• Updated input 'nixpkgs':
'github:Nixos/nixpkgs/cc3ab0e45687d15cb21663a95f5a53a05abd39e4' (2024-01-16)
→ 'github:Nixos/nixpkgs/b4ee3c3cc4b63315702e09858f6b517bdd249b3f' (2024-01-19)
• Updated input 'treefmt-nix':
'github:numtide/treefmt-nix/04f25d7bec9fb29d2c3bacaa48a3304840000d36' (2024-01-07)
→ 'github:numtide/treefmt-nix/8cd95da6c30852adb2a06c4b6bdacfe8b64a0a35' (2024-01-19)
2024-01-21 01:49:36 +00:00
github-actions[bot]
336f9c504e
flake.lock: Update
...
Flake lock file updates:
• Updated input 'flake-parts':
'github:hercules-ci/flake-parts/88a2cd8166694ba0b6cb374700799cec53aef527' (2024-01-01)
→ 'github:hercules-ci/flake-parts/07f6395285469419cf9d078f59b5b49993198c00' (2024-01-11)
• Updated input 'nixpkgs':
'github:Nixos/nixpkgs/5fcfdd4990ab907895fe9bcb1e2e4083d92ca670' (2024-01-10)
→ 'github:Nixos/nixpkgs/cc3ab0e45687d15cb21663a95f5a53a05abd39e4' (2024-01-16)
2024-01-18 01:43:15 +00:00
3c1e2c0e76
cleanup drv gcroots after a build
2024-01-15 13:17:19 +00:00
