Commit graph

227 commits

Author SHA1 Message Date
9933971ab0 re-enable the gerrit status reporter 2024-03-11 09:06:29 +01:00
29a2ef63e2 show hydra job count in trigger step
previously we immediately triggered all jobs, now we no longer do.
showing the total count at least somewhere is nice to have a rough
indication of how much longer a build may still need to run.
2024-03-11 09:05:28 +01:00
9a15348984 Fix up a few loose ends 2024-03-11 08:08:55 +01:00
4d73275123 Add build result tracking, schedule newly available builds 2024-03-11 08:08:53 +01:00
28ca39af25 WIP: Replace Trigger with custom logic 2024-03-11 08:06:37 +01:00
e9874c3d98 wip: dependency-tracked build triggering 2024-03-11 07:53:56 +01:00
f869b52a8d use build-local gc-root directory
without this two builds can interfere with each other if:

  - builds 1 and 2 start
  - build 1 is starved of workers
  - build 2 finishes, removes the shared gcroots directory
  - gc runs
  - build 1 schedules more builds whose .drvs have now been removed

using a dedicated directory for each build fixes this.

we now also need to set alwaysRun on the cleanup command or we risk
littering the system with stale gc roots when a build fails.
2024-03-11 06:48:41 +01:00
156e6e3dea remove skipped-builds builder
run all of them on the normal build worker. this significantly
simplifies the overall scheduler/builder config and removes a
triplication of possible builds paths.
2024-03-11 06:27:32 +01:00
753df8e340 remove cachix
we aren't using it and it's somewhat in the way of our efforts to
improve scheduling and stuff.
2024-03-11 06:26:39 +01:00
0b2545b036 remove unused GitWithRetry 2024-03-11 06:26:39 +01:00
fdfeef8ad4 remove retry logic
retries don't help us very much, in fact they mostly hurt by repeating
builds that failed for non-transient reasons. retries could help with
workers dropping while running a build, but those rare cases are better
to restart manually than to pend at least twice the ci time for commits
that simply do not build cleanly.
2024-03-11 06:26:38 +01:00
e1dfa0e545 Remove cachix from dependencies
The rest of the Cachix infrastructure is intact. For now.
2024-03-10 13:03:16 +00:00
ec2ef903ab use .#hydraJobs rather than .#checks 2024-03-08 23:28:49 +00:00
c487ada514 review callback: Set labels, render list of failed checks in reporter 2024-03-07 04:40:58 +00:00
18d537e5d4 nix/coordinator(reporting): re-enable reviewCB, disable summaryCB, skip evaluations
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-04 20:50:12 +01:00
322944f8d1 nix/coordinator(reporting): disable startCB and reviewCB
excessive noise.

Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-04 20:37:13 +01:00
9a67a1f2cc nix/coordinator: enable reporting to Gerrit
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-03 02:58:25 +01:00
2bcc0ee4e9 nix/coordinator: hardcode remaining github properties to lix
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 23:22:36 +01:00
3895b90493 nix/coordinator: disable reporter
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 23:07:36 +01:00
670a1d1281 nix/coordinator: fix repourl
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 23:07:36 +01:00
e92a2225f7 nix/coordinator: use a special key for service account
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 23:07:33 +01:00
94e3d7aeda nix/coordinator: support specific private SSH keys
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 23:07:33 +01:00
9f98533dd7 nix/worker: rename master → coordinator
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 22:09:56 +01:00
5a8ab145e6 buildbot: add repourl
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 22:09:56 +01:00
7ad9c1a378 nix/coordinator: introduce OAuth2 client secret
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 22:09:56 +01:00
81bd57ffac nix/coordinator: instantiate the GerritNixConfigurator
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 22:09:56 +01:00
101612eb70 nix/coordinator: fix various errors
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 22:09:56 +01:00
7ace78107c buildbot: further Gerritification
- `BuildTrigger` still depends on `github` properties.

Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 22:09:56 +01:00
5f7b3e0cdb buildbot: instantiate fully LixSystemsOAuth2
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 22:09:56 +01:00
beea96da2c nix/coordinator: simplify the module
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 18:45:19 +01:00
329d9dd6d4 nix/coordinator: rename it into what this really is
No need to use legacy names.

Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 18:45:19 +01:00
acfd225e6d buildbot/__init__.py: rework the file for gerrit usecase, our oauth2 instance
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 18:45:19 +01:00
github-actions[bot]
7a44c9f71c flake.lock: Update
Flake lock file updates:

• Updated input 'nixpkgs':
    'github:Nixos/nixpkgs/6d8aba54f305eb12a57d92ad4eaeb42049961f19' (2024-02-24)
  → 'github:Nixos/nixpkgs/96990c69fd59e807cee8ff874d0526c70dffdf8f' (2024-02-28)
• Updated input 'treefmt-nix':
    'github:numtide/treefmt-nix/36fd6923c122a983bc3915692e6cb3ff341ef083' (2024-02-23)
  → 'github:numtide/treefmt-nix/e497a9ddecff769c2a7cbab51e1ed7a8501e7a3a' (2024-02-25)
2024-02-29 01:34:25 +00:00
github-actions[bot]
3e67b49a18 flake.lock: Update
Flake lock file updates:

• Updated input 'nixpkgs':
    'github:Nixos/nixpkgs/591f9cbebeef5dfdcb24997a3069d7f29c365ab9' (2024-02-21)
  → 'github:Nixos/nixpkgs/6d8aba54f305eb12a57d92ad4eaeb42049961f19' (2024-02-24)
• Updated input 'treefmt-nix':
    'github:numtide/treefmt-nix/e504621290a1fd896631ddbc5e9c16f4366c9f65' (2024-02-19)
  → 'github:numtide/treefmt-nix/36fd6923c122a983bc3915692e6cb3ff341ef083' (2024-02-23)
2024-02-25 01:40:35 +00:00
github-actions[bot]
271610c98e flake.lock: Update
Flake lock file updates:

• Updated input 'nixpkgs':
    'github:Nixos/nixpkgs/28d6a724f54085377102db7c3278ba82a0a5255f' (2024-02-17)
  → 'github:Nixos/nixpkgs/591f9cbebeef5dfdcb24997a3069d7f29c365ab9' (2024-02-21)
• Updated input 'treefmt-nix':
    'github:numtide/treefmt-nix/ac599dab59a66304eb511af07b3883114f061b9d' (2024-02-07)
  → 'github:numtide/treefmt-nix/e504621290a1fd896631ddbc5e9c16f4366c9f65' (2024-02-19)
2024-02-22 01:35:00 +00:00
github-actions[bot]
064e545c12 flake.lock: Update
Flake lock file updates:

• Updated input 'nixpkgs':
    'github:Nixos/nixpkgs/4dec2a6e52b5d910b428468680707f7f73a1219f' (2024-02-14)
  → 'github:Nixos/nixpkgs/28d6a724f54085377102db7c3278ba82a0a5255f' (2024-02-17)
2024-02-18 01:39:52 +00:00
github-actions[bot]
b1dd56c5b5 flake.lock: Update
Flake lock file updates:

• Updated input 'nixpkgs':
    'github:Nixos/nixpkgs/8f9789aa7fe8fab4cc1bb41b7c7331cac9a36bbf' (2024-02-10)
  → 'github:Nixos/nixpkgs/4dec2a6e52b5d910b428468680707f7f73a1219f' (2024-02-14)
2024-02-15 01:36:35 +00:00
github-actions[bot]
f0a9986934 flake.lock: Update
Flake lock file updates:

• Updated input 'nixpkgs':
    'github:Nixos/nixpkgs/5ef42fcd84b2baa16f43554f1c1f1d614e23ef9a' (2024-02-07)
  → 'github:Nixos/nixpkgs/8f9789aa7fe8fab4cc1bb41b7c7331cac9a36bbf' (2024-02-10)
2024-02-11 01:41:20 +00:00
github-actions[bot]
b985888b5c flake.lock: Update
Flake lock file updates:

• Updated input 'nixpkgs':
    'github:Nixos/nixpkgs/4f301350dacb4eb0a93578ef3b07c8a996c777e7' (2024-02-03)
  → 'github:Nixos/nixpkgs/5ef42fcd84b2baa16f43554f1c1f1d614e23ef9a' (2024-02-07)
• Updated input 'treefmt-nix':
    'github:numtide/treefmt-nix/c6153c2a3ff4c38d231e3ae99af29b87f1df5901' (2024-01-28)
  → 'github:numtide/treefmt-nix/ac599dab59a66304eb511af07b3883114f061b9d' (2024-02-07)
2024-02-08 01:35:59 +00:00
github-actions[bot]
62974e991d flake.lock: Update
Flake lock file updates:

• Updated input 'flake-parts':
    'github:hercules-ci/flake-parts/60c614008eed1d0383d21daac177a3e036192ed8' (2024-01-29)
  → 'github:hercules-ci/flake-parts/b253292d9c0a5ead9bc98c4e9a26c6312e27d69f' (2024-02-01)
• Updated input 'nixpkgs':
    'github:Nixos/nixpkgs/632751bf0ceeefc74af7a9d2335ea923ad9c831a' (2024-01-31)
  → 'github:Nixos/nixpkgs/4f301350dacb4eb0a93578ef3b07c8a996c777e7' (2024-02-03)
2024-02-04 01:40:25 +00:00
github-actions[bot]
49fd61bd99 flake.lock: Update
Flake lock file updates:

• Updated input 'flake-parts':
    'github:hercules-ci/flake-parts/07f6395285469419cf9d078f59b5b49993198c00' (2024-01-11)
  → 'github:hercules-ci/flake-parts/60c614008eed1d0383d21daac177a3e036192ed8' (2024-01-29)
• Updated input 'nixpkgs':
    'github:Nixos/nixpkgs/7ac72b3ee2af9bab80d66addd9b237277cc975c5' (2024-01-26)
  → 'github:Nixos/nixpkgs/632751bf0ceeefc74af7a9d2335ea923ad9c831a' (2024-01-31)
• Updated input 'treefmt-nix':
    'github:numtide/treefmt-nix/fbef7c773be115ed33f37e97256a9e8f6312b925' (2024-01-26)
  → 'github:numtide/treefmt-nix/c6153c2a3ff4c38d231e3ae99af29b87f1df5901' (2024-01-28)
2024-02-01 01:40:13 +00:00
github-actions[bot]
65528353e5 flake.lock: Update
Flake lock file updates:

• Updated input 'nixpkgs':
    'github:Nixos/nixpkgs/5cd2baa57a9ff2d84f2615700434fa04f3067fdb' (2024-01-24)
  → 'github:Nixos/nixpkgs/7ac72b3ee2af9bab80d66addd9b237277cc975c5' (2024-01-26)
• Updated input 'treefmt-nix':
    'github:numtide/treefmt-nix/23f601bfdef75e21fe8854e24a043bb642201794' (2024-01-24)
  → 'github:numtide/treefmt-nix/fbef7c773be115ed33f37e97256a9e8f6312b925' (2024-01-26)
2024-01-28 01:41:22 +00:00
github-actions[bot]
4cbe42c048 flake.lock: Update
Flake lock file updates:

• Updated input 'nixpkgs':
    'github:Nixos/nixpkgs/b4ee3c3cc4b63315702e09858f6b517bdd249b3f' (2024-01-19)
  → 'github:Nixos/nixpkgs/5cd2baa57a9ff2d84f2615700434fa04f3067fdb' (2024-01-24)
• Updated input 'treefmt-nix':
    'github:numtide/treefmt-nix/8cd95da6c30852adb2a06c4b6bdacfe8b64a0a35' (2024-01-19)
  → 'github:numtide/treefmt-nix/23f601bfdef75e21fe8854e24a043bb642201794' (2024-01-24)
2024-01-25 01:46:29 +00:00
github-actions[bot]
6823a26b26 flake.lock: Update
Flake lock file updates:

• Updated input 'nixpkgs':
    'github:Nixos/nixpkgs/cc3ab0e45687d15cb21663a95f5a53a05abd39e4' (2024-01-16)
  → 'github:Nixos/nixpkgs/b4ee3c3cc4b63315702e09858f6b517bdd249b3f' (2024-01-19)
• Updated input 'treefmt-nix':
    'github:numtide/treefmt-nix/04f25d7bec9fb29d2c3bacaa48a3304840000d36' (2024-01-07)
  → 'github:numtide/treefmt-nix/8cd95da6c30852adb2a06c4b6bdacfe8b64a0a35' (2024-01-19)
2024-01-21 01:49:36 +00:00
github-actions[bot]
336f9c504e flake.lock: Update
Flake lock file updates:

• Updated input 'flake-parts':
    'github:hercules-ci/flake-parts/88a2cd8166694ba0b6cb374700799cec53aef527' (2024-01-01)
  → 'github:hercules-ci/flake-parts/07f6395285469419cf9d078f59b5b49993198c00' (2024-01-11)
• Updated input 'nixpkgs':
    'github:Nixos/nixpkgs/5fcfdd4990ab907895fe9bcb1e2e4083d92ca670' (2024-01-10)
  → 'github:Nixos/nixpkgs/cc3ab0e45687d15cb21663a95f5a53a05abd39e4' (2024-01-16)
2024-01-18 01:43:15 +00:00
3c1e2c0e76 cleanup drv gcroots after a build 2024-01-15 13:17:19 +00:00
dependabot[bot]
25e583ea9e Bump cachix/install-nix-action from 24 to 25
Bumps [cachix/install-nix-action](https://github.com/cachix/install-nix-action) from 24 to 25.
- [Release notes](https://github.com/cachix/install-nix-action/releases)
- [Commits](https://github.com/cachix/install-nix-action/compare/v24...v25)

---
updated-dependencies:
- dependency-name: cachix/install-nix-action
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-01-15 01:50:37 +00:00
github-actions[bot]
2958fd6dea flake.lock: Update
Flake lock file updates:

• Updated input 'nixpkgs':
    'github:Nixos/nixpkgs/0fa5a936f203acc1b11ed20fe002320944a8363b' (2024-01-05)
  → 'github:Nixos/nixpkgs/5fcfdd4990ab907895fe9bcb1e2e4083d92ca670' (2024-01-10)
• Updated input 'treefmt-nix':
    'github:numtide/treefmt-nix/e434da615ef74187ba003b529cc72f425f5d941e' (2024-01-02)
  → 'github:numtide/treefmt-nix/04f25d7bec9fb29d2c3bacaa48a3304840000d36' (2024-01-07)
2024-01-11 01:44:32 +00:00
c9e850ff32 only refresh github projects in timer and sort them
This way errors are more visible to users on the first running.

Co-authored-by: zimbatm <zimbatm@zimbatm.com>
2024-01-08 11:45:01 +00:00
github-actions[bot]
f22c113d1e flake.lock: Update
Flake lock file updates:

• Updated input 'nixpkgs':
    'github:Nixos/nixpkgs/382614ec619514fbc48dd9c60f043c4087798ddf' (2024-01-03)
  → 'github:Nixos/nixpkgs/0fa5a936f203acc1b11ed20fe002320944a8363b' (2024-01-05)
2024-01-07 01:48:57 +00:00