Commit graph

221 commits

Author SHA1 Message Date
eldritch horrors f869b52a8d use build-local gc-root directory
without this two builds can interfere with each other if:

  - builds 1 and 2 start
  - build 1 is starved of workers
  - build 2 finishes, removes the shared gcroots directory
  - gc runs
  - build 1 schedules more builds whose .drvs have now been removed

using a dedicated directory for each build fixes this.

we now also need to set alwaysRun on the cleanup command or we risk
littering the system with stale gc roots when a build fails.
2024-03-11 06:48:41 +01:00
eldritch horrors 156e6e3dea remove skipped-builds builder
run all of them on the normal build worker. this significantly
simplifies the overall scheduler/builder config and removes a
triplication of possible builds paths.
2024-03-11 06:27:32 +01:00
eldritch horrors 753df8e340 remove cachix
we aren't using it and it's somewhat in the way of our efforts to
improve scheduling and stuff.
2024-03-11 06:26:39 +01:00
eldritch horrors 0b2545b036 remove unused GitWithRetry 2024-03-11 06:26:39 +01:00
eldritch horrors fdfeef8ad4 remove retry logic
retries don't help us very much, in fact they mostly hurt by repeating
builds that failed for non-transient reasons. retries could help with
workers dropping while running a build, but those rare cases are better
to restart manually than to pend at least twice the ci time for commits
that simply do not build cleanly.
2024-03-11 06:26:38 +01:00
puck e1dfa0e545 Remove cachix from dependencies
The rest of the Cachix infrastructure is intact. For now.
2024-03-10 13:03:16 +00:00
puck ec2ef903ab use .#hydraJobs rather than .#checks 2024-03-08 23:28:49 +00:00
puck c487ada514 review callback: Set labels, render list of failed checks in reporter 2024-03-07 04:40:58 +00:00
raito 18d537e5d4 nix/coordinator(reporting): re-enable reviewCB, disable summaryCB, skip evaluations
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-04 20:50:12 +01:00
raito 322944f8d1 nix/coordinator(reporting): disable startCB and reviewCB
excessive noise.

Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-04 20:37:13 +01:00
raito 9a67a1f2cc nix/coordinator: enable reporting to Gerrit
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-03 02:58:25 +01:00
raito 2bcc0ee4e9 nix/coordinator: hardcode remaining github properties to lix
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 23:22:36 +01:00
raito 3895b90493 nix/coordinator: disable reporter
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 23:07:36 +01:00
raito 670a1d1281 nix/coordinator: fix repourl
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 23:07:36 +01:00
raito e92a2225f7 nix/coordinator: use a special key for service account
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 23:07:33 +01:00
raito 94e3d7aeda nix/coordinator: support specific private SSH keys
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 23:07:33 +01:00
raito 9f98533dd7 nix/worker: rename master → coordinator
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 22:09:56 +01:00
raito 5a8ab145e6 buildbot: add repourl
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 22:09:56 +01:00
raito 7ad9c1a378 nix/coordinator: introduce OAuth2 client secret
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 22:09:56 +01:00
raito 81bd57ffac nix/coordinator: instantiate the GerritNixConfigurator
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 22:09:56 +01:00
raito 101612eb70 nix/coordinator: fix various errors
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 22:09:56 +01:00
raito 7ace78107c buildbot: further Gerritification
- `BuildTrigger` still depends on `github` properties.

Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 22:09:56 +01:00
raito 5f7b3e0cdb buildbot: instantiate fully LixSystemsOAuth2
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 22:09:56 +01:00
raito beea96da2c nix/coordinator: simplify the module
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 18:45:19 +01:00
raito 329d9dd6d4 nix/coordinator: rename it into what this really is
No need to use legacy names.

Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 18:45:19 +01:00
raito acfd225e6d buildbot/__init__.py: rework the file for gerrit usecase, our oauth2 instance
Signed-off-by: Raito Bezarius <raito@lix.systems>
2024-03-02 18:45:19 +01:00
github-actions[bot] 7a44c9f71c flake.lock: Update
Flake lock file updates:

• Updated input 'nixpkgs':
    'github:Nixos/nixpkgs/6d8aba54f305eb12a57d92ad4eaeb42049961f19' (2024-02-24)
  → 'github:Nixos/nixpkgs/96990c69fd59e807cee8ff874d0526c70dffdf8f' (2024-02-28)
• Updated input 'treefmt-nix':
    'github:numtide/treefmt-nix/36fd6923c122a983bc3915692e6cb3ff341ef083' (2024-02-23)
  → 'github:numtide/treefmt-nix/e497a9ddecff769c2a7cbab51e1ed7a8501e7a3a' (2024-02-25)
2024-02-29 01:34:25 +00:00
github-actions[bot] 3e67b49a18 flake.lock: Update
Flake lock file updates:

• Updated input 'nixpkgs':
    'github:Nixos/nixpkgs/591f9cbebeef5dfdcb24997a3069d7f29c365ab9' (2024-02-21)
  → 'github:Nixos/nixpkgs/6d8aba54f305eb12a57d92ad4eaeb42049961f19' (2024-02-24)
• Updated input 'treefmt-nix':
    'github:numtide/treefmt-nix/e504621290a1fd896631ddbc5e9c16f4366c9f65' (2024-02-19)
  → 'github:numtide/treefmt-nix/36fd6923c122a983bc3915692e6cb3ff341ef083' (2024-02-23)
2024-02-25 01:40:35 +00:00
github-actions[bot] 271610c98e flake.lock: Update
Flake lock file updates:

• Updated input 'nixpkgs':
    'github:Nixos/nixpkgs/28d6a724f54085377102db7c3278ba82a0a5255f' (2024-02-17)
  → 'github:Nixos/nixpkgs/591f9cbebeef5dfdcb24997a3069d7f29c365ab9' (2024-02-21)
• Updated input 'treefmt-nix':
    'github:numtide/treefmt-nix/ac599dab59a66304eb511af07b3883114f061b9d' (2024-02-07)
  → 'github:numtide/treefmt-nix/e504621290a1fd896631ddbc5e9c16f4366c9f65' (2024-02-19)
2024-02-22 01:35:00 +00:00
github-actions[bot] 064e545c12 flake.lock: Update
Flake lock file updates:

• Updated input 'nixpkgs':
    'github:Nixos/nixpkgs/4dec2a6e52b5d910b428468680707f7f73a1219f' (2024-02-14)
  → 'github:Nixos/nixpkgs/28d6a724f54085377102db7c3278ba82a0a5255f' (2024-02-17)
2024-02-18 01:39:52 +00:00
github-actions[bot] b1dd56c5b5 flake.lock: Update
Flake lock file updates:

• Updated input 'nixpkgs':
    'github:Nixos/nixpkgs/8f9789aa7fe8fab4cc1bb41b7c7331cac9a36bbf' (2024-02-10)
  → 'github:Nixos/nixpkgs/4dec2a6e52b5d910b428468680707f7f73a1219f' (2024-02-14)
2024-02-15 01:36:35 +00:00
github-actions[bot] f0a9986934 flake.lock: Update
Flake lock file updates:

• Updated input 'nixpkgs':
    'github:Nixos/nixpkgs/5ef42fcd84b2baa16f43554f1c1f1d614e23ef9a' (2024-02-07)
  → 'github:Nixos/nixpkgs/8f9789aa7fe8fab4cc1bb41b7c7331cac9a36bbf' (2024-02-10)
2024-02-11 01:41:20 +00:00
github-actions[bot] b985888b5c flake.lock: Update
Flake lock file updates:

• Updated input 'nixpkgs':
    'github:Nixos/nixpkgs/4f301350dacb4eb0a93578ef3b07c8a996c777e7' (2024-02-03)
  → 'github:Nixos/nixpkgs/5ef42fcd84b2baa16f43554f1c1f1d614e23ef9a' (2024-02-07)
• Updated input 'treefmt-nix':
    'github:numtide/treefmt-nix/c6153c2a3ff4c38d231e3ae99af29b87f1df5901' (2024-01-28)
  → 'github:numtide/treefmt-nix/ac599dab59a66304eb511af07b3883114f061b9d' (2024-02-07)
2024-02-08 01:35:59 +00:00
github-actions[bot] 62974e991d flake.lock: Update
Flake lock file updates:

• Updated input 'flake-parts':
    'github:hercules-ci/flake-parts/60c614008eed1d0383d21daac177a3e036192ed8' (2024-01-29)
  → 'github:hercules-ci/flake-parts/b253292d9c0a5ead9bc98c4e9a26c6312e27d69f' (2024-02-01)
• Updated input 'nixpkgs':
    'github:Nixos/nixpkgs/632751bf0ceeefc74af7a9d2335ea923ad9c831a' (2024-01-31)
  → 'github:Nixos/nixpkgs/4f301350dacb4eb0a93578ef3b07c8a996c777e7' (2024-02-03)
2024-02-04 01:40:25 +00:00
github-actions[bot] 49fd61bd99 flake.lock: Update
Flake lock file updates:

• Updated input 'flake-parts':
    'github:hercules-ci/flake-parts/07f6395285469419cf9d078f59b5b49993198c00' (2024-01-11)
  → 'github:hercules-ci/flake-parts/60c614008eed1d0383d21daac177a3e036192ed8' (2024-01-29)
• Updated input 'nixpkgs':
    'github:Nixos/nixpkgs/7ac72b3ee2af9bab80d66addd9b237277cc975c5' (2024-01-26)
  → 'github:Nixos/nixpkgs/632751bf0ceeefc74af7a9d2335ea923ad9c831a' (2024-01-31)
• Updated input 'treefmt-nix':
    'github:numtide/treefmt-nix/fbef7c773be115ed33f37e97256a9e8f6312b925' (2024-01-26)
  → 'github:numtide/treefmt-nix/c6153c2a3ff4c38d231e3ae99af29b87f1df5901' (2024-01-28)
2024-02-01 01:40:13 +00:00
github-actions[bot] 65528353e5 flake.lock: Update
Flake lock file updates:

• Updated input 'nixpkgs':
    'github:Nixos/nixpkgs/5cd2baa57a9ff2d84f2615700434fa04f3067fdb' (2024-01-24)
  → 'github:Nixos/nixpkgs/7ac72b3ee2af9bab80d66addd9b237277cc975c5' (2024-01-26)
• Updated input 'treefmt-nix':
    'github:numtide/treefmt-nix/23f601bfdef75e21fe8854e24a043bb642201794' (2024-01-24)
  → 'github:numtide/treefmt-nix/fbef7c773be115ed33f37e97256a9e8f6312b925' (2024-01-26)
2024-01-28 01:41:22 +00:00
github-actions[bot] 4cbe42c048 flake.lock: Update
Flake lock file updates:

• Updated input 'nixpkgs':
    'github:Nixos/nixpkgs/b4ee3c3cc4b63315702e09858f6b517bdd249b3f' (2024-01-19)
  → 'github:Nixos/nixpkgs/5cd2baa57a9ff2d84f2615700434fa04f3067fdb' (2024-01-24)
• Updated input 'treefmt-nix':
    'github:numtide/treefmt-nix/8cd95da6c30852adb2a06c4b6bdacfe8b64a0a35' (2024-01-19)
  → 'github:numtide/treefmt-nix/23f601bfdef75e21fe8854e24a043bb642201794' (2024-01-24)
2024-01-25 01:46:29 +00:00
github-actions[bot] 6823a26b26 flake.lock: Update
Flake lock file updates:

• Updated input 'nixpkgs':
    'github:Nixos/nixpkgs/cc3ab0e45687d15cb21663a95f5a53a05abd39e4' (2024-01-16)
  → 'github:Nixos/nixpkgs/b4ee3c3cc4b63315702e09858f6b517bdd249b3f' (2024-01-19)
• Updated input 'treefmt-nix':
    'github:numtide/treefmt-nix/04f25d7bec9fb29d2c3bacaa48a3304840000d36' (2024-01-07)
  → 'github:numtide/treefmt-nix/8cd95da6c30852adb2a06c4b6bdacfe8b64a0a35' (2024-01-19)
2024-01-21 01:49:36 +00:00
github-actions[bot] 336f9c504e flake.lock: Update
Flake lock file updates:

• Updated input 'flake-parts':
    'github:hercules-ci/flake-parts/88a2cd8166694ba0b6cb374700799cec53aef527' (2024-01-01)
  → 'github:hercules-ci/flake-parts/07f6395285469419cf9d078f59b5b49993198c00' (2024-01-11)
• Updated input 'nixpkgs':
    'github:Nixos/nixpkgs/5fcfdd4990ab907895fe9bcb1e2e4083d92ca670' (2024-01-10)
  → 'github:Nixos/nixpkgs/cc3ab0e45687d15cb21663a95f5a53a05abd39e4' (2024-01-16)
2024-01-18 01:43:15 +00:00
Jörg Thalheim 3c1e2c0e76 cleanup drv gcroots after a build 2024-01-15 13:17:19 +00:00
dependabot[bot] 25e583ea9e Bump cachix/install-nix-action from 24 to 25
Bumps [cachix/install-nix-action](https://github.com/cachix/install-nix-action) from 24 to 25.
- [Release notes](https://github.com/cachix/install-nix-action/releases)
- [Commits](https://github.com/cachix/install-nix-action/compare/v24...v25)

---
updated-dependencies:
- dependency-name: cachix/install-nix-action
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-01-15 01:50:37 +00:00
github-actions[bot] 2958fd6dea flake.lock: Update
Flake lock file updates:

• Updated input 'nixpkgs':
    'github:Nixos/nixpkgs/0fa5a936f203acc1b11ed20fe002320944a8363b' (2024-01-05)
  → 'github:Nixos/nixpkgs/5fcfdd4990ab907895fe9bcb1e2e4083d92ca670' (2024-01-10)
• Updated input 'treefmt-nix':
    'github:numtide/treefmt-nix/e434da615ef74187ba003b529cc72f425f5d941e' (2024-01-02)
  → 'github:numtide/treefmt-nix/04f25d7bec9fb29d2c3bacaa48a3304840000d36' (2024-01-07)
2024-01-11 01:44:32 +00:00
Jörg Thalheim c9e850ff32 only refresh github projects in timer and sort them
This way errors are more visible to users on the first running.

Co-authored-by: zimbatm <zimbatm@zimbatm.com>
2024-01-08 11:45:01 +00:00
github-actions[bot] f22c113d1e flake.lock: Update
Flake lock file updates:

• Updated input 'nixpkgs':
    'github:Nixos/nixpkgs/382614ec619514fbc48dd9c60f043c4087798ddf' (2024-01-03)
  → 'github:Nixos/nixpkgs/0fa5a936f203acc1b11ed20fe002320944a8363b' (2024-01-05)
2024-01-07 01:48:57 +00:00
Jörg Thalheim 69ac528df0
Merge pull request #76 from Mic92/ci-lock
relax concurrent builds
2024-01-05 08:55:02 +01:00
Jörg Thalheim f69a37a69e relax concurrent builds
So far we cannot have builds running concurrently, whereas we only would
need to be strict about nix evaluation to stay below memory limits.
2024-01-05 08:49:54 +01:00
github-actions[bot] 19ae8e85b6 flake.lock: Update
Flake lock file updates:

• Updated input 'flake-parts':
    'github:hercules-ci/flake-parts/34fed993f1674c8d06d58b37ce1e0fe5eebcb9f5' (2023-12-01)
  → 'github:hercules-ci/flake-parts/88a2cd8166694ba0b6cb374700799cec53aef527' (2024-01-01)
• Updated input 'nixpkgs':
    'github:Nixos/nixpkgs/59fa082abdbf462515facc8800d517f5728c909d' (2023-12-29)
  → 'github:Nixos/nixpkgs/382614ec619514fbc48dd9c60f043c4087798ddf' (2024-01-03)
• Updated input 'treefmt-nix':
    'github:numtide/treefmt-nix/2961375283668d867e64129c22af532de8e77734' (2023-12-19)
  → 'github:numtide/treefmt-nix/e434da615ef74187ba003b529cc72f425f5d941e' (2024-01-02)
2024-01-04 01:46:24 +00:00
Jörg Thalheim b2467c4ac5 typecheck twisted 2024-01-01 15:38:28 +00:00
Jörg Thalheim c48efb2b25
Merge pull request #72 from Mic92/fixes
fixup logger warning call
2024-01-01 08:12:33 +01:00
Jörg Thalheim 6882c81e90 fixup logger warning call 2024-01-01 08:05:12 +01:00