ma27/hydra
0
0
Fork 0
forked from lix-project/hydra
Code Pull requests Activity
4204 commits 4 branches 0 tags 26 MiB
Commit graph

4204 commits

This branch
This branch
All branches
Author SHA1 Message Date
Janne Heß 8a413ce71a
Merge pull request #1293 from arianvp/patch-1 
Fix docs for  /eval/{id}  endpoint
 2023-09-09 17:10:56 +02:00
Pierre Bourdon b7c864c515
queue-runner: only re-sort runnables by prio once per dispatch cycle 
The previous implementation was O(N²lg(N)) due to sorting the full
runnables priority list once per runnable being scheduled. While not
confirmed, this is suspected to cause performance issues and
bottlenecking with the queue runner when the runnable list gets large
enough.

This commit changes the dispatcher to instead only sort runnables per
priority once per dispatch cycle. This has the drawback of being less
reactive to runnable priority changes: the previous code would react
immediately, while this might end up using "old" priorities until the
next dispatch cycle. However, dispatch cycles are not supposed to take
very long (seconds, not minutes/hours), so this is not expected to have
much or any practical impact.

Ideally runnables would be maintained in a sorted data structure instead
of the current approach of copying + sorting in the scheduler. This
would however be a much more invasive change to implement, and might
have to wait until we can confirm where the queue runner bottlenecks
actually lie.
 2023-09-08 23:38:30 +02:00
sternenseemann e2195c46d1 hydra-api.yaml: document all_builds (/eval/{eval-id}/builds) 2023-08-30 15:08:11 +02:00
sternenseemann 113836ebae hydra-api.yaml: name JobsetEval parameter eval-id 
This is more accurate since the id space is not shared between build and
eval ids.
 2023-08-30 15:06:48 +02:00
Eelco Dolstra 00d30874da
Merge pull request #1296 from DeterminateSystems/nix-2.17 
Support Nix 2.17
 2023-08-23 17:53:14 +02:00
Eelco Dolstra 35ccc9ebb2
Fix indentation 
Co-authored-by: John Ericson <git@JohnEricson.me>
 2023-08-23 17:04:45 +02:00
Linus Heckemann 9f0427385f Apply LTO fix suggested by Ericson2314 2023-08-20 14:55:56 +02:00
Linus Heckemann b23431a657 Support Nix 2.17 2023-08-04 15:53:48 +02:00
Eelco Dolstra 60e2c377d3
Merge pull request #1295 from arianvp/patch-3 
Fix documentation of defaultpath in api docs
 2023-08-03 17:09:21 +02:00
Arian van Putten a78664f1b5
Fix documentation of defaultpath in api docs 2023-07-20 14:43:03 +02:00
Arian van Putten 46246dcae3
Fix docs for /eval/{id} endpoint 
You  need to pass it an eval-id, not a build-id pretty sure
 2023-07-19 15:13:25 +02:00
Janne Heß d135b123cd
Merge pull request #1292 from Ma27/fix-queue-runner-stats 
hydra-queue-runner: fix stats
 2023-07-17 09:56:05 +02:00
Janne Heß 526e8bd744
Merge pull request #1291 from NixOS/update-nix-nixpkgs 2023-06-25 20:53:50 +02:00
Maximilian Bosch 5c35d1be20
hydra-queue-runner: fix stats 2023-06-25 17:28:15 +02:00
Eelco Dolstra ce001bb142 Relax time interval checks 
I saw one of these failing randomly.
 2023-06-23 15:09:09 +02:00
Eelco Dolstra 9f69bb5c2c Fix compilation against Nix 2.16 2023-06-23 15:06:55 +02:00
Eelco Dolstra a0c8440a5c Update to Nix 2.16 and NixOS 23.05 
Flake lock file updates:

• Updated input 'nix':
    'github:nixos/nix/4acc684ef7b3117c6d6ac12837398a0008a53d85' (2023-02-22)
  → 'github:NixOS/nix/84050709ea18f3285a85d729f40c8f8eddf5008e' (2023-06-06)
• Added input 'nix/flake-compat':
    'github:edolstra/flake-compat/35bb57c0c8d8b62bbfd284272c928ceb64ddbde9' (2023-01-17)
• Updated input 'nixpkgs':
    follows 'nix/nixpkgs'
  → 'github:NixOS/nixpkgs/ef0bc3976340dab9a4e087a0bcff661a8b2e87f3' (2023-06-21)
 2023-06-23 15:06:46 +02:00
Janne Heß 13ef4e3c5d
Merge pull request #1286 from JulienMalka/fix-hydra-eval-jobs-dot 
hydra-eval-jobs: fix jobs containing a dot being dropped
 2023-05-08 14:48:33 +02:00
Julien Malka b4099df91e
hydra-eval-jobs: fix jobs containing a dot being dropped 2023-04-25 10:37:41 +02:00
Eelco Dolstra 082495e34e
Merge pull request #1275 from Ma27/nix-2.13 
Nix 2.13 + nixpkgs input update
 2023-03-27 13:30:13 +02:00
Graham Christensen 399b61ff67
Merge pull request #1277 from Mindavi/systemd/network-online 
systemd: hydra-queue-runner: wait for network-online
 2023-03-24 09:56:29 -04:00
Graham Christensen 3da6ef0d6d
Merge pull request #1281 from NixOS/rv-google-signin 
Use new Google for Web signin
 2023-03-24 09:55:22 -04:00
Rob Vermaas f88bef15ed Use new Google for Web signin, the old way will be deprecated Mar 31st 2023 2023-03-14 09:04:12 +01:00
Rick van Schijndel a084e204ae
systemd: hydra-queue-runner: wait for network.target too 
Co-authored-by: Sandro <sandro.jaeckel@gmail.com>
 2023-03-07 21:56:20 +01:00
Graham Christensen ecfa817d30
Merge pull request #1279 from DeterminateSystems/drop-unnecessary-index 
Drop unused IndexBuildOutputsOnPath index
 2023-03-06 11:06:31 -05:00
Cole Helbling 8d53c3ca11 test: use ubuntu-latest 2023-03-06 07:56:05 -08:00
Cole Helbling 810d2e6b51 Drop unused IndexBuildOutputsOnPath index 
Also it's larger than the actual table it's indexing lol.

    -[ RECORD 30 ]----------+-----------------------------------------
    table_name              | buildoutputs
    index_name              | indexbuildoutputsonpath
    index_scans_count       | 0
    index_size              | 31 GB
    table_reads_index_count | 2128699937
    table_reads_seq_count   | 0
    table_reads_count       | 2128699937
    table_writes_count      | 22442976
    table_size              | 28 GB
 2023-03-06 07:56:05 -08:00
Maximilian Bosch f44d3d6ec9
Update Nix to 2.13.3 
Includes the following required fixes:

* perl-bindings are correctly initialized: 77d8066e83
* /etc/ must be unwritable in build sandbox: 4acc684ef7
 2023-03-04 12:07:34 +01:00
Rick van Schijndel 65c1249227 systemd: hydra-queue-runner: wait for network-online 
This prevents eval errors when a machine is just started and the network isn't yet online.
I'm running hydra on a laptop and the network takes a bit of time to come online (WLAN),
so it's nice if the evaluator starts only when the network actually goes online.

Otherwise an error like this can happen on the first eval(s):

```
error fetching latest change from git repo at `https://github.com/nixos/nixpkgs.git':
fatal: unable to access 'https://github.com/nixos/nixpkgs.git/': Could not resolve host: github.com
```
 2023-02-16 19:24:53 +01:00
Linus Heckemann 73dff15039
tests: ports are numbers 2023-02-04 20:12:30 +01:00
Linus Heckemann ddd3ac3a4d
name tests 2023-02-04 20:12:30 +01:00
Maximilian Bosch c7716817a9
Update Nix to 2.13 2023-02-04 20:11:53 +01:00
Linus Heckemann 5b35e13898
hydra-queue-runner: use initializer lists for constructing JSON 
And also fix the parts that were broken
 2023-02-04 20:08:27 +01:00
Linus Heckemann 96e36201eb
hydra-queue-runner: adapt to nlohmann::json 2023-02-04 20:08:09 +01:00
Josef Kemetmüller ad99d3366f Fix MIME types when serving .js and .css 
To correctly render HTML reports we make sure to return the following MIME
types instead of "text/plain"

- *.css: "text/css"
- *.js: "application/javascript"

Fixes: #1267
 2022-12-29 22:26:59 +01:00
Graham Christensen f48f00ee6d
Merge pull request #1256 from cransom/hydra-evaluator-broken-connection 
exit with error if database connectivity lost
 2022-12-22 19:28:51 -05:00
Eelco Dolstra d1fac69c21
Merge pull request #1264 from SuperSandro2000/patch-2 
Fix example config
 2022-12-05 17:48:46 +01:00
Graham Christensen 01802efc17
Merge pull request #1263 from Ma27/fix-my-jobs-tab 
Fix "My Jobs" tab in user dashboard
 2022-12-05 01:55:49 +01:00
Sandro 7f816e3237
Fix link 2022-12-05 00:35:05 +01:00
Sandro 213879484d
Fix example config 2022-12-05 00:22:35 +01:00
Eelco Dolstra 14d4624dc2
Merge pull request #1215 from knedlsepp/fix-hydra-with-latest-git 
scmdiff: Hardcode `--git-dir`
 2022-11-24 12:04:23 +01:00
Maximilian Bosch fd765bc97a
Fix "My Jobs" tab in user dashboard 
Nowadays `Builds` doesn't reference `Project` directly anymore. This
means that simply resolving both `jobset` and `project` with a single
JOIN from `Builds` doesn't work anymore. Instead we need to resolve the
relation to `jobset` first and then the relation to `project`.

For similar fixes see e.g. c7c4759600.
 2022-11-22 20:54:51 +01:00
Eelco Dolstra d4d20f6484
Merge pull request #1262 from lheckemann/aarch64 
Enable aarch64 support
 2022-11-21 11:01:38 +01:00
Linus Heckemann a8b89420bc Enable aarch64 support 2022-11-17 23:04:52 +01:00
Niklas Hambüchen d1d171ee90
renderInputDiff: Increase git hash length 6 -> 8 
Nixpkgs has so many commits that length 6 is often ambiguous,
making the use of the shown values with git difficult.
 2022-11-02 17:30:32 +01:00
Casey Ransom 70ad3a924a exit with error if database connectivity lost 
There's currently no automatic recovery for disconnected databases in
the evaluator. This means if the database is ever temporarily
unavailable, hydra-evaluator will sit and spin with no work
accomplished.

If this condition is caught, the daemon will exit and systemd will be
responsible for resuming the service.
 2022-10-26 16:13:40 -04:00
John Ericson 3526d61ff2 Merge remote-tracking branch 'upstream/master' into split-buildRemote 2022-10-25 11:24:54 -04:00
Théophane Hufschmitt 143c31734f Move all the build remote utils to their namespace 
Just don't pollute the global one
 2022-10-25 10:04:29 +02:00
Janne Heß 312cb42275
Merge pull request #1234 from helsinki-systems/feat/squiggly-line 
Add a squiggly line to the Hydra link on hover
 2022-10-21 22:57:20 +02:00
Janne Heß a67d3b47d2
Merge pull request #1255 from MaxHearnden/patch-1 
Fix insecure advice in the manual
 2022-10-21 10:00:52 +02:00