Tests fail with double free or corruption

9p4 commented

2026-01-16 08:55:25 +00:00

https://hydra.ersei.net/build/2776

nix build "git+https://git.ersei.net/nix-configs.git?ref=trunk&rev=5290f28c7653bfe7c11106f89bae2a35bc0fc866#hydraJobs.hosts.hydra"

The following jobs failed:
+------------------------+------------------------+------------------------+
| Job ID                 | Test File              | Subtests               |
+------------------------+------------------------+------------------------+
| C6573244-F2B3-11F0-B35 | Hydra/Controller/Build |                        |
| F-BBAC281A1CE2         | /restart.t             |                        |
|                        |                        |                        |
| C6584940-F2B3-11F0-B35 | Hydra/Plugin/RunComman |                        |
| F-BBAC281A1CE2         | d/http.t               |                        |
|                        |                        |                        |
| C6577AD8-F2B3-11F0-B35 | Hydra/Controller/Proje | Deleting a project wit |
| F-BBAC281A1CE2         | ct/delete.t            | h metrics              |
|                        |                        |                        |
| C6589D64-F2B3-11F0-B35 | evaluator/evaluate-bas |                        |
| F-BBAC281A1CE2         | ic.t                   |                        |
|                        |                        |                        |
| C65821C2-F2B3-11F0-B35 | Hydra/Plugin/Declarati | Evaluating and buildin |
| F-BBAC281A1CE2         | veJobsets/basic.t      | g the top .jobsets job |
|                        |                        | set                    |
|                        |                        | Validating a new jobse |
|                        |                        | t appears              |
|                        |                        | Validating a new jobse |
|                        |                        | t appears -> Evaluatin |
|                        |                        | g and building that jo |
|                        |                        | bset works             |
|                        |                        |                        |
| C6585CF0-F2B3-11F0-B35 | Hydra/Plugin/gitea.t   |                        |
| F-BBAC281A1CE2         |                        |                        |
|                        |                        |                        |
| C657FB52-F2B3-11F0-B35 | Hydra/Helper/BuildDiff |                        |
| F-BBAC281A1CE2         | .t                     |                        |
|                        |                        |                        |
| C65827C6-F2B3-11F0-B35 | Hydra/Plugin/RunComman |                        |
| F-BBAC281A1CE2         | d/basic.t              |                        |
|                        |                        |                        |
| C6583608-F2B3-11F0-B35 | Hydra/Plugin/RunComman | can enable dynamic Run |
| F-BBAC281A1CE2         | d/dynamic-enabled.t    | Command when enabled b |
|                        |                        | y server               |
|                        |                        |                        |
| C6583CC0-F2B3-11F0-B35 | Hydra/Plugin/RunComman |                        |
| F-BBAC281A1CE2         | d/errno.t              |                        |
|                        |                        |                        |
| C658B29A-F2B3-11F0-B35 | evaluator/evaluate-dep | For the 'build1' job   |
| F-BBAC281A1CE2         | endent-jobsets.t       | For the 'build2' job   |
|                        |                        |                        |
| C658B952-F2B3-11F0-B35 | evaluator/evaluate-met |                        |
| F-BBAC281A1CE2         | a.t                    |                        |
|                        |                        |                        |
| C6580156-F2B3-11F0-B35 | Hydra/Helper/CatalystU |                        |
| F-BBAC281A1CE2         | tils.t                 |                        |
|                        |                        |                        |
| C657E090-F2B3-11F0-B35 | Hydra/Event/EvalCached |                        |
| F-BBAC281A1CE2         | .t                     |                        |
|                        |                        |                        |
| C65842C4-F2B3-11F0-B35 | Hydra/Plugin/RunComman |                        |
| F-BBAC281A1CE2         | d/fanout.t             |                        |
|                        |                        |                        |
| C6573852-F2B3-11F0-B35 | Hydra/Controller/Job/b |                        |
| F-BBAC281A1CE2         | uilds.t                |                        |
|                        |                        |                        |
| C659156E-F2B3-11F0-B35 | queue-runner/notificat |                        |
| F-BBAC281A1CE2         | ions.t                 |                        |
|                        |                        |                        |
| C65744E6-F2B3-11F0-B35 | Hydra/Controller/Jobse |                        |
| F-BBAC281A1CE2         | t/channel.t            |                        |
|                        |                        |                        |
| C6592432-F2B3-11F0-B35 | scripts/hydra-eval-job | on a fresh evaluation  |
| F-BBAC281A1CE2         | set/notifications.t    | with changed sources   |
|                        |                        |                        |
| C6578CF8-F2B3-11F0-B35 | Hydra/Controller/Root/ |                        |
| F-BBAC281A1CE2         | status.t               |                        |
|                        |                        |                        |
| C657E7D4-F2B3-11F0-B35 | Hydra/Event/EvalFailed |                        |
| F-BBAC281A1CE2         | .t                     |                        |
|                        |                        |                        |
| C6571CDC-F2B3-11F0-B35 | Hydra/Controller/Build |                        |
| F-BBAC281A1CE2         | /api.t                 |                        |
|                        |                        |                        |
| C6590916-F2B3-11F0-B35 | queue-runner/default-m |                        |
| F-BBAC281A1CE2         | achine-file.t          |                        |
|                        |                        |                        |
| C6570936-F2B3-11F0-B35 | Hydra/Controller/API/c |                        |
| F-BBAC281A1CE2         | hecks.t                |                        |
|                        |                        |                        |
| C6584F4E-F2B3-11F0-B35 | Hydra/Plugin/RunComman |                        |
| F-BBAC281A1CE2         | d/json.t               |                        |
|                        |                        |                        |
| C65936DE-F2B3-11F0-B35 | scripts/hydra-update-g |                        |
| F-BBAC281A1CE2         | c-roots/update-gc-root |                        |
|                        | s.t                    |                        |
|                        |                        |                        |
| C6573E56-F2B3-11F0-B35 | Hydra/Controller/Jobse |                        |
| F-BBAC281A1CE2         | t/builds.t             |                        |
|                        |                        |                        |
| C657D9C4-F2B3-11F0-B35 | Hydra/Event/EvalAdded. |                        |
| F-BBAC281A1CE2         | t                      |                        |
|                        |                        |                        |
| C65896CA-F2B3-11F0-B35 | build-products.t       |                        |
| F-BBAC281A1CE2         |                        |                        |
|                        |                        |                        |
| C6572C22-F2B3-11F0-B35 | Hydra/Controller/Build |                        |
| F-BBAC281A1CE2         | /evals.t               |                        |
|                        |                        |                        |
| C657F4D6-F2B3-11F0-B35 | Hydra/Event/StepFinish |                        |
| F-BBAC281A1CE2         | ed.t                   |                        |
|                        |                        |                        |
| C657937E-F2B3-11F0-B35 | Hydra/Controller/User/ |                        |
| F-BBAC281A1CE2         | dashboard.t            |                        |
|                        |                        |                        |
| C6582DB6-F2B3-11F0-B35 | Hydra/Plugin/RunComman | can't enable dynamic R |
| F-BBAC281A1CE2         | d/dynamic-disabled.t   | unCommand when disable |
|                        |                        | d by server            |
|                        |                        |                        |
| C658FC1E-F2B3-11F0-B35 | queue-runner/build-loc | Building, caching, and |
| F-BBAC281A1CE2         | ally-with-substitutabl |  then garbage collecti |
|                        | e-path.t               | ng the underlying job  |
|                        |                        | Building the dependent |
|                        |                        |  job should now succee |
|                        |                        | d, even though we're m |
|                        |                        | issing a local depende |
|                        |                        | ncy                    |
|                        |                        |                        |
| C657745C-F2B3-11F0-B35 | Hydra/Controller/Proje |                        |
| F-BBAC281A1CE2         | ct/builds.t            |                        |
|                        |                        |                        |
| C65930E4-F2B3-11F0-B35 | scripts/hydra-send-sta |                        |
| F-BBAC281A1CE2         | ts.t                   |                        |
|                        |                        |                        |
| C657EE96-F2B3-11F0-B35 | Hydra/Event/EvalStarte |                        |
| F-BBAC281A1CE2         | d.t                    |                        |
|                        |                        |                        |
| C65786F4-F2B3-11F0-B35 | Hydra/Controller/Root/ |                        |
| F-BBAC281A1CE2         | narinfo.t              |                        |
+------------------------+------------------------+------------------------+

ma27 commented

2026-01-17 09:26:54 +00:00

Member

Huh, not reproducible with the stuff we have in the lockfile. Let me see if updating Lix to a newer main is the problem...

ma27 commented

2026-01-17 13:15:50 +00:00

Member

I suspect this was a bug in nixpkgs that's now fixed. I didn't manage to reproduce this on my own and when trying your config, I could build Hydra with the following diff in flake.lock:

diff --git a/flake.lock b/flake.lock
index 3fae61c..a28aee3 100644
--- a/flake.lock
+++ b/flake.lock
@@ -149,11 +149,11 @@
     "lix": {
       "flake": false,
       "locked": {
-        "lastModified": 1768513840,
-        "narHash": "sha256-uWX0MCMB0V0VdTlMngYoZIzedQH41IVbTZSL5xB4Bl4=",
-        "rev": "dbdc3ee28c535e7ef21d32872bd6c1f2bf0a9ab7",
+        "lastModified": 1768582323,
+        "narHash": "sha256-0oEiVXywTjy+UV+j1LlTFPCEv+C05e6ADMqj6a8tQwg=",
+        "rev": "cef9572c24e74e3e4f6eb6967316965c3fd0a60a",
         "type": "tarball",
-        "url": "https://git.lix.systems/api/v1/repos/lix-project/lix/archive/dbdc3ee28c535e7ef21d32872bd6c1f2bf0a9ab7.tar.gz?rev=dbdc3ee28c535e7ef21d32872bd6c1f2bf0a9ab7"
+        "url": "https://git.lix.systems/api/v1/repos/lix-project/lix/archive/cef9572c24e74e3e4f6eb6967316965c3fd0a60a.tar.gz?rev=cef9572c24e74e3e4f6eb6967316965c3fd0a60a"
       },
       "original": {
         "type": "tarball",
@@ -207,11 +207,11 @@
     },
     "nixpkgs": {
       "locked": {
-        "lastModified": 1768305791,
-        "narHash": "sha256-AIdl6WAn9aymeaH/NvBj0H9qM+XuAuYbGMZaP0zcXAQ=",
+        "lastModified": 1768564909,
+        "narHash": "sha256-Kell/SpJYVkHWMvnhqJz/8DqQg2b6PguxVWOuadbHCc=",
         "owner": "NixOS",
         "repo": "nixpkgs",
-        "rev": "1412caf7bf9e660f2f962917c14b1ea1c3bc695e",
+        "rev": "e4bae1bd10c9c57b2cf517953ab70060a828ee6f",
         "type": "github"
       },
       "original": {

I suspect this was a bug in nixpkgs that's now fixed. I didn't manage to reproduce this on my own and when trying your config, I could build Hydra with the following diff in flake.lock: ```diff diff --git a/flake.lock b/flake.lock index 3fae61c..a28aee3 100644 --- a/flake.lock +++ b/flake.lock @@ -149,11 +149,11 @@ "lix": { "flake": false, "locked": { - "lastModified": 1768513840, - "narHash": "sha256-uWX0MCMB0V0VdTlMngYoZIzedQH41IVbTZSL5xB4Bl4=", - "rev": "dbdc3ee28c535e7ef21d32872bd6c1f2bf0a9ab7", + "lastModified": 1768582323, + "narHash": "sha256-0oEiVXywTjy+UV+j1LlTFPCEv+C05e6ADMqj6a8tQwg=", + "rev": "cef9572c24e74e3e4f6eb6967316965c3fd0a60a", "type": "tarball", - "url": "https://git.lix.systems/api/v1/repos/lix-project/lix/archive/dbdc3ee28c535e7ef21d32872bd6c1f2bf0a9ab7.tar.gz?rev=dbdc3ee28c535e7ef21d32872bd6c1f2bf0a9ab7" + "url": "https://git.lix.systems/api/v1/repos/lix-project/lix/archive/cef9572c24e74e3e4f6eb6967316965c3fd0a60a.tar.gz?rev=cef9572c24e74e3e4f6eb6967316965c3fd0a60a" }, "original": { "type": "tarball", @@ -207,11 +207,11 @@ }, "nixpkgs": { "locked": { - "lastModified": 1768305791, - "narHash": "sha256-AIdl6WAn9aymeaH/NvBj0H9qM+XuAuYbGMZaP0zcXAQ=", + "lastModified": 1768564909, + "narHash": "sha256-Kell/SpJYVkHWMvnhqJz/8DqQg2b6PguxVWOuadbHCc=", "owner": "NixOS", "repo": "nixpkgs", - "rev": "1412caf7bf9e660f2f962917c14b1ea1c3bc695e", + "rev": "e4bae1bd10c9c57b2cf517953ab70060a828ee6f", "type": "github" }, "original": { ```

9p4 commented

2026-01-17 18:12:56 +00:00

Author

I wonder what caused the issue...

Do you want for me to continue creating issues for issues in Hydra arising in nixos-unstable?

I wonder what caused the issue... Do you want for me to continue creating issues for issues in Hydra arising in nixos-unstable?

Rows
Columns

Tests fail with double free or corruption #77