Some install checks are flakey #700

New issue

Closed

opened 2025-02-26 09:19:35 +00:00 by getchoo · 1 comment

getchoo commented

2025-02-26 09:19:35 +00:00

Describe the bug

Select install checks will fail depending on the system they're built on

Steps To Reproduce

Build https://github.com/getchoo/borealis/commit/99b8b8320a62da18655f1c5f1f67e62a7ce25af5#nixosConfigurations.glados-wsl.pkgs.nix (which uses the NixOS module/overlay) or https://git.lix.systems/lix-project/lix/archive/2.92.0.tar.gz on one machine
Build them on another, like GitHub Actions

Expected behavior

Install checks consistently pass or fail

`nix --version` output

From the version of Lix where checks did succeed:

nix (Lix, like Nix) 2.92.0
System type: x86_64-linux
Additional system types: i686-linux, x86_64-v1-linux, x86_64-v2-linux, x86_64-v3-linux
Features: gc, signed-caches
System configuration file: /etc/nix/nix.conf
User configuration files: /home/seth/.config/nix/nix.conf:/etc/xdg/nix/nix.conf:/home/seth/.nix-profile/etc/xdg/nix/nix.conf:/nix/profile/etc/xdg/nix/nix.conf:/home/seth/.local/state/nix/profile/etc/xdg/nix/nix.conf:/etc/profiles/per-user/seth/etc/xdg/nix/nix.conf:/nix/var/nix/profiles/default/etc/xdg/nix/nix.conf:/run/current-system/sw/etc/xdg/nix/nix.conf
Store directory: /nix/store
State directory: /nix/var/nix
Data directory: /nix/store/v6rpybz1pwr46kff20q7ddm28kkqcqqf-lix-2.92.0/share

Additional context

Here are two repeated failures in GitHub actions against 99b8b8320a:

https://github.com/getchoo/borealis/actions/runs/13538509877/job/37834411226
https://github.com/getchoo/borealis/actions/runs/13538509877/job/37837497448

TL;DR:

error: builder for '/nix/store/dxqlkk1asz0i8zxq0gdk9clb7a9d6dzp-lix-2.92.0.drv' failed with exit code 12;
       last 25 log lines:
       > 167/167 lix:installcheck / functional2                                                 OK               1.57s
       >
       > Summary of Failures:
       >
       >  83/167 lix:installcheck / functional-build-remote-input-addressed            FAIL             0.38s   exit status 1
       >  95/167 lix:installcheck / functional-build-remote-content-addressed-fixed    FAIL             0.38s   exit status 1
       >  96/167 lix:installcheck / functional-build-remote-content-addressed-floating FAIL             0.38s   exit status 1
       >  97/167 lix:installcheck / functional-build-remote-trustless-should-pass-0    FAIL             0.41s   exit status 1
       >  98/167 lix:installcheck / functional-build-remote-trustless-should-pass-1    FAIL             0.39s   exit status 1
       > 100/167 lix:installcheck / functional-build-remote-trustless-should-pass-2    FAIL             0.41s   exit status 1
       > 101/167 lix:installcheck / functional-build-remote-trustless-should-pass-3    FAIL             0.41s   exit status 1
       > 102/167 lix:installcheck / functional-build-remote-trustless-should-fail-0    FAIL             0.33s   exit status 100
       > 117/167 lix:installcheck / functional-linux-sandbox                           FAIL             0.27s   exit status 100
       > 118/167 lix:installcheck / functional-supplementary-groups                    FAIL             0.15s   exit status 1
       > 124/167 lix:installcheck / functional-shell                                   FAIL             0.83s   exit status 1
       > 155/167 lix:installcheck / functional-nested-sandboxing                       FAIL             0.30s   exit status 1
       >
       > Ok:                 151
       > Expected Fail:      0
       > Fail:               12
       > Unexpected Pass:    0
       > Skipped:            4
       > Timeout:            0
       >
       > Full log written to /build/source/build/meson-logs/testlog.txt
       For full logs, run 'nix log /nix/store/dxqlkk1asz0i8zxq0gdk9clb7a9d6dzp-lix-2.92.0.drv'.

And the relevant sections from my flake.lock:

    "lix": {
      "flake": false,
      "locked": {
        "lastModified": 1737234286,
        "narHash": "sha256-CCKIAE84dzkrnlxJCKFyffAxP3yfsOAbdvydUGqq24g=",
        "rev": "2837da71ec1588c1187d2e554719b15904a46c8b",
        "type": "tarball",
        "url": "https://git.lix.systems/api/v1/repos/lix-project/lix/archive/2837da71ec1588c1187d2e554719b15904a46c8b.tar.gz?rev=2837da71ec1588c1187d2e554719b15904a46c8b"
      },
      "original": {
        "type": "tarball",
        "url": "https://git.lix.systems/lix-project/lix/archive/2.92.0.tar.gz"
      }
    },
    "lix-module": {
      "inputs": {
        "flake-utils": "flake-utils",
        "flakey-profile": [],
        "lix": "lix",
        "nixpkgs": [
          "nixpkgs"
        ]
      },
      "locked": {
        "lastModified": 1737237494,
        "narHash": "sha256-YMLrcBpf0TR5r/eaqm8lxzFPap2TxCor0ZGcK3a7+b8=",
        "rev": "b90bf629bbd835e61f1317b99e12f8c831017006",
        "type": "tarball",
        "url": "https://git.lix.systems/api/v1/repos/lix-project/nixos-module/archive/b90bf629bbd835e61f1317b99e12f8c831017006.tar.gz"
      },
      "original": {
        "type": "tarball",
        "url": "https://git.lix.systems/lix-project/nixos-module/archive/refs/tags/2.92.0.tar.gz"
      }
    },

## Describe the bug Select install checks will fail depending on the system they're built on ## Steps To Reproduce 1. Build `https://github.com/getchoo/borealis/commit/99b8b8320a62da18655f1c5f1f67e62a7ce25af5#nixosConfigurations.glados-wsl.pkgs.nix` (which uses the NixOS module/overlay) or `https://git.lix.systems/lix-project/lix/archive/2.92.0.tar.gz` on one machine 2. Build them on another, like GitHub Actions ## Expected behavior Install checks consistently pass or fail ## `nix --version` output From the version of Lix where checks *did* succeed: ``` nix (Lix, like Nix) 2.92.0 System type: x86_64-linux Additional system types: i686-linux, x86_64-v1-linux, x86_64-v2-linux, x86_64-v3-linux Features: gc, signed-caches System configuration file: /etc/nix/nix.conf User configuration files: /home/seth/.config/nix/nix.conf:/etc/xdg/nix/nix.conf:/home/seth/.nix-profile/etc/xdg/nix/nix.conf:/nix/profile/etc/xdg/nix/nix.conf:/home/seth/.local/state/nix/profile/etc/xdg/nix/nix.conf:/etc/profiles/per-user/seth/etc/xdg/nix/nix.conf:/nix/var/nix/profiles/default/etc/xdg/nix/nix.conf:/run/current-system/sw/etc/xdg/nix/nix.conf Store directory: /nix/store State directory: /nix/var/nix Data directory: /nix/store/v6rpybz1pwr46kff20q7ddm28kkqcqqf-lix-2.92.0/share ``` ## Additional context Here are two repeated failures in GitHub actions against https://github.com/getchoo/borealis/commit/99b8b8320a62da18655f1c5f1f67e62a7ce25af5: https://github.com/getchoo/borealis/actions/runs/13538509877/job/37834411226 https://github.com/getchoo/borealis/actions/runs/13538509877/job/37837497448 TL;DR: ``` error: builder for '/nix/store/dxqlkk1asz0i8zxq0gdk9clb7a9d6dzp-lix-2.92.0.drv' failed with exit code 12; last 25 log lines: > 167/167 lix:installcheck / functional2 OK 1.57s > > Summary of Failures: > > 83/167 lix:installcheck / functional-build-remote-input-addressed FAIL 0.38s exit status 1 > 95/167 lix:installcheck / functional-build-remote-content-addressed-fixed FAIL 0.38s exit status 1 > 96/167 lix:installcheck / functional-build-remote-content-addressed-floating FAIL 0.38s exit status 1 > 97/167 lix:installcheck / functional-build-remote-trustless-should-pass-0 FAIL 0.41s exit status 1 > 98/167 lix:installcheck / functional-build-remote-trustless-should-pass-1 FAIL 0.39s exit status 1 > 100/167 lix:installcheck / functional-build-remote-trustless-should-pass-2 FAIL 0.41s exit status 1 > 101/167 lix:installcheck / functional-build-remote-trustless-should-pass-3 FAIL 0.41s exit status 1 > 102/167 lix:installcheck / functional-build-remote-trustless-should-fail-0 FAIL 0.33s exit status 100 > 117/167 lix:installcheck / functional-linux-sandbox FAIL 0.27s exit status 100 > 118/167 lix:installcheck / functional-supplementary-groups FAIL 0.15s exit status 1 > 124/167 lix:installcheck / functional-shell FAIL 0.83s exit status 1 > 155/167 lix:installcheck / functional-nested-sandboxing FAIL 0.30s exit status 1 > > Ok: 151 > Expected Fail: 0 > Fail: 12 > Unexpected Pass: 0 > Skipped: 4 > Timeout: 0 > > Full log written to /build/source/build/meson-logs/testlog.txt For full logs, run 'nix log /nix/store/dxqlkk1asz0i8zxq0gdk9clb7a9d6dzp-lix-2.92.0.drv'. ``` And the relevant sections from my flake.lock: ```json "lix": { "flake": false, "locked": { "lastModified": 1737234286, "narHash": "sha256-CCKIAE84dzkrnlxJCKFyffAxP3yfsOAbdvydUGqq24g=", "rev": "2837da71ec1588c1187d2e554719b15904a46c8b", "type": "tarball", "url": "https://git.lix.systems/api/v1/repos/lix-project/lix/archive/2837da71ec1588c1187d2e554719b15904a46c8b.tar.gz?rev=2837da71ec1588c1187d2e554719b15904a46c8b" }, "original": { "type": "tarball", "url": "https://git.lix.systems/lix-project/lix/archive/2.92.0.tar.gz" } }, "lix-module": { "inputs": { "flake-utils": "flake-utils", "flakey-profile": [], "lix": "lix", "nixpkgs": [ "nixpkgs" ] }, "locked": { "lastModified": 1737237494, "narHash": "sha256-YMLrcBpf0TR5r/eaqm8lxzFPap2TxCor0ZGcK3a7+b8=", "rev": "b90bf629bbd835e61f1317b99e12f8c831017006", "type": "tarball", "url": "https://git.lix.systems/api/v1/repos/lix-project/nixos-module/archive/b90bf629bbd835e61f1317b99e12f8c831017006.tar.gz" }, "original": { "type": "tarball", "url": "https://git.lix.systems/lix-project/nixos-module/archive/refs/tags/2.92.0.tar.gz" } }, ```