lix-project/lix-releng-staging
0
0
Fork 0
Code Packages Activity
lix-releng-staging/tests/check.sh

89 lines
3 KiB
Bash
Raw Normal View History

Add a test for --check / --repeat
2018-01-19 12:58:28 +00:00
source common.sh
Allow running all the tests with the daemon When `NIX_DAEMON_PACKAGE` is set, make all the tests use the Nix daemon. That way we can test every piece of Nix functionality both with and without the daemon. Tests for which using the daemon isn’t possible or doesn’t make sens can selectively be disabled with `needLocalStore`
2021-07-26 04:54:55 +00:00
# XXX: This shouldn’t be, but #4813 cause this test to fail
buggyNeedLocalStore "see #4813"
Delete temporary directory on successful build With --check and the --keep-failed (-K) flag, the temporary directory was being retained regardless of whether the build was successful and reproducible. This removes the temporary directory, as expected, on a reproducible check build. Added tests to verify that temporary build directories are not retained unnecessarily, particularly when using --check with --keep-failed.
2019-02-17 21:26:49 +00:00
checkBuildTempDirRemoved ()
{
buildDir=$(sed -n 's/CHECK_TMPDIR=//p' $1 | head -1)
checkBuildIdFile=${buildDir}/checkBuildId
[[ ! -f $checkBuildIdFile ]] || ! grep $checkBuildId $checkBuildIdFile
}
# written to build temp directories to verify created by this instance
checkBuildId=$(date +%s%N)
Add a test for --check / --repeat
2018-01-19 12:58:28 +00:00
clearStore
nix-build dependencies.nix --no-out-link
nix-build dependencies.nix --no-out-link --check
Delete temporary directory on successful build With --check and the --keep-failed (-K) flag, the temporary directory was being retained regardless of whether the build was successful and reproducible. This removes the temporary directory, as expected, on a reproducible check build. Added tests to verify that temporary build directories are not retained unnecessarily, particularly when using --check with --keep-failed.
2019-02-17 21:26:49 +00:00
# check for dangling temporary build directories
# only retain if build fails and --keep-failed is specified, or...
# ...build is non-deterministic and --check and --keep-failed are both specified
nix-build check.nix -A failed --argstr checkBuildId $checkBuildId \
--no-out-link 2> $TEST_ROOT/log || status=$?
[ "$status" = "100" ]
checkBuildTempDirRemoved $TEST_ROOT/log
nix-build check.nix -A failed --argstr checkBuildId $checkBuildId \
--no-out-link --keep-failed 2> $TEST_ROOT/log || status=$?
[ "$status" = "100" ]
if checkBuildTempDirRemoved $TEST_ROOT/log; then false; fi
nix-build check.nix -A deterministic --argstr checkBuildId $checkBuildId \
--no-out-link 2> $TEST_ROOT/log
checkBuildTempDirRemoved $TEST_ROOT/log
nix-build check.nix -A deterministic --argstr checkBuildId $checkBuildId \
--no-out-link --check --keep-failed 2> $TEST_ROOT/log
Harden tests' bash Use `set -u` and `set -o pipefail` to catch accidental mistakes and failures more strongly. - `set -u` catches the use of undefined variables - `set -o pipefail` catches failures (like `set -e`) earlier in the pipeline. This makes the tests a bit more robust. It is nice to read code not worrying about these spurious success paths (via uncaught) errors undermining the tests. Indeed, I caught some bugs doing this. There are a few tests where we run a command that should fail, and then search its output to make sure the failure message is one that we expect. Before, since the `grep` was the last command in the pipeline the exit code of those failing programs was silently ignored. Now with `set -o pipefail` it won't be, and we have to do something so the expected failure doesn't accidentally fail the test. To do that we use `expect` and a new `expectStderr` to check for the exact failing exit code. See the comments on each for why. `grep -q` is replaced with `grepQuiet`, see the comments on that function for why. `grep -v` when we just want the exit code is replaced with `grepInverse, see the comments on that function for why. `grep -q -v` together is, surprise surprise, replaced with `grepQuietInverse`, which is both combined. Co-authored-by: Robert Hensing <roberth@users.noreply.github.com>
2021-12-09 15:26:46 +00:00
if grepQuiet 'may not be deterministic' $TEST_ROOT/log; then false; fi
Delete temporary directory on successful build With --check and the --keep-failed (-K) flag, the temporary directory was being retained regardless of whether the build was successful and reproducible. This removes the temporary directory, as expected, on a reproducible check build. Added tests to verify that temporary build directories are not retained unnecessarily, particularly when using --check with --keep-failed.
2019-02-17 21:26:49 +00:00
checkBuildTempDirRemoved $TEST_ROOT/log
nix-build check.nix -A nondeterministic --argstr checkBuildId $checkBuildId \
--no-out-link 2> $TEST_ROOT/log
checkBuildTempDirRemoved $TEST_ROOT/log
nix-build check.nix -A nondeterministic --argstr checkBuildId $checkBuildId \
--no-out-link --check 2> $TEST_ROOT/log || status=$?
grep 'may not be deterministic' $TEST_ROOT/log
[ "$status" = "104" ]
checkBuildTempDirRemoved $TEST_ROOT/log
nix-build check.nix -A nondeterministic --argstr checkBuildId $checkBuildId \
--no-out-link --check --keep-failed 2> $TEST_ROOT/log || status=$?
Add a test for --check / --repeat
2018-01-19 12:58:28 +00:00
grep 'may not be deterministic' $TEST_ROOT/log
build: replace 100 offset for build exit codes
2019-06-15 13:28:32 +00:00
[ "$status" = "104" ]
Delete temporary directory on successful build With --check and the --keep-failed (-K) flag, the temporary directory was being retained regardless of whether the build was successful and reproducible. This removes the temporary directory, as expected, on a reproducible check build. Added tests to verify that temporary build directories are not retained unnecessarily, particularly when using --check with --keep-failed.
2019-02-17 21:26:49 +00:00
if checkBuildTempDirRemoved $TEST_ROOT/log; then false; fi
Add a test for --check / --repeat
2018-01-19 12:58:28 +00:00
clearStore
Replace --hashed-mirrors with substituters test
2020-06-12 19:39:44 +00:00
path=$(nix-build check.nix -A fetchurl --no-out-link)
Rewrite builtin derivation environment Also add a test. Fixes #1803. Closes #1805.
2018-01-19 13:53:34 +00:00
chmod +w $path
echo foo > $path
chmod -w $path
Replace --hashed-mirrors with substituters test
2020-06-12 19:39:44 +00:00
nix-build check.nix -A fetchurl --no-out-link --check
Rewrite builtin derivation environment Also add a test. Fixes #1803. Closes #1805.
2018-01-19 13:53:34 +00:00
# Note: "check" doesn't repair anything, it just compares to the hash stored in the database.
[[ $(cat $path) = foo ]]
Replace --hashed-mirrors with substituters test
2020-06-12 19:39:44 +00:00
nix-build check.nix -A fetchurl --no-out-link --repair
Rewrite builtin derivation environment Also add a test. Fixes #1803. Closes #1805.
2018-01-19 13:53:34 +00:00
[[ $(cat $path) != foo ]]
build: add tests for --check status codes
2019-05-11 21:32:53 +00:00
tests: don't refer to TMPDIR
2022-12-06 15:36:42 +00:00
echo 'Hello World' > $TEST_ROOT/dummy
Replace --hashed-mirrors with substituters test
2020-06-12 19:39:44 +00:00
nix-build check.nix -A hashmismatch --no-out-link || status=$?
build: add tests for --check status codes
2019-05-11 21:32:53 +00:00
[ "$status" = "102" ]
tests: don't refer to TMPDIR
2022-12-06 15:36:42 +00:00
echo -n > $TEST_ROOT/dummy
Replace --hashed-mirrors with substituters test
2020-06-12 19:39:44 +00:00
nix-build check.nix -A hashmismatch --no-out-link
tests: don't refer to TMPDIR
2022-12-06 15:36:42 +00:00
echo 'Hello World' > $TEST_ROOT/dummy
build: add tests for --check status codes
2019-05-11 21:32:53 +00:00
Replace --hashed-mirrors with substituters test
2020-06-12 19:39:44 +00:00
nix-build check.nix -A hashmismatch --no-out-link --check || status=$?
build: add tests for --check status codes
2019-05-11 21:32:53 +00:00
[ "$status" = "102" ]
# Multiple failures with --keep-going
nix-build check.nix -A nondeterministic --no-out-link
Replace --hashed-mirrors with substituters test
2020-06-12 19:39:44 +00:00
nix-build check.nix -A nondeterministic -A hashmismatch --no-out-link --check --keep-going || status=$?
build: replace 100 offset for build exit codes
2019-06-15 13:28:32 +00:00
[ "$status" = "110" ]
Copy permalink