alois31/lix
0
0
Fork 0
forked from lix-project/lix
Code Pull requests Activity
lix/tests/ca/substitute.sh

66 lines
2.4 KiB
Bash
Raw Normal View History

Add a test for the remote caching of CA derivations
2020-11-09 15:04:43 +00:00
#!/usr/bin/env bash
# Ensure that binary substitution works properly with ca derivations
source common.sh
Allow running all the tests with the daemon When `NIX_DAEMON_PACKAGE` is set, make all the tests use the Nix daemon. That way we can test every piece of Nix functionality both with and without the daemon. Tests for which using the daemon isn’t possible or doesn’t make sens can selectively be disabled with `needLocalStore`
2021-07-26 04:54:55 +00:00
needLocalStore "“--no-require-sigs” can’t be used with the daemon"
Add a test for the remote caching of CA derivations
2020-11-09 15:04:43 +00:00
LocalBinaryCacheStore::upsertFile(): Fix race When multiple threads try to upsert the same file, this could fail. Fixes #4667.
2021-03-26 16:10:15 +00:00
rm -rf $TEST_ROOT/binary_cache
Add a regression test for #4725
2021-04-22 15:54:02 +00:00
export REMOTE_STORE_DIR=$TEST_ROOT/binary_cache
export REMOTE_STORE=file://$REMOTE_STORE_DIR
Add a test for the remote caching of CA derivations
2020-11-09 15:04:43 +00:00
buildDrvs () {
nix build --file ./content-addressed.nix -L --no-link "$@"
}
# Populate the remote cache
LocalBinaryCacheStore::upsertFile(): Fix race When multiple threads try to upsert the same file, this could fail. Fixes #4667.
2021-03-26 16:10:15 +00:00
clearStore
Recursively substitute the realisations Make sure that whenever we substitute a realisation, we also substitute its entire closure
2021-05-19 12:51:34 +00:00
nix copy --to $REMOTE_STORE --file ./content-addressed.nix
Add a test for the remote caching of CA derivations
2020-11-09 15:04:43 +00:00
# Restart the build on an empty store, ensuring that we don't build
clearStore
Recursively substitute the realisations Make sure that whenever we substitute a realisation, we also substitute its entire closure
2021-05-19 12:51:34 +00:00
buildDrvs --substitute --substituters $REMOTE_STORE --no-require-sigs -j0 transitivelyDependentCA
# Check that the thing we’ve just substituted has its realisation stored
nix realisation info --file ./content-addressed.nix transitivelyDependentCA
# Check that its dependencies have it too
nix: Respect meta.outputsToInstall, and use all outputs by default 'nix profile install' will now install all outputs listed in the package's meta.outputsToInstall attribute, or all outputs if that attribute doesn't exist. This makes it behave consistently with nix-env. Fixes #6385. Furthermore, for consistency, all other 'nix' commands do this as well. E.g. 'nix build' will build and symlink the outputs in meta.outputsToInstall, defaulting to all outputs. Previously, it only built/symlinked the first output. Note that this means that selecting a specific output using attrpath selection (e.g. 'nix build nixpkgs#libxml2.dev') no longer works. A subsequent PR will add a way to specify the desired outputs explicitly.
2022-04-20 14:39:47 +00:00
nix realisation info --file ./content-addressed.nix dependentCA
# nix realisation info --file ./content-addressed.nix rootCA --outputs out
Add a test for the remote caching of CA derivations
2020-11-09 15:04:43 +00:00
Add a regression test for #4725
2021-04-22 15:54:02 +00:00
# Same thing, but
# 1. With non-ca derivations
# 2. Erasing the realisations on the remote store
#
# Even in that case, realising the derivations should still produce the right
# realisations on the local store
#
# Regression test for #4725
clearStore
nix build --file ../simple.nix -L --no-link --post-build-hook ../push-to-store.sh
clearStore
rm -r "$REMOTE_STORE_DIR/realisations"
nix build --file ../simple.nix -L --no-link --substitute --substituters "$REMOTE_STORE" --no-require-sigs -j0
fixup! Add a regression test for #4725
2021-04-23 07:34:16 +00:00
# There's no easy way to check whether a realisation is present on the local
# store − short of manually querying the db, but the build environment doesn't
# have the sqlite binary − so we instead push things again, and check that the
# realisations have correctly been pushed to the remote store
nix copy --to "$REMOTE_STORE" --file ../simple.nix
if [[ -z "$(ls "$REMOTE_STORE_DIR/realisations")" ]]; then
Add a regression test for #4725
2021-04-22 15:54:02 +00:00
echo "Realisations not rebuilt"
exit 1
fi
Add a realisations disk cache Similar to the nar-info disk cache (and using the same db). This makes rebuilds muuch faster. - This works regardless of the ca-derivations experimental feature. I could modify the logic to not touch the db if the flag isn’t there, but given that this is a trash-able local cache, it doesn’t seem to be really worth it. - We could unify the `NARs` and `Realisation` tables to only have one generic kv table. This is left as an exercise to the reader. - I didn’t update the cache db version number as the new schema just adds a new table to the previous one, so the db will be transparently migrated and is backwards-compatible. Fix #4746
2021-05-06 14:45:09 +00:00
# Test the local realisation disk cache
buildDrvs --post-build-hook ../push-to-store.sh
clearStore
# Add the realisations of rootCA to the cachecache
clearCacheCache
export _NIX_FORCE_HTTP=1
buildDrvs --substitute --substituters $REMOTE_STORE --no-require-sigs -j0
# Try rebuilding, but remove the realisations from the remote cache to force
# using the cachecache
clearStore
rm $REMOTE_STORE_DIR/realisations/*
buildDrvs --substitute --substituters $REMOTE_STORE --no-require-sigs -j0
Copy permalink