alois31/lix
0
0
Fork 0
forked from lix-project/lix
Code Pull requests Activity
lix/tests/binary-cache.sh

287 lines
8.3 KiB
Bash
Raw Normal View History

Add a test for the binary cache substituter
2012-07-26 21:13:14 +00:00
source common.sh
Add a test for fetchClosure and 'nix store make-content-addressed'
2022-03-22 22:19:21 +00:00
needLocalStore "'--no-require-sigs' can’t be used with the daemon"
Allow running all the tests with the daemon When `NIX_DAEMON_PACKAGE` is set, make all the tests use the Nix daemon. That way we can test every piece of Nix functionality both with and without the daemon. Tests for which using the daemon isn’t possible or doesn’t make sens can selectively be disabled with `needLocalStore`
2021-07-26 04:54:55 +00:00
Test nix-instantiate with binary cache store Trying to make sure it work with obscurers stores.
2020-12-20 19:55:21 +00:00
# We can produce drvs directly into the binary cache
Add a test for the binary cache substituter
2012-07-26 21:13:14 +00:00
clearStore
Test nix-instantiate with binary cache store Trying to make sure it work with obscurers stores.
2020-12-20 19:55:21 +00:00
clearCacheCache
nix-instantiate --store "file://$cacheDir" dependencies.nix
Add a test for the binary cache substituter
2012-07-26 21:13:14 +00:00
Test "nix-env -qas" with the binary cache substituter
2012-07-27 18:15:03 +00:00
# Create the binary cache.
Test nix-instantiate with binary cache store Trying to make sure it work with obscurers stores.
2020-12-20 19:55:21 +00:00
clearStore
clearCache
Add a test for the binary cache substituter
2012-07-26 21:13:14 +00:00
outPath=$(nix-build dependencies.nix --no-out-link)
Fix tests `nix copy` no longer accepts a `--recursive` argument
2017-10-03 03:41:29 +00:00
nix copy --to file://$cacheDir $outPath
Add a test for the binary cache substituter
2012-07-26 21:13:14 +00:00
Add a test for 'nix store copy-log' and 'nix log'
2022-01-18 16:30:50 +00:00
# Test copying build logs to the binary cache.
nix log --store file://$cacheDir $outPath 2>&1 | grep 'is not available'
nix store copy-log --to file://$cacheDir $outPath
nix log --store file://$cacheDir $outPath | grep FOO
rm -rf $TEST_ROOT/var/log/nix
nix log $outPath 2>&1 | grep 'is not available'
nix log --substituters file://$cacheDir $outPath | grep FOO
# Test copying build logs from the binary cache.
nix store copy-log --from file://$cacheDir $(nix-store -qd $outPath)
nix log $outPath | grep FOO
Allow a binary cache to declare that it doesn't support "nix-env -qas" Querying all substitutable paths via "nix-env -qas" is potentially hard on a server, since it involves sending thousands of HEAD requests. So a binary cache must now have a meta-info file named "nix-cache-info" that specifies whether the server wants this. It also specifies the store prefix so that we don't send useless queries to a binary cache for a different store prefix.
2012-07-27 22:16:05 +00:00
Test nix-instantiate with binary cache store Trying to make sure it work with obscurers stores.
2020-12-20 19:55:21 +00:00
basicDownloadTests() {
# No uploading tests bcause upload with force HTTP doesn't work.
Add a test for the binary cache substituter
2012-07-26 21:13:14 +00:00
HttpBinaryCacheStore: Fix caching of WantMassQuery Also, test HttpBinaryCacheStore in addition to LocalBinaryCacheStore.
2016-06-01 13:15:21 +00:00
# By default, a binary cache doesn't support "nix-env -qas", but does
# support installation.
clearStore
clearCacheCache
Test NAR info caching
2013-04-23 10:43:28 +00:00
Test: Replace --option with the corresponding flag
2017-11-20 16:50:49 +00:00
nix-env --substituters "file://$cacheDir" -f dependencies.nix -qas \* | grep -- "---"
Allow a binary cache to declare that it doesn't support "nix-env -qas" Querying all substitutable paths via "nix-env -qas" is potentially hard on a server, since it involves sending thousands of HEAD requests. So a binary cache must now have a meta-info file named "nix-cache-info" that specifies whether the server wants this. It also specifies the store prefix so that we don't send useless queries to a binary cache for a different store prefix.
2012-07-27 22:16:05 +00:00
Test: Replace --option with the corresponding flag
2017-11-20 16:50:49 +00:00
nix-store --substituters "file://$cacheDir" --no-require-sigs -r $outPath
Allow a binary cache to declare that it doesn't support "nix-env -qas" Querying all substitutable paths via "nix-env -qas" is potentially hard on a server, since it involves sending thousands of HEAD requests. So a binary cache must now have a meta-info file named "nix-cache-info" that specifies whether the server wants this. It also specifies the store prefix so that we don't send useless queries to a binary cache for a different store prefix.
2012-07-27 22:16:05 +00:00
HttpBinaryCacheStore: Fix caching of WantMassQuery Also, test HttpBinaryCacheStore in addition to LocalBinaryCacheStore.
2016-06-01 13:15:21 +00:00
[ -x $outPath/program ]
Test executables in NARs
2014-02-26 17:59:01 +00:00
Allow a binary cache to declare that it doesn't support "nix-env -qas" Querying all substitutable paths via "nix-env -qas" is potentially hard on a server, since it involves sending thousands of HEAD requests. So a binary cache must now have a meta-info file named "nix-cache-info" that specifies whether the server wants this. It also specifies the store prefix so that we don't send useless queries to a binary cache for a different store prefix.
2012-07-27 22:16:05 +00:00
HttpBinaryCacheStore: Fix caching of WantMassQuery Also, test HttpBinaryCacheStore in addition to LocalBinaryCacheStore.
2016-06-01 13:15:21 +00:00
# But with the right configuration, "nix-env -qas" should also work.
clearStore
clearCacheCache
echo "WantMassQuery: 1" >> $cacheDir/nix-cache-info
Test: Replace --option with the corresponding flag
2017-11-20 16:50:49 +00:00
nix-env --substituters "file://$cacheDir" -f dependencies.nix -qas \* | grep -- "--S"
nix-env --substituters "file://$cacheDir" -f dependencies.nix -qas \* | grep -- "--S"
HttpBinaryCacheStore: Fix caching of WantMassQuery Also, test HttpBinaryCacheStore in addition to LocalBinaryCacheStore.
2016-06-01 13:15:21 +00:00
x=$(nix-env -f dependencies.nix -qas \* --prebuilt-only)
[ -z "$x" ]
Test: Replace --option with the corresponding flag
2017-11-20 16:50:49 +00:00
nix-store --substituters "file://$cacheDir" --no-require-sigs -r $outPath
HttpBinaryCacheStore: Fix caching of WantMassQuery Also, test HttpBinaryCacheStore in addition to LocalBinaryCacheStore.
2016-06-01 13:15:21 +00:00
nix-store --check-validity $outPath
nix-store -qR $outPath | grep input-2
echo "WantMassQuery: 0" >> $cacheDir/nix-cache-info
}
# Test LocalBinaryCacheStore.
Test nix-instantiate with binary cache store Trying to make sure it work with obscurers stores.
2020-12-20 19:55:21 +00:00
basicDownloadTests
Allow a binary cache to declare that it doesn't support "nix-env -qas" Querying all substitutable paths via "nix-env -qas" is potentially hard on a server, since it involves sending thousands of HEAD requests. So a binary cache must now have a meta-info file named "nix-cache-info" that specifies whether the server wants this. It also specifies the store prefix so that we don't send useless queries to a binary cache for a different store prefix.
2012-07-27 22:16:05 +00:00
Test "nix-env -qas" with the binary cache substituter
2012-07-27 18:15:03 +00:00
HttpBinaryCacheStore: Fix caching of WantMassQuery Also, test HttpBinaryCacheStore in addition to LocalBinaryCacheStore.
2016-06-01 13:15:21 +00:00
# Test HttpBinaryCacheStore.
Misc changes from the flakes branch
2020-03-24 13:26:13 +00:00
export _NIX_FORCE_HTTP=1
Test nix-instantiate with binary cache store Trying to make sure it work with obscurers stores.
2020-12-20 19:55:21 +00:00
basicDownloadTests
Test the ‘--prebuilt-only’ flag
2012-12-03 20:02:06 +00:00
Add a test for the binary cache substituter
2012-07-26 21:13:14 +00:00
Test whether Nix correctly checks the hash of downloaded NARs
2014-01-08 16:56:30 +00:00
# Test whether Nix notices if the NAR doesn't match the hash in the NAR info.
clearStore
Revert "narinfo: Change NAR URLs to be addressed on the NAR hash instead of the compressed hash"
2021-02-09 17:26:41 +00:00
nar=$(ls $cacheDir/nar/*.nar.xz | head -n1)
Test whether Nix correctly checks the hash of downloaded NARs
2014-01-08 16:56:30 +00:00
mv $nar $nar.good
mkdir -p $TEST_ROOT/empty
nix-store --dump $TEST_ROOT/empty | xz > $nar
Test: Replace --option with the corresponding flag
2017-11-20 16:50:49 +00:00
nix-build --substituters "file://$cacheDir" --no-require-sigs dependencies.nix -o $TEST_ROOT/result 2>&1 | tee $TEST_ROOT/log
LocalStore::addToStore: Verify hash of the imported path
2016-05-30 11:44:09 +00:00
grep -q "hash mismatch" $TEST_ROOT/log
Test whether Nix correctly checks the hash of downloaded NARs
2014-01-08 16:56:30 +00:00
mv $nar.good $nar
Support cryptographically signed binary caches NAR info files in binary caches can now have a cryptographic signature that Nix will verify before using the corresponding NAR file. To create a private/public key pair for signing and verifying a binary cache, do: $ openssl genrsa -out ./cache-key.sec 2048 $ openssl rsa -in ./cache-key.sec -pubout > ./cache-key.pub You should also come up with a symbolic name for the key, such as "cache.example.org-1". This will be used by clients to look up the public key. (It's a good idea to number keys, in case you ever need to revoke/replace one.) To create a binary cache signed with the private key: $ nix-push --dest /path/to/binary-cache --key ./cache-key.sec --key-name cache.example.org-1 The public key (cache-key.pub) should be distributed to the clients. They should have a nix.conf should contain something like: signed-binary-caches = * binary-cache-public-key-cache.example.org-1 = /path/to/cache-key.pub If all works well, then if Nix fetches something from the signed binary cache, you will see a message like: *** Downloading ‘http://cache.example.org/nar/7dppcj5sc1nda7l54rjc0g5l1hamj09j-subversion-1.7.11’ (signed by ‘cache.example.org-1’) to ‘/nix/store/7dppcj5sc1nda7l54rjc0g5l1hamj09j-subversion-1.7.11’... On the other hand, if the signature is wrong, you get a message like NAR info file `http://cache.example.org/7dppcj5sc1nda7l54rjc0g5l1hamj09j.narinfo' has an invalid signature; ignoring Signatures are implemented as a single line appended to the NAR info file, which looks like this: Signature: 1;cache.example.org-1;HQ9Xzyanq9iV...muQ== Thus the signature has 3 fields: a version (currently "1"), the ID of key, and the base64-encoded signature of the SHA-256 hash of the contents of the NAR info file up to but not including the Signature line. Issue #75.
2014-01-08 14:23:41 +00:00
# Test whether this unsigned cache is rejected if the user requires signed caches.
clearStore
Test the NAR info cache
2016-05-30 12:53:57 +00:00
clearCacheCache
Support cryptographically signed binary caches NAR info files in binary caches can now have a cryptographic signature that Nix will verify before using the corresponding NAR file. To create a private/public key pair for signing and verifying a binary cache, do: $ openssl genrsa -out ./cache-key.sec 2048 $ openssl rsa -in ./cache-key.sec -pubout > ./cache-key.pub You should also come up with a symbolic name for the key, such as "cache.example.org-1". This will be used by clients to look up the public key. (It's a good idea to number keys, in case you ever need to revoke/replace one.) To create a binary cache signed with the private key: $ nix-push --dest /path/to/binary-cache --key ./cache-key.sec --key-name cache.example.org-1 The public key (cache-key.pub) should be distributed to the clients. They should have a nix.conf should contain something like: signed-binary-caches = * binary-cache-public-key-cache.example.org-1 = /path/to/cache-key.pub If all works well, then if Nix fetches something from the signed binary cache, you will see a message like: *** Downloading ‘http://cache.example.org/nar/7dppcj5sc1nda7l54rjc0g5l1hamj09j-subversion-1.7.11’ (signed by ‘cache.example.org-1’) to ‘/nix/store/7dppcj5sc1nda7l54rjc0g5l1hamj09j-subversion-1.7.11’... On the other hand, if the signature is wrong, you get a message like NAR info file `http://cache.example.org/7dppcj5sc1nda7l54rjc0g5l1hamj09j.narinfo' has an invalid signature; ignoring Signatures are implemented as a single line appended to the NAR info file, which looks like this: Signature: 1;cache.example.org-1;HQ9Xzyanq9iV...muQ== Thus the signature has 3 fields: a version (currently "1"), the ID of key, and the base64-encoded signature of the SHA-256 hash of the contents of the NAR info file up to but not including the Signature line. Issue #75.
2014-01-08 14:23:41 +00:00
Test: Replace --option with the corresponding flag
2017-11-20 16:50:49 +00:00
if nix-store --substituters "file://$cacheDir" -r $outPath; then
Fix signed-binary-caches test
2014-01-08 16:56:58 +00:00
echo "unsigned binary cache incorrectly accepted"
exit 1
fi
Support cryptographically signed binary caches NAR info files in binary caches can now have a cryptographic signature that Nix will verify before using the corresponding NAR file. To create a private/public key pair for signing and verifying a binary cache, do: $ openssl genrsa -out ./cache-key.sec 2048 $ openssl rsa -in ./cache-key.sec -pubout > ./cache-key.pub You should also come up with a symbolic name for the key, such as "cache.example.org-1". This will be used by clients to look up the public key. (It's a good idea to number keys, in case you ever need to revoke/replace one.) To create a binary cache signed with the private key: $ nix-push --dest /path/to/binary-cache --key ./cache-key.sec --key-name cache.example.org-1 The public key (cache-key.pub) should be distributed to the clients. They should have a nix.conf should contain something like: signed-binary-caches = * binary-cache-public-key-cache.example.org-1 = /path/to/cache-key.pub If all works well, then if Nix fetches something from the signed binary cache, you will see a message like: *** Downloading ‘http://cache.example.org/nar/7dppcj5sc1nda7l54rjc0g5l1hamj09j-subversion-1.7.11’ (signed by ‘cache.example.org-1’) to ‘/nix/store/7dppcj5sc1nda7l54rjc0g5l1hamj09j-subversion-1.7.11’... On the other hand, if the signature is wrong, you get a message like NAR info file `http://cache.example.org/7dppcj5sc1nda7l54rjc0g5l1hamj09j.narinfo' has an invalid signature; ignoring Signatures are implemented as a single line appended to the NAR info file, which looks like this: Signature: 1;cache.example.org-1;HQ9Xzyanq9iV...muQ== Thus the signature has 3 fields: a version (currently "1"), the ID of key, and the base64-encoded signature of the SHA-256 hash of the contents of the NAR info file up to but not including the Signature line. Issue #75.
2014-01-08 14:23:41 +00:00
Don't require --fallback to recover from disappeared binary cache NARs
2018-06-05 14:04:41 +00:00
# Test whether fallback works if a NAR has disappeared. This does not require --fallback.
Test whether --fallback works if NARS have disappeared from the binary cache
2013-04-23 10:44:01 +00:00
clearStore
Don't require --fallback to recover from disappeared binary cache NARs
2018-06-05 14:04:41 +00:00
mv $cacheDir/nar $cacheDir/nar2
nix-build --substituters "file://$cacheDir" --no-require-sigs dependencies.nix -o $TEST_ROOT/result
mv $cacheDir/nar2 $cacheDir/nar
# Test whether fallback works if a NAR is corrupted. This does require --fallback.
clearStore
Test whether --fallback works if NARS have disappeared from the binary cache
2013-04-23 10:44:01 +00:00
Improve binary cache fallback test
2018-06-05 12:44:26 +00:00
mv $cacheDir/nar $cacheDir/nar2
Don't require --fallback to recover from disappeared binary cache NARs
2018-06-05 14:04:41 +00:00
mkdir $cacheDir/nar
for i in $(cd $cacheDir/nar2 && echo *); do touch $cacheDir/nar/$i; done
Test whether --fallback works if NARS have disappeared from the binary cache
2013-04-23 10:44:01 +00:00
Improve binary cache fallback test
2018-06-05 12:44:26 +00:00
(! nix-build --substituters "file://$cacheDir" --no-require-sigs dependencies.nix -o $TEST_ROOT/result)
Test whether --fallback works if NARS have disappeared from the binary cache
2013-04-23 10:44:01 +00:00
Improve binary cache fallback test
2018-06-05 12:44:26 +00:00
nix-build --substituters "file://$cacheDir" --no-require-sigs dependencies.nix -o $TEST_ROOT/result --fallback
Don't require --fallback to recover from disappeared binary cache NARs
2018-06-05 14:04:41 +00:00
rm -rf $cacheDir/nar
Improve binary cache fallback test
2018-06-05 12:44:26 +00:00
mv $cacheDir/nar2 $cacheDir/nar
Test whether --fallback works if NARS have disappeared from the binary cache
2013-04-23 10:44:01 +00:00
Add a test for incomplete closures in the binary cache Issue #77.
2013-01-02 10:45:23 +00:00
# Test whether building works if the binary cache contains an
# incomplete closure.
clearStore
tests/binary-cache.sh: Improve incomplete closure test Issue #3373.
2020-05-12 11:49:55 +00:00
rm -v $(grep -l "StorePath:.*dependencies-input-2" $cacheDir/*.narinfo)
Add a test for incomplete closures in the binary cache Issue #77.
2013-01-02 10:45:23 +00:00
Test: Replace --option with the corresponding flag
2017-11-20 16:50:49 +00:00
nix-build --substituters "file://$cacheDir" --no-require-sigs dependencies.nix -o $TEST_ROOT/result 2>&1 | tee $TEST_ROOT/log
tests/binary-cache.sh: Improve incomplete closure test Issue #3373.
2020-05-12 11:49:55 +00:00
grep -q "copying path.*input-0" $TEST_ROOT/log
grep -q "copying path.*input-2" $TEST_ROOT/log
grep -q "copying path.*top" $TEST_ROOT/log
# Idem, but without cached .narinfo.
clearStore
clearCacheCache
nix-build --substituters "file://$cacheDir" --no-require-sigs dependencies.nix -o $TEST_ROOT/result 2>&1 | tee $TEST_ROOT/log
grep -q "don't know how to build" $TEST_ROOT/log
grep -q "building.*input-1" $TEST_ROOT/log
grep -q "building.*input-2" $TEST_ROOT/log
grep -q "copying path.*input-0" $TEST_ROOT/log
grep -q "copying path.*top" $TEST_ROOT/log
Use libsodium instead of OpenSSL for binary cache signing Sodium's Ed25519 signatures are much shorter than OpenSSL's RSA signatures. Public keys are also much shorter, so they're now specified directly in the nix.conf option ‘binary-cache-public-keys’. The new command ‘nix-store --generate-binary-cache-key’ generates and prints a public and secret key.
2015-02-04 15:43:32 +00:00
# Create a signed binary cache.
clearCache
Improve binary cache fallback test
2018-06-05 12:44:26 +00:00
clearCacheCache
Use libsodium instead of OpenSSL for binary cache signing Sodium's Ed25519 signatures are much shorter than OpenSSL's RSA signatures. Public keys are also much shorter, so they're now specified directly in the nix.conf option ‘binary-cache-public-keys’. The new command ‘nix-store --generate-binary-cache-key’ generates and prints a public and secret key.
2015-02-04 15:43:32 +00:00
Add commands for generating secret/public keys
2021-01-06 16:41:16 +00:00
nix key generate-secret --key-name test.nixos.org-1 > $TEST_ROOT/sk1
publicKey=$(nix key convert-secret-to-public < $TEST_ROOT/sk1)
Use libsodium instead of OpenSSL for binary cache signing Sodium's Ed25519 signatures are much shorter than OpenSSL's RSA signatures. Public keys are also much shorter, so they're now specified directly in the nix.conf option ‘binary-cache-public-keys’. The new command ‘nix-store --generate-binary-cache-key’ generates and prints a public and secret key.
2015-02-04 15:43:32 +00:00
Add commands for generating secret/public keys
2021-01-06 16:41:16 +00:00
nix key generate-secret --key-name test.nixos.org-1 > $TEST_ROOT/sk2
badKey=$(nix key convert-secret-to-public < $TEST_ROOT/sk2)
Use libsodium instead of OpenSSL for binary cache signing Sodium's Ed25519 signatures are much shorter than OpenSSL's RSA signatures. Public keys are also much shorter, so they're now specified directly in the nix.conf option ‘binary-cache-public-keys’. The new command ‘nix-store --generate-binary-cache-key’ generates and prints a public and secret key.
2015-02-04 15:43:32 +00:00
Add commands for generating secret/public keys
2021-01-06 16:41:16 +00:00
nix key generate-secret --key-name foo.nixos.org-1 > $TEST_ROOT/sk3
otherKey=$(nix key convert-secret-to-public < $TEST_ROOT/sk3)
Use libsodium instead of OpenSSL for binary cache signing Sodium's Ed25519 signatures are much shorter than OpenSSL's RSA signatures. Public keys are also much shorter, so they're now specified directly in the nix.conf option ‘binary-cache-public-keys’. The new command ‘nix-store --generate-binary-cache-key’ generates and prints a public and secret key.
2015-02-04 15:43:32 +00:00
Misc changes from the flakes branch
2020-03-24 13:26:13 +00:00
_NIX_FORCE_HTTP= nix copy --to file://$cacheDir?secret-key=$TEST_ROOT/sk1 $outPath
Use libsodium instead of OpenSSL for binary cache signing Sodium's Ed25519 signatures are much shorter than OpenSSL's RSA signatures. Public keys are also much shorter, so they're now specified directly in the nix.conf option ‘binary-cache-public-keys’. The new command ‘nix-store --generate-binary-cache-key’ generates and prints a public and secret key.
2015-02-04 15:43:32 +00:00
# Downloading should fail if we don't provide a key.
clearStore
Test the NAR info cache
2016-05-30 12:53:57 +00:00
clearCacheCache
Use libsodium instead of OpenSSL for binary cache signing Sodium's Ed25519 signatures are much shorter than OpenSSL's RSA signatures. Public keys are also much shorter, so they're now specified directly in the nix.conf option ‘binary-cache-public-keys’. The new command ‘nix-store --generate-binary-cache-key’ generates and prints a public and secret key.
2015-02-04 15:43:32 +00:00
Test: Replace --option with the corresponding flag
2017-11-20 16:50:49 +00:00
(! nix-store -r $outPath --substituters "file://$cacheDir")
Use libsodium instead of OpenSSL for binary cache signing Sodium's Ed25519 signatures are much shorter than OpenSSL's RSA signatures. Public keys are also much shorter, so they're now specified directly in the nix.conf option ‘binary-cache-public-keys’. The new command ‘nix-store --generate-binary-cache-key’ generates and prints a public and secret key.
2015-02-04 15:43:32 +00:00
# And it should fail if we provide an incorrect key.
clearStore
Test the NAR info cache
2016-05-30 12:53:57 +00:00
clearCacheCache
Use libsodium instead of OpenSSL for binary cache signing Sodium's Ed25519 signatures are much shorter than OpenSSL's RSA signatures. Public keys are also much shorter, so they're now specified directly in the nix.conf option ‘binary-cache-public-keys’. The new command ‘nix-store --generate-binary-cache-key’ generates and prints a public and secret key.
2015-02-04 15:43:32 +00:00
Test: Replace --option with the corresponding flag
2017-11-20 16:50:49 +00:00
(! nix-store -r $outPath --substituters "file://$cacheDir" --trusted-public-keys "$badKey")
Use libsodium instead of OpenSSL for binary cache signing Sodium's Ed25519 signatures are much shorter than OpenSSL's RSA signatures. Public keys are also much shorter, so they're now specified directly in the nix.conf option ‘binary-cache-public-keys’. The new command ‘nix-store --generate-binary-cache-key’ generates and prints a public and secret key.
2015-02-04 15:43:32 +00:00
# It should succeed if we provide the correct key.
Test: Replace --option with the corresponding flag
2017-11-20 16:50:49 +00:00
nix-store -r $outPath --substituters "file://$cacheDir" --trusted-public-keys "$otherKey $publicKey"
Use libsodium instead of OpenSSL for binary cache signing Sodium's Ed25519 signatures are much shorter than OpenSSL's RSA signatures. Public keys are also much shorter, so they're now specified directly in the nix.conf option ‘binary-cache-public-keys’. The new command ‘nix-store --generate-binary-cache-key’ generates and prints a public and secret key.
2015-02-04 15:43:32 +00:00
# It should fail if we corrupt the .narinfo.
clearStore
Test trying the next substitute after a bad signature
2016-05-30 13:03:04 +00:00
cacheDir2=$TEST_ROOT/binary-cache-2
rm -rf $cacheDir2
cp -r $cacheDir $cacheDir2
for i in $cacheDir2/*.narinfo; do
Use libsodium instead of OpenSSL for binary cache signing Sodium's Ed25519 signatures are much shorter than OpenSSL's RSA signatures. Public keys are also much shorter, so they're now specified directly in the nix.conf option ‘binary-cache-public-keys’. The new command ‘nix-store --generate-binary-cache-key’ generates and prints a public and secret key.
2015-02-04 15:43:32 +00:00
grep -v References $i > $i.tmp
mv $i.tmp $i
done
Test the NAR info cache
2016-05-30 12:53:57 +00:00
clearCacheCache
Use libsodium instead of OpenSSL for binary cache signing Sodium's Ed25519 signatures are much shorter than OpenSSL's RSA signatures. Public keys are also much shorter, so they're now specified directly in the nix.conf option ‘binary-cache-public-keys’. The new command ‘nix-store --generate-binary-cache-key’ generates and prints a public and secret key.
2015-02-04 15:43:32 +00:00
Test: Replace --option with the corresponding flag
2017-11-20 16:50:49 +00:00
(! nix-store -r $outPath --substituters "file://$cacheDir2" --trusted-public-keys "$publicKey")
Test trying the next substitute after a bad signature
2016-05-30 13:03:04 +00:00
# If we provide a bad and a good binary cache, it should succeed.
Test: Replace --option with the corresponding flag
2017-11-20 16:50:49 +00:00
nix-store -r $outPath --substituters "file://$cacheDir2 file://$cacheDir" --trusted-public-keys "$publicKey"
Make libsodium an optional dependency
2015-02-10 10:54:06 +00:00
Add a test for NAR listing generation
2020-07-13 11:32:33 +00:00
unset _NIX_FORCE_HTTP
Fix 'nix verify --all' on a binary cache and add a test
2020-07-13 12:35:01 +00:00
# Test 'nix verify --all' on a binary cache.
Move most store-related commands to 'nix store'
2020-07-24 18:38:56 +00:00
nix store verify -vvvvv --all --store file://$cacheDir --no-trust
Fix 'nix verify --all' on a binary cache and add a test
2020-07-13 12:35:01 +00:00
Add a test for local NAR caching
2020-07-13 14:01:00 +00:00
# Test local NAR caching.
narCache=$TEST_ROOT/nar-cache
rm -rf $narCache
mkdir $narCache
Move NAR-related commands to 'nix nar'
2020-07-24 18:42:24 +00:00
[[ $(nix store cat --store "file://$cacheDir?local-nar-cache=$narCache" $outPath/foobar) = FOOBAR ]]
Add a test for local NAR caching
2020-07-13 14:01:00 +00:00
rm -rfv "$cacheDir/nar"
Move NAR-related commands to 'nix nar'
2020-07-24 18:42:24 +00:00
[[ $(nix store cat --store "file://$cacheDir?local-nar-cache=$narCache" $outPath/foobar) = FOOBAR ]]
Add a test for local NAR caching
2020-07-13 14:01:00 +00:00
Move NAR-related commands to 'nix nar'
2020-07-24 18:42:24 +00:00
(! nix store cat --store file://$cacheDir $outPath/foobar)
Add a test for local NAR caching
2020-07-13 14:01:00 +00:00
Add a test for NAR listing generation
2020-07-13 11:32:33 +00:00
# Test NAR listing generation.
clearCache
outPath=$(nix-build --no-out-link -E '
with import ./config.nix;
mkDerivation {
name = "nar-listing";
buildCommand = "mkdir $out; echo foo > $out/bar; ln -s xyzzy $out/link";
}
')
nix copy --to file://$cacheDir?write-nar-listing=1 $outPath
Make JSON equality tests agnostic to ordering It is in fact more sorted than before, but I don't think we want to guarantee anything about the ordering.
2020-08-04 01:09:52 +00:00
diff -u \
Fix .ls file names in binary caches These are not supposed to include the 'name' part of the store path. This was broken by 759947bf72.
2020-08-07 19:18:29 +00:00
<(jq -S < $cacheDir/$(basename $outPath | cut -c1-32).ls) \
Make JSON equality tests agnostic to ordering It is in fact more sorted than before, but I don't think we want to guarantee anything about the ordering.
2020-08-04 01:09:52 +00:00
<(echo '{"version":1,"root":{"type":"directory","entries":{"bar":{"type":"regular","size":4,"narOffset":232},"link":{"type":"symlink","target":"xyzzy"}}}}' | jq -S)
Add a test for DWARF debug info index generation
2020-07-13 11:37:22 +00:00
# Test debug info index generation.
clearCache
outPath=$(nix-build --no-out-link -E '
with import ./config.nix;
mkDerivation {
name = "debug-info";
buildCommand = "mkdir -p $out/lib/debug/.build-id/02; echo foo > $out/lib/debug/.build-id/02/623eda209c26a59b1a8638ff7752f6b945c26b.debug";
}
')
nix copy --to "file://$cacheDir?index-debug-info=1&compression=none" $outPath
Make JSON equality tests agnostic to ordering It is in fact more sorted than before, but I don't think we want to guarantee anything about the ordering.
2020-08-04 01:09:52 +00:00
diff -u \
<(cat $cacheDir/debuginfo/02623eda209c26a59b1a8638ff7752f6b945c26b.debug | jq -S) \
<(echo '{"archive":"../nar/100vxs724qr46phz8m24iswmg9p3785hsyagz0kchf6q6gf06sw6.nar","member":"lib/debug/.build-id/02/623eda209c26a59b1a8638ff7752f6b945c26b.debug"}' | jq -S)
Tests for #3964
2020-10-17 22:43:52 +00:00
# Test against issue https://github.com/NixOS/nix/issues/3964
#
expr='
with import ./config.nix;
mkDerivation {
name = "multi-output";
buildCommand = "mkdir -p $out; echo foo > $doc; echo $doc > $out/docref";
outputs = ["out" "doc"];
}
'
outPath=$(nix-build --no-out-link -E "$expr")
docPath=$(nix-store -q --references $outPath)
# $ nix-store -q --tree $outPath
# ...-multi-output
# +---...-multi-output-doc
nix copy --to "file://$cacheDir" $outPath
hashpart() {
basename "$1" | cut -c1-32
}
# break the closure of out by removing doc
rm $cacheDir/$(hashpart $docPath).narinfo
nix-store --delete $outPath $docPath
# -vvv is the level that logs during the loop
Fix test
2020-10-26 16:59:32 +00:00
timeout 60 nix-build --no-out-link -E "$expr" --option substituters "file://$cacheDir" \
Tests for #3964
2020-10-17 22:43:52 +00:00
--option trusted-binary-caches "file://$cacheDir" --no-require-sigs
Copy permalink