scriptis/lix
0
0
Fork 0
forked from lix-project/lix
Code Pull requests Activity
lix/src/libstore/worker-protocol.hh

80 lines
2.1 KiB
C++
Raw Normal View History

Use "#pragma once" to prevent repeated header file inclusion
2012-07-18 18:59:03 +00:00
#pragma once
* First remote operation: isValidPath().
2006-11-30 20:13:59 +00:00
* The determination of the root set should be made by the privileged process, so forward the operation. * Spam the user about GC misconfigurations (NIX-71). * findRoots: skip all roots that are unreadable - the warnings with which we spam the user should be enough.
2006-12-05 01:31:45 +00:00
namespace nix {
* Pass various options to the worker so that flags like -K or -j work in multi-user Nix (NIX-72). * Client/worker: exchange a protocol version number for future compatibility.
2007-09-18 09:11:20 +00:00
#define WORKER_MAGIC_1 0x6e697863
#define WORKER_MAGIC_2 0x6478696f
Update worker protocol to support sending storepath maps We need to also send the ca to daemon in addition to the path.
2020-06-19 22:06:19 +00:00
#define PROTOCOL_VERSION 0x116
* Pass various options to the worker so that flags like -K or -j work in multi-user Nix (NIX-72). * Client/worker: exchange a protocol version number for future compatibility.
2007-09-18 09:11:20 +00:00
#define GET_PROTOCOL_MAJOR(x) ((x) & 0xff00)
* Flag `--no-build-hook' to disable distributed builds. * queryDeriver in daemon mode: don't barf if the other side returns an empty string (which means there is no deriver).
2007-11-16 16:15:26 +00:00
#define GET_PROTOCOL_MINOR(x) ((x) & 0x00ff)
* First remote operation: isValidPath().
2006-11-30 20:13:59 +00:00
typedef enum {
* Some refactoring: put the GC options / results in separate structs. * The garbage collector now also prints the number of blocks freed.
2008-06-18 09:34:17 +00:00
wopIsValidPath = 1,
* Backwards compatibility.
2007-08-13 11:15:13 +00:00
wopHasSubstitutes = 3,
Move path info caching from BinaryCacheStore to Store Caching path info is generally useful. For instance, it speeds up "nix path-info -rS /run/current-system" (i.e. showing the closure sizes of all paths in the closure of the current system) from 5.6s to 0.15s. This also eliminates some APIs like Store::queryDeriver() and Store::queryReferences().
2016-04-19 16:50:15 +00:00
wopQueryPathHash = 4, // obsolete
wopQueryReferences = 5, // obsolete
* Some refactoring: put the GC options / results in separate structs. * The garbage collector now also prints the number of blocks freed.
2008-06-18 09:34:17 +00:00
wopQueryReferrers = 6,
wopAddToStore = 7,
wopAddTextToStore = 8,
nix-store -r: do substitutions in parallel I.e. when multiple non-derivation arguments are passed to ‘nix-store -r’ to be substituted, do them in parallel.
2012-06-27 20:58:15 +00:00
wopBuildPaths = 9,
* Some refactoring: put the GC options / results in separate structs. * The garbage collector now also prints the number of blocks freed.
2008-06-18 09:34:17 +00:00
wopEnsurePath = 10,
wopAddTempRoot = 11,
wopAddIndirectRoot = 12,
wopSyncWithGC = 13,
wopFindRoots = 14,
Add a Store::addToStore() variant that accepts a NAR As a side effect, this ensures that signatures are propagated when copying paths between stores. Also refactored import/export to make use of this.
2016-05-04 11:36:54 +00:00
wopExportPath = 16, // obsolete
Move path info caching from BinaryCacheStore to Store Caching path info is generally useful. For instance, it speeds up "nix path-info -rS /run/current-system" (i.e. showing the closure sizes of all paths in the closure of the current system) from 5.6s to 0.15s. This also eliminates some APIs like Store::queryDeriver() and Store::queryReferences().
2016-04-19 16:50:15 +00:00
wopQueryDeriver = 18, // obsolete
* Some refactoring: put the GC options / results in separate structs. * The garbage collector now also prints the number of blocks freed.
2008-06-18 09:34:17 +00:00
wopSetOptions = 19,
wopCollectGarbage = 20,
* querySubstitutablePathInfo: work properly when run via the daemon. * --dry-run: print the paths that we don't know how to build/substitute.
2008-08-04 11:44:50 +00:00
wopQuerySubstitutablePathInfo = 21,
Add a way to get all the outputs of a derivation with their label Generalize `queryDerivationOutputNames` and `queryDerivationOutputs` by adding a `queryDerivationOutputMap` that returns the map `outputName=>outputPath` (not that this is not equivalent to merging the results of `queryDerivationOutputs` and `queryDerivationOutputNames` as sets don't preserve the order, so we would end up with an incorrect mapping). squash! Add a way to get all the outputs of a derivation with their label Rename StorePathMap to OutputPathMap
2020-06-10 09:20:52 +00:00
wopQueryDerivationOutputs = 22, // obsolete
Rename queryValidPaths() to queryAllValidPaths()
2012-07-11 14:49:04 +00:00
wopQueryAllValidPaths = 23,
* Allow unprivileged users to do `nix-store --clear-failed-paths' and `nix-store --query-failed-paths'.
2010-05-04 10:45:10 +00:00
wopQueryFailedPaths = 24,
wopClearFailedPaths = 25,
* Implement RemoteStore::queryPathInfo().
2010-11-17 12:08:01 +00:00
wopQueryPathInfo = 26,
Add a Store::addToStore() variant that accepts a NAR As a side effect, this ensures that signatures are propagated when copying paths between stores. Also refactored import/export to make use of this.
2016-05-04 11:36:54 +00:00
wopImportPaths = 27, // obsolete
Remove Store::queryDerivationOutputNames() This function was used in only one place, where it could easily be replaced by readDerivation() since it's not performance-critical. (This function appears to have been modelled after queryDerivationOutputs(), which exists only to make the garbage collector faster.)
2020-06-12 10:46:33 +00:00
wopQueryDerivationOutputNames = 28, // obsolete
Add function queryPathFromHashPart() To implement binary caches efficiently, Hydra needs to be able to map the hash part of a store path (e.g. "gbg...zr7") to the full store path (e.g. "/nix/store/gbg...kzr7-subversion-1.7.5"). (The binary cache mechanism uses hash parts as a key for looking up store paths to ensure privacy.) However, doing a search in the Nix store for /nix/store/<hash>* is expensive since it requires reading the entire directory. queryPathFromHashPart() prevents this by doing a cheap database lookup.
2012-07-17 22:55:39 +00:00
wopQueryPathFromHashPart = 29,
Merge branch 'master' into no-manifests
2012-07-18 14:47:59 +00:00
wopQuerySubstitutablePathInfos = 30,
wopQueryValidPaths = 31,
wopQuerySubstitutablePaths = 32,
nix-store -q --roots: Respect the gc-keep-outputs/gc-keep-derivations settings So if a path is not garbage solely because it's reachable from a root due to the gc-keep-outputs or gc-keep-derivations settings, ‘nix-store -q --roots’ now shows that root.
2012-12-20 17:41:44 +00:00
wopQueryValidDerivers = 33,
Add a ‘verifyStore’ RPC Hello! The patch below adds a ‘verifyStore’ RPC with the same signature as the current LocalStore::verifyStore method. Thanks, Ludo’. >From aef46c03ca77eb6344f4892672eb6d9d06432041 Mon Sep 17 00:00:00 2001 From: =?UTF-8?q?Ludovic=20Court=C3=A8s?= <ludo@gnu.org> Date: Mon, 1 Jun 2015 23:17:10 +0200 Subject: [PATCH] Add a 'verifyStore' remote procedure call.
2015-06-01 21:20:11 +00:00
wopOptimiseStore = 34,
Implement buildDerivation() via the daemon
2015-09-03 10:56:59 +00:00
wopVerifyStore = 35,
wopBuildDerivation = 36,
Add "nix copy-sigs" command This imports signatures from one store into another. E.g. $ nix copy-sigs -r /run/current-system -s https://cache.nixos.org/ imported 595 signatures
2016-04-05 13:30:22 +00:00
wopAddSignatures = 37,
Implement nar-based addToStore for remote-store
2016-09-02 18:33:58 +00:00
wopNarFromPath = 38,
Implement RemoteStore::queryMissing() This provides a significant speedup, e.g. 64 s -> 12 s for nix-build --dry-run -I nixpkgs=channel:nixos-16.03 '<nixpkgs/nixos/tests/misc.nix>' -A test on a cold local and CloudFront cache. The alternative is to use lots of concurrent daemon connections but that seems wasteful.
2017-04-06 16:40:19 +00:00
wopAddToStoreNar = 39,
wopQueryMissing = 40,
Add a way to get all the outputs of a derivation with their label Generalize `queryDerivationOutputNames` and `queryDerivationOutputs` by adding a `queryDerivationOutputMap` that returns the map `outputName=>outputPath` (not that this is not equivalent to merging the results of `queryDerivationOutputs` and `queryDerivationOutputNames` as sets don't preserve the order, so we would end up with an incorrect mapping). squash! Add a way to get all the outputs of a derivation with their label Rename StorePathMap to OutputPathMap
2020-06-10 09:20:52 +00:00
wopQueryDerivationOutputMap = 41,
* First remote operation: isValidPath().
2006-11-30 20:13:59 +00:00
} WorkerOp;
* Some hackery to propagate the worker's stderr and exceptions to the client.
2006-12-03 02:08:13 +00:00
#define STDERR_NEXT 0x6f6c6d67
* `nix-store --import' now also works in remote mode. The worker always requires a signature on the archive. This is to ensure that unprivileged users cannot add Trojan horses to the Nix store.
2007-02-21 17:34:02 +00:00
#define STDERR_READ 0x64617461 // data needed from source
#define STDERR_WRITE 0x64617416 // data for sink
* Some hackery to propagate the worker's stderr and exceptions to the client.
2006-12-03 02:08:13 +00:00
#define STDERR_LAST 0x616c7473
#define STDERR_ERROR 0x63787470
Tunnel progress messages from the daemon to the client This makes the progress bar work for non-root users.
2017-08-28 16:49:42 +00:00
#define STDERR_START_ACTIVITY 0x53545254
#define STDERR_STOP_ACTIVITY 0x53544f50
#define STDERR_RESULT 0x52534c54
* Some hackery to propagate the worker's stderr and exceptions to the client.
2006-12-03 02:08:13 +00:00
Move most of the daemon implementation to libstore
2018-09-24 11:53:44 +00:00
class Store;
minor: fix mismatch of struct/class forward decl of 'Source' Fixes the following warning and the indicate potential issue: src/libstore/worker-protocol.hh:66:1: warning: class 'Source' was previously declared as a struct; this is valid, but may result in linker errors under the Microsoft C++ ABI [-Wmismatched-tags] (cherry picked from commit 6e1bb04870b1b723282d32182af286646f13bf3c)
2019-10-30 19:38:02 +00:00
struct Source;
Move most of the daemon implementation to libstore
2018-09-24 11:53:44 +00:00
Make the Store API more type-safe Most functions now take a StorePath argument rather than a Path (which is just an alias for std::string). The StorePath constructor ensures that the path is syntactically correct (i.e. it looks like <store-dir>/<base32-hash>-<name>). Similarly, functions like buildPaths() now take a StorePathWithOutputs, rather than abusing Path by adding a '!<outputs>' suffix. Note that the StorePath type is implemented in Rust. This involves some hackery to allow Rust values to be used directly in C++, via a helper type whose destructor calls the Rust type's drop() function. The main issue is the dynamic nature of C++ move semantics: after we have moved a Rust value, we should not call the drop function on the original value. So when we move a value, we set the original value to bitwise zero, and the destructor only calls drop() if the value is not bitwise zero. This should be sufficient for most types. Also lots of minor cleanups to the C++ API to make it more modern (e.g. using std::optional and std::string_view in some places).
2019-12-05 18:11:09 +00:00
template<class T> T readStorePaths(const Store & store, Source & from);
void writeStorePaths(const Store & store, Sink & out, const StorePathSet & paths);
* The determination of the root set should be made by the privileged process, so forward the operation. * Spam the user about GC misconfigurations (NIX-71). * findRoots: skip all roots that are unreadable - the warnings with which we spam the user should be enough.
2006-12-05 01:31:45 +00:00
Merge remote-tracking branch 'origin/master' into substitute-other-storedir
2020-06-22 17:08:11 +00:00
StorePathCAMap readStorePathCAMap(const Store & store, Source & from);
Update worker protocol to support sending storepath maps We need to also send the ca to daemon in addition to the path.
2020-06-19 22:06:19 +00:00
void writeStorePathCAMap(const Store & store, Sink & out, const StorePathCAMap & paths);
Add a way to get all the outputs of a derivation with their label Generalize `queryDerivationOutputNames` and `queryDerivationOutputs` by adding a `queryDerivationOutputMap` that returns the map `outputName=>outputPath` (not that this is not equivalent to merging the results of `queryDerivationOutputs` and `queryDerivationOutputNames` as sets don't preserve the order, so we would end up with an incorrect mapping). squash! Add a way to get all the outputs of a derivation with their label Rename StorePathMap to OutputPathMap
2020-06-10 09:20:52 +00:00
void writeOutputPathMap(const Store & store, Sink & out, const OutputPathMap & paths);
Whitespace
2012-07-30 21:13:25 +00:00
* The determination of the root set should be made by the privileged process, so forward the operation. * Spam the user about GC misconfigurations (NIX-71). * findRoots: skip all roots that are unreadable - the warnings with which we spam the user should be enough.
2006-12-05 01:31:45 +00:00
}
Copy permalink