lix/distributed/test.sh

#! /bin/sh

set -e

rm -f current-load
touch current-load

storeExpr=$(nix-instantiate ~/nixpkgs/pkgs/system/test.nix)

export NIX_BUILD_HOOK="build-remote.pl"

../src/nix-store/nix-store -qnvvvv -j1 $storeExpr
* The build hooks used to implement distributed builds can now be run in parallel. Hooks are more efficient: locks on output paths are only acquired when the hook says that it is willing to accept a build job. Hooks now work in two phases. First, they should first tell Nix whether they are willing to accept a job. Nix guarantuees that no two hooks will ever be in the first phase at the same time (this simplifies the implementation of hooks, since they don't have to perform locking (?)). Second, if they accept a job, they are then responsible for building it (on the remote system), and copying the result back. These can be run in parallel with other hooks and locally executed jobs. The implementation is a bit messy right now, though. * The directory `distributed' shows a (hacky) example of a hook that distributes build jobs over a set of machines listed in a configuration file. 2004-05-13 19:14:49 +00:00			`#! /bin/sh`

			`set -e`

* Load balancing. `build-remote.pl' will only execute up to a per-machine maximum number of parallel jobs on a remote machine. 2004-05-13 19:35:46 +00:00			`rm -f current-load`
			`touch current-load`

* The build hooks used to implement distributed builds can now be run in parallel. Hooks are more efficient: locks on output paths are only acquired when the hook says that it is willing to accept a build job. Hooks now work in two phases. First, they should first tell Nix whether they are willing to accept a job. Nix guarantuees that no two hooks will ever be in the first phase at the same time (this simplifies the implementation of hooks, since they don't have to perform locking (?)). Second, if they accept a job, they are then responsible for building it (on the remote system), and copying the result back. These can be run in parallel with other hooks and locally executed jobs. The implementation is a bit messy right now, though. * The directory `distributed' shows a (hacky) example of a hook that distributes build jobs over a set of machines listed in a configuration file. 2004-05-13 19:14:49 +00:00			`storeExpr=$(nix-instantiate ~/nixpkgs/pkgs/system/test.nix)`

			`export NIX_BUILD_HOOK="build-remote.pl"`

* Load balancing. `build-remote.pl' will only execute up to a per-machine maximum number of parallel jobs on a remote machine. 2004-05-13 19:35:46 +00:00			`../src/nix-store/nix-store -qnvvvv -j1 $storeExpr`