danderson/channel-scripts
0
0
Fork 0
forked from the-distro/channel-scripts
Code Pull requests Activity
%!d() commits 2 branches 0 tags 295 KiB
Commit graph

29 commits

Author SHA1 Message Date
Eelco Dolstra b6d6feaef3 * Parallelize mirror-channel.pl by forking several worker processes to do 
the compression / uploading.


git-svn-id: https://nixos.org/repos/nix/release/trunk/channels@34738 70bd8c7a-acb8-0310-9f0d-9cc1c95dcdbb
 2013-06-17 13:14:05 +00:00
Eelco Dolstra 1c233f0b23 * Upload binary cache data directly to S3. 
git-svn-id: https://nixos.org/repos/nix/release/trunk/channels@34736 70bd8c7a-acb8-0310-9f0d-9cc1c95dcdbb
 2013-06-17 00:33:29 +00:00
Eelco Dolstra d4873737b7 * Update binary cache URL. 
git-svn-id: https://nixos.org/repos/nix/release/trunk/channels@34734 70bd8c7a-acb8-0310-9f0d-9cc1c95dcdbb
 2013-06-06 10:03:23 +00:00
Eelco Dolstra e9f69209fc * Enable xz compression of NARs. 
git-svn-id: https://nixos.org/repos/nix/release/trunk/channels@34727 70bd8c7a-acb8-0310-9f0d-9cc1c95dcdbb
 2013-05-23 20:23:58 +00:00
Eelco Dolstra 1ea3048b91 * As an optimisation, when mirroring a NAR, if the store path exists 
locally, then use it directly instead of going through Hydra.  Since
  the mirror script currently runs on the Hydra server, this will
  always be the case.


git-svn-id: https://nixos.org/repos/nix/release/trunk/channels@34698 70bd8c7a-acb8-0310-9f0d-9cc1c95dcdbb
 2013-03-25 13:19:27 +00:00
Eelco Dolstra 3055fa3adf * Generate nixexprs.tar.xz. 
git-svn-id: https://nixos.org/repos/nix/release/trunk/channels@34685 70bd8c7a-acb8-0310-9f0d-9cc1c95dcdbb
 2013-02-05 14:55:24 +00:00
Eelco Dolstra 3aad07cee3 * Randomly permute the order in which we download NARs so that 
mirror-nixos and mirror-nixpkgs don't download the same files at the
  same time.


git-svn-id: https://nixos.org/repos/nix/release/trunk/channels@34682 70bd8c7a-acb8-0310-9f0d-9cc1c95dcdbb
 2013-01-18 11:48:37 +00:00
Eelco Dolstra cbfc30c73b * Integrate binary cache generation into the mirror-channel script. 
git-svn-id: https://nixos.org/repos/nix/release/trunk/channels@34658 70bd8c7a-acb8-0310-9f0d-9cc1c95dcdbb
 2012-12-09 22:43:26 +00:00
Eelco Dolstra f64bd1231d * Export a binary-cache-url file. 
git-svn-id: https://nixos.org/repos/nix/release/trunk/channels@34639 70bd8c7a-acb8-0310-9f0d-9cc1c95dcdbb
 2012-10-29 11:10:33 +00:00
Eelco Dolstra 4d9d3a88a1 * Base the Nixpkgs channel on 
http://hydra.nixos.org/view/nixpkgs/unstable/.  So now the Nixpkgs
  channel corresponds to exactly one revision of Nixpkgs (i.e. no more
  binaries from previous revisions), there is some minimal assurance
  that the channel is okay (because the builds in the "unstable" view
  need to succeed), and older Nixpkgs pre-releases are available under
  http://nixos.org/releases/nixpkgs/.  This means we've come full
  circle, because this is how the Nixpkgs channel used to work before
  we had Hydra :-)

  The downside is that it can take longer for the channel to catch up
  with the Nixpkgs repository.  But that's only a problem for people
  who build from the Nixpkgs repository.


git-svn-id: https://nixos.org/repos/nix/release/trunk/channels@33565 70bd8c7a-acb8-0310-9f0d-9cc1c95dcdbb
 2012-04-04 14:45:24 +00:00
Eelco Dolstra b847c5d809 git-svn-id: https://nixos.org/repos/nix/release/trunk/channels@30545 70bd8c7a-acb8-0310-9f0d-9cc1c95dcdbb 2011-11-23 16:15:33 +00:00
Eelco Dolstra 50a70cd428 * Fix patch generation. It was broken because of the removal of the 
"local paths" feature from NixManifests.pm.


git-svn-id: https://nixos.org/repos/nix/release/trunk/channels@28026 70bd8c7a-acb8-0310-9f0d-9cc1c95dcdbb
 2011-07-31 23:24:08 +00:00
Eelco Dolstra c850f595bc * Verify whether downloaded NARs have the right hash. This prevents 
propagating corrupt store paths.


git-svn-id: https://nixos.org/repos/nix/release/trunk/channels@24985 70bd8c7a-acb8-0310-9f0d-9cc1c95dcdbb
 2010-12-06 00:53:36 +00:00
Eelco Dolstra 93e0016e7a * Backup the manifest. 
git-svn-id: https://nixos.org/repos/nix/release/trunk/channels@24937 70bd8c7a-acb8-0310-9f0d-9cc1c95dcdbb
 2010-11-30 13:05:32 +00:00
Eelco Dolstra d715593122 * Enable asynchronous patch generation (i.e. it doesn't block 
mirroring of the channel).


git-svn-id: https://nixos.org/repos/nix/release/trunk/channels@24922 70bd8c7a-acb8-0310-9f0d-9cc1c95dcdbb
 2010-11-29 16:14:43 +00:00
Rob Vermaas bf23243d12 mirror-channel.pl: check if file is a bzip2 file 
git-svn-id: https://nixos.org/repos/nix/release/trunk/channels@24362 70bd8c7a-acb8-0310-9f0d-9cc1c95dcdbb
 2010-10-19 11:39:24 +00:00
Rob Vermaas b3d95b30d8 mirror-channel.pl: add binary patches option, set ENABLE_PATCHES env var 
git-svn-id: https://nixos.org/repos/nix/release/trunk/channels@24132 70bd8c7a-acb8-0310-9f0d-9cc1c95dcdbb
 2010-10-07 12:19:46 +00:00
Eelco Dolstra 34d4018237 * Speed up the mirror script by reusing the file size / hash info 
from the previous manifest (rather than reading all those .hash 
  files, which is rather I/O intensive).


git-svn-id: https://nixos.org/repos/nix/release/trunk/channels@23477 70bd8c7a-acb8-0310-9f0d-9cc1c95dcdbb
 2010-08-27 09:01:45 +00:00
Eelco Dolstra 412010e2dc * Disable binary patch generation, our poor server can't handle it. 
git-svn-id: https://nixos.org/repos/nix/release/trunk/channels@22974 70bd8c7a-acb8-0310-9f0d-9cc1c95dcdbb
 2010-08-05 20:17:17 +00:00
Eelco Dolstra 4deaf50ae6 git-svn-id: https://nixos.org/repos/nix/release/trunk/channels@22778 70bd8c7a-acb8-0310-9f0d-9cc1c95dcdbb 2010-07-28 08:25:22 +00:00
Eelco Dolstra a621b5cf87 * Run generate-patches.pl. 
git-svn-id: https://nixos.org/repos/nix/release/trunk/channels@22524 70bd8c7a-acb8-0310-9f0d-9cc1c95dcdbb
 2010-07-08 09:09:28 +00:00
Eelco Dolstra 6d149f9253 * Store the NARs in a different directory. 
git-svn-id: https://nixos.org/repos/nix/release/trunk/channels@22396 70bd8c7a-acb8-0310-9f0d-9cc1c95dcdbb
 2010-06-23 14:07:47 +00:00
Eelco Dolstra b5ad42fd2b git-svn-id: https://nixos.org/repos/nix/release/trunk/channels@19659 70bd8c7a-acb8-0310-9f0d-9cc1c95dcdbb 2010-01-26 09:51:05 +00:00
Eelco Dolstra 1a16afabba * Do some locking. 
git-svn-id: https://nixos.org/repos/nix/release/trunk/channels@19658 70bd8c7a-acb8-0310-9f0d-9cc1c95dcdbb
 2010-01-26 09:38:13 +00:00
Eelco Dolstra 421313d9b0 * Don't show a progress bar. 
git-svn-id: https://nixos.org/repos/nix/release/trunk/channels@19657 70bd8c7a-acb8-0310-9f0d-9cc1c95dcdbb
 2010-01-26 09:17:50 +00:00
Eelco Dolstra 51e53116e9 * Put the NAR hash in the filename to prevent problems if Hydra 
redoes a derivation.


git-svn-id: https://nixos.org/repos/nix/release/trunk/channels@17852 70bd8c7a-acb8-0310-9f0d-9cc1c95dcdbb
 2009-10-16 11:33:48 +00:00
Eelco Dolstra a919ef0a9b git-svn-id: https://nixos.org/repos/nix/release/trunk/channels@15277 70bd8c7a-acb8-0310-9f0d-9cc1c95dcdbb 2009-04-23 13:58:06 +00:00
Eelco Dolstra cfdd333199 * Copy nixexprs.tar.bz2. 
* Don't do anything if we get a server error.  Otherwise we might end
  up destroying the target channel.


git-svn-id: https://nixos.org/repos/nix/release/trunk/channels@15115 70bd8c7a-acb8-0310-9f0d-9cc1c95dcdbb
 2009-04-17 13:48:30 +00:00
Eelco Dolstra a5c419b725 * Quick script to mirror Nix channels. Ideally it should be possible 
to do this with a `wget -r' but the manifest contains absolute
  rather than relative URLs, so those have to be rewritten.  And since
  they have to be rewritten anyway, we can add size and hash fields to
  make the manifest compatible with older version of Nix (and make the
  download size estimate work).


git-svn-id: https://nixos.org/repos/nix/release/trunk/channels@15076 70bd8c7a-acb8-0310-9f0d-9cc1c95dcdbb
 2009-04-16 09:25:42 +00:00