Commit graph

81 commits

Author SHA1 Message Date
Ilya K 6eac9547ea Ship Plasma 6 ISOs 2024-05-20 19:00:05 +03:00
Pierre Bourdon 919045560c
mirror-nixos-branch: fetch channel artifacts from S3 directly (#68)
The channel scripts hit into NixOS/nixos-org-configurations#212
sometimes when fetching ISOs from cache.nixos.org to copy to the
channels bucket. This makes runs take hours when they should take
minutes.

There is no benefit gained from going through cache.nixos.org for this
use case. As noticed by @K900, the .iso nar.xz files on the cache are
unlikely to be touched by anyone other than the channel scripts, so we
don't even end up pre-warming the cache or anything along those lines -
if anything, we just waste cache bytes that could be used by other
paths.

Fixes #67.
2024-01-28 19:40:32 +01:00
Vladimír Čunát 074f417efa
mirror-nixos-branch.pl: drop i686 for > 23.11 2024-01-01 17:49:21 +01:00
hexa e2c8b9f483
mirror-nixos-branch.pl: Prune special handling for NixOS 22.05 2023-12-25 00:30:28 +01:00
Vladimír Čunát f37d5e1545
mirror-nixos-branch.pl: avoid deprecated nix sub-commands
warning: 'cat-store' is a deprecated alias for 'store cat'
warning: 'hash-file' is a deprecated alias for 'hash file'
2023-11-14 10:09:26 +01:00
Ilya K 8656f3e07f Replace ad-hoc command-not-found generation scripts with nix-index
This is much, MUCH faster than the existing solution, especially on large channels.
It can be made even faster if we actually reuse anything whatsoever, but this is
a massive improvement in itself.
2023-01-12 21:00:49 +03:00
hexa 5feab0d769 mirror-nixos-branch: Create redirects for aarch64-linux ISOs 2022-11-30 20:30:41 +01:00
hexa f402c5c2fc
Fix typo in system name for ova image 2022-10-27 17:31:37 +02:00
hexa b603df8489
Restore old copy behavior for nixos-22.05
Was prematurely removed in the previous commit.
2022-10-13 21:58:52 +02:00
hexa c6046943ca
Copy aarch64-linux ISO images unconditionally 2022-10-01 03:44:32 +02:00
Markus Wamser 648eb867a0 mirror-nixos-branch: remove special handling for old releases 2022-02-04 07:51:50 +01:00
Janne Heß fa2c4eae31
mirror-nixos-branches: Fix failing aarch64 downloads 2021-11-22 12:06:24 +01:00
Janne Heß a961c8a6b9
mirror-nixos-branch: Add aarch64 support 2021-11-22 01:09:59 +01:00
Jonas Chevalier 20845261a3
s-maxage => maxage
Try this to see if it improves on
https://github.com/NixOS/nixos-org-configurations/issues/169
2021-10-21 15:02:40 +02:00
Jonas Chevalier 1a2b045d2c
mirror-nixos-branch: stop pushing to nixpkgs-channels
The channel has been archived and doesn't take updates anymore.
2021-09-08 19:41:17 +02:00
Jonas Chevalier b05671cdb5
set cache-control on mutable objects
This allows to override the default TTL on Fastly. Let it know what
these objects should be refreshed more often.

Fixes NixOS/nixos-org-configurations#169
2021-09-08 19:29:17 +02:00
Jessica Dunstan c1b766ace2 Update github link to use nixpkgs instead of nixpkgs-channels. 2021-03-14 19:53:08 -07:00
Eelco Dolstra f8db1d7bf9
Add Gnome ISO to the channel
Fixes #43.
2020-10-07 08:45:39 +02:00
Eelco Dolstra 7c442a2f67 Stop updating nixpkgs-channels for NixOS >= 20.09
https://github.com/NixOS/nixpkgs/issues/99257
2020-10-02 22:20:28 +02:00
Graham Christensen 3e3304d0f7
curRelease: guard against missing channel 2020-04-12 21:38:18 -04:00
tilpner 7fd06f9d8d
mirror: add redirection for store-paths.xz 2020-04-09 22:42:56 +02:00
Samuel Dionne-Riel 3cd3da04a1 mirror: Add content-type and content-encoding for .json.br 2020-03-25 15:40:00 -04:00
Samuel Dionne-Riel 7d46561471 mirror: Add redirects for json data files 2020-03-25 14:20:05 -04:00
Samuel Dionne-Riel 51104d8cde mirror: Use shell-free calls when possible
Passing a list of parameters to `system` automatically gives us peace of
mind with regards to shell escaping. This is because it will not rely on
a shell invocation to run the given parameters, but directly exec to it.

The left-over shell invocations all use redirection.
2020-03-24 22:29:10 -04:00
Samuel Dionne-Riel 0568ef3c4a mirror: Download packages.json.br and options.json.br 2020-03-24 22:24:29 -04:00
Samuel Dionne-Riel badde7c674 mirror: allow downloadFile to select a specific product 2020-03-24 22:24:11 -04:00
Samuel Dionne-Riel 13154f8e86 mirror: Convert all system use to run* 2020-03-24 20:05:59 -04:00
Samuel Dionne-Riel 877e989376 mirror: Cosmetic change to the release info output 2020-03-24 19:59:57 -04:00
Samuel Dionne-Riel 84c6a24dac mirror: Add dry-run mode to better test script 2020-03-24 19:59:50 -04:00
Samuel Dionne-Riel f5d04ea038 mirror: Use experimental "nix-command" feature. 2020-03-24 19:59:45 -04:00
Samuel Dionne-Riel ab952e5863 mirror: Introduce two functions for running commands
They are thin wrappers over `system`, but two main points:

 * They log the (unescaped) command.
 * `run` will auto-die.

This removes the need to pepper `== 0 or die` in the script.
2020-03-24 19:59:39 -04:00
Eelco Dolstra 10188a5679
Fix OVA redirects 2020-03-20 09:52:04 +01:00
Eelco Dolstra 6ba4a48263 Quick hack to fix status.nixos.org 2020-03-17 13:21:57 +01:00
Eelco Dolstra faa521b194 Fix redirects 2020-03-10 15:22:54 +01:00
Rok Garbas 4d53dba964
wrong content 2020-03-10 12:52:59 +01:00
Rok Garbas 15ff4aff86
added error handling 2020-03-10 12:52:09 +01:00
Rok Garbas 0893b43140
channelsDir -> channelName 2020-03-10 12:51:19 +01:00
Rok Garbas a8671842d9
channelsDir -> channelName 2020-03-10 12:49:52 +01:00
Rok Garbas 1729eb92c8
remove not needed lines 2020-03-10 12:48:11 +01:00
Rok Garbas a3e79347be
my poor attempt at perl 2020-03-10 12:15:53 +01:00
Rok Garbas 0ec4463dbd
fixing copy paste typo 2020-03-06 10:32:44 +01:00
Rok Garbas a055dc2cdc
fix a typo and also add redirect for $channel/nixexprs.tar.xz 2020-03-06 10:24:35 +01:00
Rok Garbas 3ef68861db
Push channels to s3://nix-channels bucket 2020-03-05 21:48:33 +01:00
Rok Garbas d1fb4bf67a
Upload channels artifacts (or links to those artifacts) to download.nixos.org
This will enable us to move nixos.org website to other location as
described in nixos/nixos-homepage#326
2020-02-17 13:16:22 +01:00
worldofpeace 751409599d rename iso_graphical to iso_plasma5 2020-01-30 08:28:20 -05:00
Samuel Dionne-Riel c4a61dfe8a mirror-branch: Always exit with 1 on nix-instantiate error
Resolving the values and being fancy is harder than the actual benefits
would give out.

Return all the info we have, and let the pager'd person deal with the
data.
2020-01-02 22:04:43 -05:00
Samuel Dionne-Riel cac10f5360 mirror-branch: Bails when failing to run nix-instantiate
A more durable solution would likely be to make a generic function that
wraps backticks and fails when $? is non-zero, rather than doing it
in-situ. There are other backtick uses that may be problematic
2020-01-02 21:19:58 -05:00
Graham Christensen 7ee70fd479
mirror-nixos-branch.pl: exit 0 if the channel would go back in time
Prometheus now has a configured alert if an update job fails for a
while. Going back in time is not so unusual:

1. a hydra evaluation completes with some failed jobs
2. the channel advances to this commit
3. an admin restarts a failed job
4. the channel would go backward because the evaluation is complete

Since it is not a problem, make it a non-problematic exit code.
2019-11-15 11:01:34 -05:00
Eelco Dolstra fac8ec969e
Revert "Namespace channel pushes in nixpkgs"
This reverts commit 38d2339ca2.
2019-10-29 12:29:31 +01:00
Graham Christensen 38d2339ca2
Namespace channel pushes in nixpkgs
PRs to NixOS are a bit confused about if they should PR to release-* or nixos-* or nixpkgs-*. I think namespacing the refs will go a long way in making it more obvious.
2019-10-29 12:17:25 +01:00