Commit graph

81 commits

Author SHA1 Message Date
6eac9547ea Ship Plasma 6 ISOs 2024-05-20 19:00:05 +03:00
919045560c
mirror-nixos-branch: fetch channel artifacts from S3 directly (#68)
The channel scripts hit into NixOS/nixos-org-configurations#212
sometimes when fetching ISOs from cache.nixos.org to copy to the
channels bucket. This makes runs take hours when they should take
minutes.

There is no benefit gained from going through cache.nixos.org for this
use case. As noticed by @K900, the .iso nar.xz files on the cache are
unlikely to be touched by anyone other than the channel scripts, so we
don't even end up pre-warming the cache or anything along those lines -
if anything, we just waste cache bytes that could be used by other
paths.

Fixes #67.
2024-01-28 19:40:32 +01:00
Vladimír Čunát
074f417efa
mirror-nixos-branch.pl: drop i686 for > 23.11 2024-01-01 17:49:21 +01:00
e2c8b9f483
mirror-nixos-branch.pl: Prune special handling for NixOS 22.05 2023-12-25 00:30:28 +01:00
Vladimír Čunát
f37d5e1545
mirror-nixos-branch.pl: avoid deprecated nix sub-commands
warning: 'cat-store' is a deprecated alias for 'store cat'
warning: 'hash-file' is a deprecated alias for 'hash file'
2023-11-14 10:09:26 +01:00
8656f3e07f Replace ad-hoc command-not-found generation scripts with nix-index
This is much, MUCH faster than the existing solution, especially on large channels.
It can be made even faster if we actually reuse anything whatsoever, but this is
a massive improvement in itself.
2023-01-12 21:00:49 +03:00
5feab0d769 mirror-nixos-branch: Create redirects for aarch64-linux ISOs 2022-11-30 20:30:41 +01:00
f402c5c2fc
Fix typo in system name for ova image 2022-10-27 17:31:37 +02:00
b603df8489
Restore old copy behavior for nixos-22.05
Was prematurely removed in the previous commit.
2022-10-13 21:58:52 +02:00
c6046943ca
Copy aarch64-linux ISO images unconditionally 2022-10-01 03:44:32 +02:00
648eb867a0 mirror-nixos-branch: remove special handling for old releases 2022-02-04 07:51:50 +01:00
Janne Heß
fa2c4eae31
mirror-nixos-branches: Fix failing aarch64 downloads 2021-11-22 12:06:24 +01:00
Janne Heß
a961c8a6b9
mirror-nixos-branch: Add aarch64 support 2021-11-22 01:09:59 +01:00
20845261a3
s-maxage => maxage
Try this to see if it improves on
https://github.com/NixOS/nixos-org-configurations/issues/169
2021-10-21 15:02:40 +02:00
1a2b045d2c
mirror-nixos-branch: stop pushing to nixpkgs-channels
The channel has been archived and doesn't take updates anymore.
2021-09-08 19:41:17 +02:00
b05671cdb5
set cache-control on mutable objects
This allows to override the default TTL on Fastly. Let it know what
these objects should be refreshed more often.

Fixes NixOS/nixos-org-configurations#169
2021-09-08 19:29:17 +02:00
Jessica Dunstan
c1b766ace2 Update github link to use nixpkgs instead of nixpkgs-channels. 2021-03-14 19:53:08 -07:00
Eelco Dolstra
f8db1d7bf9
Add Gnome ISO to the channel
Fixes #43.
2020-10-07 08:45:39 +02:00
Eelco Dolstra
7c442a2f67 Stop updating nixpkgs-channels for NixOS >= 20.09
https://github.com/NixOS/nixpkgs/issues/99257
2020-10-02 22:20:28 +02:00
Graham Christensen
3e3304d0f7
curRelease: guard against missing channel 2020-04-12 21:38:18 -04:00
tilpner
7fd06f9d8d
mirror: add redirection for store-paths.xz 2020-04-09 22:42:56 +02:00
3cd3da04a1 mirror: Add content-type and content-encoding for .json.br 2020-03-25 15:40:00 -04:00
7d46561471 mirror: Add redirects for json data files 2020-03-25 14:20:05 -04:00
51104d8cde mirror: Use shell-free calls when possible
Passing a list of parameters to `system` automatically gives us peace of
mind with regards to shell escaping. This is because it will not rely on
a shell invocation to run the given parameters, but directly exec to it.

The left-over shell invocations all use redirection.
2020-03-24 22:29:10 -04:00
0568ef3c4a mirror: Download packages.json.br and options.json.br 2020-03-24 22:24:29 -04:00
badde7c674 mirror: allow downloadFile to select a specific product 2020-03-24 22:24:11 -04:00
13154f8e86 mirror: Convert all system use to run* 2020-03-24 20:05:59 -04:00
877e989376 mirror: Cosmetic change to the release info output 2020-03-24 19:59:57 -04:00
84c6a24dac mirror: Add dry-run mode to better test script 2020-03-24 19:59:50 -04:00
f5d04ea038 mirror: Use experimental "nix-command" feature. 2020-03-24 19:59:45 -04:00
ab952e5863 mirror: Introduce two functions for running commands
They are thin wrappers over `system`, but two main points:

 * They log the (unescaped) command.
 * `run` will auto-die.

This removes the need to pepper `== 0 or die` in the script.
2020-03-24 19:59:39 -04:00
Eelco Dolstra
10188a5679
Fix OVA redirects 2020-03-20 09:52:04 +01:00
Eelco Dolstra
6ba4a48263 Quick hack to fix status.nixos.org 2020-03-17 13:21:57 +01:00
Eelco Dolstra
faa521b194 Fix redirects 2020-03-10 15:22:54 +01:00
Rok Garbas
4d53dba964
wrong content 2020-03-10 12:52:59 +01:00
Rok Garbas
15ff4aff86
added error handling 2020-03-10 12:52:09 +01:00
Rok Garbas
0893b43140
channelsDir -> channelName 2020-03-10 12:51:19 +01:00
Rok Garbas
a8671842d9
channelsDir -> channelName 2020-03-10 12:49:52 +01:00
Rok Garbas
1729eb92c8
remove not needed lines 2020-03-10 12:48:11 +01:00
Rok Garbas
a3e79347be
my poor attempt at perl 2020-03-10 12:15:53 +01:00
Rok Garbas
0ec4463dbd
fixing copy paste typo 2020-03-06 10:32:44 +01:00
Rok Garbas
a055dc2cdc
fix a typo and also add redirect for $channel/nixexprs.tar.xz 2020-03-06 10:24:35 +01:00
Rok Garbas
3ef68861db
Push channels to s3://nix-channels bucket 2020-03-05 21:48:33 +01:00
Rok Garbas
d1fb4bf67a
Upload channels artifacts (or links to those artifacts) to download.nixos.org
This will enable us to move nixos.org website to other location as
described in nixos/nixos-homepage#326
2020-02-17 13:16:22 +01:00
worldofpeace
751409599d rename iso_graphical to iso_plasma5 2020-01-30 08:28:20 -05:00
c4a61dfe8a mirror-branch: Always exit with 1 on nix-instantiate error
Resolving the values and being fancy is harder than the actual benefits
would give out.

Return all the info we have, and let the pager'd person deal with the
data.
2020-01-02 22:04:43 -05:00
cac10f5360 mirror-branch: Bails when failing to run nix-instantiate
A more durable solution would likely be to make a generic function that
wraps backticks and fails when $? is non-zero, rather than doing it
in-situ. There are other backtick uses that may be problematic
2020-01-02 21:19:58 -05:00
Graham Christensen
7ee70fd479
mirror-nixos-branch.pl: exit 0 if the channel would go back in time
Prometheus now has a configured alert if an update job fails for a
while. Going back in time is not so unusual:

1. a hydra evaluation completes with some failed jobs
2. the channel advances to this commit
3. an admin restarts a failed job
4. the channel would go backward because the evaluation is complete

Since it is not a problem, make it a non-problematic exit code.
2019-11-15 11:01:34 -05:00
Eelco Dolstra
fac8ec969e
Revert "Namespace channel pushes in nixpkgs"
This reverts commit 38d2339ca2.
2019-10-29 12:29:31 +01:00
Graham Christensen
38d2339ca2
Namespace channel pushes in nixpkgs
PRs to NixOS are a bit confused about if they should PR to release-* or nixos-* or nixpkgs-*. I think namespacing the refs will go a long way in making it more obvious.
2019-10-29 12:17:25 +01:00