Eelco Dolstra
a74251af2b
Disable channels on binary cached based Hydra instances
2016-03-02 15:08:53 +01:00
Eelco Dolstra
f09b92e289
Remove another obsolete SSL variable
2016-03-02 15:03:54 +01:00
Eelco Dolstra
2d6b585cb3
Merge branch 'slack-plugin' of https://github.com/shlevy/hydra
2016-03-02 15:03:03 +01:00
Shea Levy
6eb1c5bf19
Remove PERL_LWP_SSL_CA_FILE.
...
Real fix is NixOS/nixpkgs@bd7f379a3f
2016-03-02 09:02:48 -05:00
Eelco Dolstra
b98a061c24
Add some instrumentation to keep track of dispatcher cost
2016-03-02 14:18:39 +01:00
Eelco Dolstra
6beee0ab49
Fix segfault sorting runnable steps
...
Same problem as d744362e4a
.
at /nix/store/ksvsbr7pg4z69bv6fbbc8h7x7rm2104m-gcc-4.9.3/include/c++/4.9.3/bits/predefined_ops.h:166
__last@entry=..., __comp=...) at /nix/store/ksvsbr7pg4z69bv6fbbc8h7x7rm2104m-gcc-4.9.3/include/c++/4.9.3/bits/stl_algo.h:1827
__comp=...) at /nix/store/ksvsbr7pg4z69bv6fbbc8h7x7rm2104m-gcc-4.9.3/include/c++/4.9.3/bits/stl_algo.h:4717
2016-03-02 13:59:24 +01:00
Shea Levy
0f5937503e
SlackNotification: Use bigger images
2016-03-01 11:25:18 -05:00
Shea Levy
006ac1fc03
Add slack plugin.
...
Respects <slack> blocks in the hydra config, with attributes:
* jobs: a regexp matching the job name (in the format project:jobset:job)
* url: The URL to a slack incoming webhook
* force: If true, always send messages. Otherwise, only when the build status changes
Multiple <slack> blocks are allowed
2016-02-29 14:48:36 -05:00
Eelco Dolstra
bc958c508b
Merge branch 'binary-cache'
2016-02-29 18:29:07 +01:00
Eelco Dolstra
7cd08c7c46
Warn if PostgreSQL appears stalled
2016-02-29 15:10:30 +01:00
Eelco Dolstra
922dc541c2
Add log message
2016-02-29 11:58:06 +01:00
Eelco Dolstra
ad035b5227
hydra-queue-runner: Enable core dumps
2016-02-28 14:09:04 +01:00
Eelco Dolstra
610a8d67ae
Better AWS error messages
2016-02-26 22:40:27 +01:00
Eelco Dolstra
1693354506
Remove unnecessary call to hydra-queue-runner --unlock
2016-02-26 21:45:59 +01:00
Eelco Dolstra
1a055e7e9e
Reduce severity level of some message
2016-02-26 21:31:08 +01:00
Eelco Dolstra
6bb860fd6e
Add FIXME
2016-02-26 21:15:05 +01:00
Eelco Dolstra
e8cdfe5171
hydra-server: Don't barf if the binary cache public key can't be read
2016-02-26 21:14:40 +01:00
Eelco Dolstra
53ca41ef9f
Use US standard S3 region
2016-02-26 20:57:47 +01:00
Eelco Dolstra
c635f5d0ea
Fix Makefile.am
2016-02-26 19:54:55 +01:00
Eelco Dolstra
b1ce76c2b4
Fix test
...
nix-support/failed is supposed to be a file, not a directory.
2016-02-26 19:54:32 +01:00
Eelco Dolstra
07e5fc5618
Hackery to make downloads work when using a binary cache
2016-02-26 17:28:26 +01:00
Eelco Dolstra
b00bdefa98
Fix hydra-server signing
2016-02-26 17:28:16 +01:00
Eelco Dolstra
9de336de7c
Proxy local binary caches via hydra-server
2016-02-26 17:27:30 +01:00
Eelco Dolstra
b9afaadfb3
Keep better bytesReceived/bytesSent stats
2016-02-26 16:17:05 +01:00
Eelco Dolstra
6d741d2ffa
Prevent download of NARs we just uploaded
2016-02-26 15:21:44 +01:00
Eelco Dolstra
02190b0fef
Support hydra-build-products on binary cache stores
2016-02-26 14:45:03 +01:00
Eelco Dolstra
8e24ad6f0d
Sync with Nix
2016-02-25 10:58:31 +01:00
Eelco Dolstra
8321a3eb27
Sync with Nix
2016-02-24 14:04:31 +01:00
Eelco Dolstra
7b509237cd
Bleh Automake
2016-02-22 18:05:15 +01:00
Eelco Dolstra
6c3ae36648
hydra-queue-runner: Get store mode configuration from hydra.conf
...
To use the local Nix store (default):
store_mode = direct
To use a local binary cache:
store_mode = local-binary-cache
binary_cache_dir = /var/lib/hydra/binary-cache
To use an S3 bucket:
store_mode = s3-binary-cache
binary_cache_s3_bucket = my-nix-bucket
Also, respect binary_cache_{secret,public}_key_file for signing the
binary cache.
2016-02-22 17:23:06 +01:00
Eelco Dolstra
94817d77d9
BinaryCacheStore: Respect build-use-substitutes
2016-02-22 17:21:39 +01:00
Eelco Dolstra
5668aa5f71
After uploading a .narinfo, add it to the LRU cache
2016-02-20 10:35:16 +01:00
Eelco Dolstra
88a05763cc
Pool local store connections
2016-02-20 00:04:08 +01:00
Eelco Dolstra
1cefd6cac8
Fix log message
2016-02-20 00:02:37 +01:00
Eelco Dolstra
a593ebc58e
Add missing file
2016-02-19 20:58:40 +01:00
Eelco Dolstra
2b76094a23
S3BinaryCacheStore::isValidPath(): Do a GET instead of HEAD
2016-02-19 17:41:11 +01:00
Eelco Dolstra
bd76f9120a
Cache .narinfo lookups
2016-02-19 16:19:40 +01:00
Eelco Dolstra
a0f74047da
Keep some statistics for the binary cache stores
2016-02-19 14:24:23 +01:00
Eelco Dolstra
dc4a00347d
Use a single BinaryCacheStore for all threads
...
This will make it easier to do caching / keep stats. Also, we won't
have S3Client's connection pooling if we create multiple S3Client
instances.
2016-02-18 17:31:19 +01:00
Eelco Dolstra
00a7be13a2
Make queue runner internal status available under /queue-runner-status
2016-02-18 17:11:46 +01:00
Eelco Dolstra
8c9fc677c1
Typo
2016-02-18 16:43:24 +01:00
Eelco Dolstra
db3fcc0f5e
Enable substitution on the build machines
...
If properly configured, this allows them to get store paths directly
from S3, rather than having to receive them from the queue runner.
2016-02-18 16:42:05 +01:00
Eelco Dolstra
2d40888e2e
Add an S3-backed binary cache store
2016-02-18 16:18:50 +01:00
Eelco Dolstra
0e254ca66d
Refactor local binary cache code into a subclass
2016-02-18 14:06:17 +01:00
Eelco Dolstra
a992f688d1
Rename class
2016-02-18 13:02:20 +01:00
Eelco Dolstra
de77cc2910
Rename file
2016-02-18 13:02:20 +01:00
Rob Vermaas
633381a501
Merge pull request #271 from gulrotkake/master
...
Construct uri using uri_for, which respects X-Request-Base.
2016-02-18 10:27:20 +01:00
Michael Mortensen
d9a4f7a211
Construct uri using uri_for, which respects X-Request-Base.
2016-02-17 21:27:44 +01:00
Eelco Dolstra
ce5790285a
Merge remote-tracking branch 'origin/master' into binary-cache
2016-02-17 11:54:59 +01:00
Eelco Dolstra
d7a123fcd4
Keep track of the time we spend copying to/from build machines
2016-02-17 10:30:23 +01:00