Eelco Dolstra
45b237453a
hydra-queue-runner: Recycle finishedDrvs
...
This should prevent the queue monitor thread from looking up the same
derivations over and over again.
2016-03-08 11:52:13 +01:00
Eelco Dolstra
2ab8e9a1e0
hydra-queue-runner: Fix handling of missing derivations
...
This barfed with 'queue monitor: ERROR: column "errormsg" of relation
"builds" does not exist' due to the removal of the errorMsg column.
2016-03-07 19:05:24 +01:00
Eelco Dolstra
e7ce225558
Fix build
2016-03-04 17:51:32 +01:00
Eelco Dolstra
76104accda
Return unique store paths
2016-03-03 11:32:30 +01:00
Eelco Dolstra
86a2d6471c
Fix a boost format string abort
2016-03-02 20:06:48 +01:00
Eelco Dolstra
e7655fdcbc
Fix latest-finished
2016-03-02 18:06:20 +01:00
Eelco Dolstra
232ca8fea2
Fix build
2016-03-02 17:05:07 +01:00
Eelco Dolstra
e45bbfbef0
Fix .nixpkg channel uri
...
Fixes #274 .
2016-03-02 15:38:40 +01:00
Eelco Dolstra
8b4f90b0d4
.nixpkgs: Drop obsolete manifest URI
2016-03-02 15:24:23 +01:00
Eelco Dolstra
ec82bc2517
Add /eval/NNN/store-paths action to return store paths in an eval
...
Needed by the NixOS channel scripts since we can no longer get a
MANIFEST from Hydra.
2016-03-02 15:17:22 +01:00
Eelco Dolstra
a74251af2b
Disable channels on binary cached based Hydra instances
2016-03-02 15:08:53 +01:00
Eelco Dolstra
f09b92e289
Remove another obsolete SSL variable
2016-03-02 15:03:54 +01:00
Eelco Dolstra
2d6b585cb3
Merge branch 'slack-plugin' of https://github.com/shlevy/hydra
2016-03-02 15:03:03 +01:00
Shea Levy
6eb1c5bf19
Remove PERL_LWP_SSL_CA_FILE.
...
Real fix is NixOS/nixpkgs@bd7f379a3f
2016-03-02 09:02:48 -05:00
Eelco Dolstra
b98a061c24
Add some instrumentation to keep track of dispatcher cost
2016-03-02 14:18:39 +01:00
Eelco Dolstra
6beee0ab49
Fix segfault sorting runnable steps
...
Same problem as d744362e4a
.
at /nix/store/ksvsbr7pg4z69bv6fbbc8h7x7rm2104m-gcc-4.9.3/include/c++/4.9.3/bits/predefined_ops.h:166
__last@entry=..., __comp=...) at /nix/store/ksvsbr7pg4z69bv6fbbc8h7x7rm2104m-gcc-4.9.3/include/c++/4.9.3/bits/stl_algo.h:1827
__comp=...) at /nix/store/ksvsbr7pg4z69bv6fbbc8h7x7rm2104m-gcc-4.9.3/include/c++/4.9.3/bits/stl_algo.h:4717
2016-03-02 13:59:24 +01:00
Shea Levy
0f5937503e
SlackNotification: Use bigger images
2016-03-01 11:25:18 -05:00
Shea Levy
006ac1fc03
Add slack plugin.
...
Respects <slack> blocks in the hydra config, with attributes:
* jobs: a regexp matching the job name (in the format project:jobset:job)
* url: The URL to a slack incoming webhook
* force: If true, always send messages. Otherwise, only when the build status changes
Multiple <slack> blocks are allowed
2016-02-29 14:48:36 -05:00
Eelco Dolstra
bc958c508b
Merge branch 'binary-cache'
2016-02-29 18:29:07 +01:00
Eelco Dolstra
7cd08c7c46
Warn if PostgreSQL appears stalled
2016-02-29 15:10:30 +01:00
Eelco Dolstra
922dc541c2
Add log message
2016-02-29 11:58:06 +01:00
Eelco Dolstra
ad035b5227
hydra-queue-runner: Enable core dumps
2016-02-28 14:09:04 +01:00
Eelco Dolstra
610a8d67ae
Better AWS error messages
2016-02-26 22:40:27 +01:00
Eelco Dolstra
1693354506
Remove unnecessary call to hydra-queue-runner --unlock
2016-02-26 21:45:59 +01:00
Eelco Dolstra
1a055e7e9e
Reduce severity level of some message
2016-02-26 21:31:08 +01:00
Eelco Dolstra
6bb860fd6e
Add FIXME
2016-02-26 21:15:05 +01:00
Eelco Dolstra
e8cdfe5171
hydra-server: Don't barf if the binary cache public key can't be read
2016-02-26 21:14:40 +01:00
Eelco Dolstra
53ca41ef9f
Use US standard S3 region
2016-02-26 20:57:47 +01:00
Eelco Dolstra
c635f5d0ea
Fix Makefile.am
2016-02-26 19:54:55 +01:00
Eelco Dolstra
b1ce76c2b4
Fix test
...
nix-support/failed is supposed to be a file, not a directory.
2016-02-26 19:54:32 +01:00
Eelco Dolstra
07e5fc5618
Hackery to make downloads work when using a binary cache
2016-02-26 17:28:26 +01:00
Eelco Dolstra
b00bdefa98
Fix hydra-server signing
2016-02-26 17:28:16 +01:00
Eelco Dolstra
9de336de7c
Proxy local binary caches via hydra-server
2016-02-26 17:27:30 +01:00
Eelco Dolstra
b9afaadfb3
Keep better bytesReceived/bytesSent stats
2016-02-26 16:17:05 +01:00
Eelco Dolstra
6d741d2ffa
Prevent download of NARs we just uploaded
2016-02-26 15:21:44 +01:00
Eelco Dolstra
02190b0fef
Support hydra-build-products on binary cache stores
2016-02-26 14:45:03 +01:00
Eelco Dolstra
8e24ad6f0d
Sync with Nix
2016-02-25 10:58:31 +01:00
Eelco Dolstra
8321a3eb27
Sync with Nix
2016-02-24 14:04:31 +01:00
Eelco Dolstra
7b509237cd
Bleh Automake
2016-02-22 18:05:15 +01:00
Eelco Dolstra
6c3ae36648
hydra-queue-runner: Get store mode configuration from hydra.conf
...
To use the local Nix store (default):
store_mode = direct
To use a local binary cache:
store_mode = local-binary-cache
binary_cache_dir = /var/lib/hydra/binary-cache
To use an S3 bucket:
store_mode = s3-binary-cache
binary_cache_s3_bucket = my-nix-bucket
Also, respect binary_cache_{secret,public}_key_file for signing the
binary cache.
2016-02-22 17:23:06 +01:00
Eelco Dolstra
94817d77d9
BinaryCacheStore: Respect build-use-substitutes
2016-02-22 17:21:39 +01:00
Eelco Dolstra
5668aa5f71
After uploading a .narinfo, add it to the LRU cache
2016-02-20 10:35:16 +01:00
Eelco Dolstra
88a05763cc
Pool local store connections
2016-02-20 00:04:08 +01:00
Eelco Dolstra
1cefd6cac8
Fix log message
2016-02-20 00:02:37 +01:00
Eelco Dolstra
a593ebc58e
Add missing file
2016-02-19 20:58:40 +01:00
Eelco Dolstra
2b76094a23
S3BinaryCacheStore::isValidPath(): Do a GET instead of HEAD
2016-02-19 17:41:11 +01:00
Eelco Dolstra
bd76f9120a
Cache .narinfo lookups
2016-02-19 16:19:40 +01:00
Eelco Dolstra
a0f74047da
Keep some statistics for the binary cache stores
2016-02-19 14:24:23 +01:00
Eelco Dolstra
dc4a00347d
Use a single BinaryCacheStore for all threads
...
This will make it easier to do caching / keep stats. Also, we won't
have S3Client's connection pooling if we create multiple S3Client
instances.
2016-02-18 17:31:19 +01:00
Eelco Dolstra
00a7be13a2
Make queue runner internal status available under /queue-runner-status
2016-02-18 17:11:46 +01:00