2017-10-29 21:10:26 +00:00
|
|
|
# grahamcofborg
|
|
|
|
|
2017-11-23 15:50:03 +00:00
|
|
|
## Guidelines
|
|
|
|
|
|
|
|
1. make sure you've reviewed the code before you trigger it on a PR
|
|
|
|
that isn't your own
|
|
|
|
2. be gentle, preferably don't run mass rebuilds / massive builds like
|
|
|
|
chromium on it
|
|
|
|
|
2018-02-03 14:37:37 +00:00
|
|
|
## Automatic Building
|
|
|
|
|
2018-02-03 17:41:32 +00:00
|
|
|
Users who are _trusted_ (see: ./config.public.json) or _known_ (see:
|
|
|
|
./config.known-users.json) will have their PRs automatically trigger
|
|
|
|
builds if their commits follow the well-defined format of Nixpkgs.
|
|
|
|
Example messages and the builds:
|
2018-02-03 14:37:37 +00:00
|
|
|
|
|
|
|
|Message|Automatic Build|
|
|
|
|
|-|-|
|
|
|
|
|`vim: 1.0.0 -> 2.0.0`|`vim`|
|
2018-02-03 17:41:32 +00:00
|
|
|
|`python36Packages.requests,python27Packages.requests: 1.0.0 -> 2.0.0`|`python36Packages.requests`, `python27Packages.requests`|
|
2018-02-03 14:37:37 +00:00
|
|
|
|`python{2,3}Packages.requests: 1.0.0 -> 2.0.0`|_nothing_|
|
|
|
|
|
2018-02-03 17:41:32 +00:00
|
|
|
If a PR is opened with many commits, it will create a single build job
|
|
|
|
for all of the detected packages. If a PR is opened and many commits
|
|
|
|
are pushed one by one to the open PR, many build jobs will be created.
|
2018-02-03 14:37:37 +00:00
|
|
|
|
2018-02-03 17:47:08 +00:00
|
|
|
To disable automatic building of packages on a PR, add `[WIP]` to the
|
2018-02-03 17:41:32 +00:00
|
|
|
PR's title, or the `2.status: work-in-progress` label.
|
2018-02-03 14:37:37 +00:00
|
|
|
|
2017-11-23 13:38:52 +00:00
|
|
|
## Commands
|
|
|
|
|
Support ofborg comments inline with other text
The old design of the parser treated all whitespace the same and
mandated that `grahamcofborg` (plus the `@`) be the first token in the
text. This allowed for some ridiculous but command calls:
grahamcofborg build foo
bar
baz
This used to become a build instruction for foo, bar, and baz. After
this change, it is just an instruction for building foo. This allows
for comments for people to be intertwined with comments for the bot:
grahamcofborg build foo
Let's see what happens!
Before this would unintentionally become a build instruction for
`foo`, `Let's`, `see`, `what`, `happens!`, and is now only going to
build `foo`.
Additionally, this comment would do nothing:
Let's see what happens!
grahamcofborg build foo
Or a more real case where people expected this to work:
/cc grahamc for ^^
GrahamcOfBorg eval
This will continue to not produce a build instruction, because
grahamcofborg must be the first word of a line:
foo bar grahamcofborg build foo
Note: I've removed `@`s from all usernames to avoid accidental email.
2017-12-22 13:51:55 +00:00
|
|
|
The comment parser is line-based, so comments can be interleaved with
|
|
|
|
instructions.
|
|
|
|
|
|
|
|
1. To trigger the bot, the line _must_ start with a case
|
2017-11-23 13:38:52 +00:00
|
|
|
insensitive version of `@GrahamcOfBorg`.
|
|
|
|
2. To use multiple commands, insert a bit of whitespace and then your
|
|
|
|
new command.
|
|
|
|
|
|
|
|
Commands:
|
|
|
|
|
2017-11-24 19:40:53 +00:00
|
|
|
### test (added: 2017-11-24)
|
2017-11-24 19:08:00 +00:00
|
|
|
|
|
|
|
```
|
|
|
|
@grahamcofborg test list of tests
|
|
|
|
```
|
|
|
|
|
2018-02-13 16:17:09 +00:00
|
|
|
This will run `nix-build ./nixos/release.nix -A tests.list -A tests.of -A tests.tests` in
|
2017-11-24 19:08:00 +00:00
|
|
|
the nixpkgs checkout. Note: this will only run on x86_64-linux machines.
|
|
|
|
|
2017-11-24 19:40:53 +00:00
|
|
|
### eval
|
2017-11-24 19:08:00 +00:00
|
|
|
|
2017-11-23 13:38:52 +00:00
|
|
|
```
|
|
|
|
@grahamcofborg eval
|
|
|
|
```
|
|
|
|
|
2017-11-23 19:25:33 +00:00
|
|
|
Note: Every PR automatically evaluates when it is opened and when the
|
|
|
|
commits change. There is no reason to run eval on a PR unless the
|
|
|
|
evaluation has failed for weird reasons, or because master was broken
|
|
|
|
before.
|
|
|
|
|
2017-11-24 19:40:53 +00:00
|
|
|
### build
|
|
|
|
|
|
|
|
```
|
|
|
|
@grahamcofborg build list of attrs
|
|
|
|
```
|
|
|
|
|
|
|
|
This will run `nix-build ./default.nix -A list -A of -A attrs` in
|
|
|
|
the nixpkgs checkout.
|
|
|
|
|
2017-11-23 19:25:33 +00:00
|
|
|
---
|
|
|
|
|
|
|
|
|
2017-11-23 13:38:52 +00:00
|
|
|
Multiple Commands:
|
|
|
|
|
|
|
|
```
|
|
|
|
@grahamcofborg build list of attrs
|
|
|
|
@grahamcofborg eval
|
|
|
|
```
|
|
|
|
|
|
|
|
or even:
|
|
|
|
|
|
|
|
```
|
|
|
|
@grahamcofborg build list of attrs @grahamcofborg eval
|
|
|
|
```
|
|
|
|
|
Support ofborg comments inline with other text
The old design of the parser treated all whitespace the same and
mandated that `grahamcofborg` (plus the `@`) be the first token in the
text. This allowed for some ridiculous but command calls:
grahamcofborg build foo
bar
baz
This used to become a build instruction for foo, bar, and baz. After
this change, it is just an instruction for building foo. This allows
for comments for people to be intertwined with comments for the bot:
grahamcofborg build foo
Let's see what happens!
Before this would unintentionally become a build instruction for
`foo`, `Let's`, `see`, `what`, `happens!`, and is now only going to
build `foo`.
Additionally, this comment would do nothing:
Let's see what happens!
grahamcofborg build foo
Or a more real case where people expected this to work:
/cc grahamc for ^^
GrahamcOfBorg eval
This will continue to not produce a build instruction, because
grahamcofborg must be the first word of a line:
foo bar grahamcofborg build foo
Note: I've removed `@`s from all usernames to avoid accidental email.
2017-12-22 13:51:55 +00:00
|
|
|
This will also work:
|
2017-11-23 13:38:52 +00:00
|
|
|
|
|
|
|
```
|
|
|
|
looks good to me!
|
|
|
|
@grahamcofborg build list of attrs
|
|
|
|
```
|
|
|
|
|
Support ofborg comments inline with other text
The old design of the parser treated all whitespace the same and
mandated that `grahamcofborg` (plus the `@`) be the first token in the
text. This allowed for some ridiculous but command calls:
grahamcofborg build foo
bar
baz
This used to become a build instruction for foo, bar, and baz. After
this change, it is just an instruction for building foo. This allows
for comments for people to be intertwined with comments for the bot:
grahamcofborg build foo
Let's see what happens!
Before this would unintentionally become a build instruction for
`foo`, `Let's`, `see`, `what`, `happens!`, and is now only going to
build `foo`.
Additionally, this comment would do nothing:
Let's see what happens!
grahamcofborg build foo
Or a more real case where people expected this to work:
/cc grahamc for ^^
GrahamcOfBorg eval
This will continue to not produce a build instruction, because
grahamcofborg must be the first word of a line:
foo bar grahamcofborg build foo
Note: I've removed `@`s from all usernames to avoid accidental email.
2017-12-22 13:51:55 +00:00
|
|
|
And this is fine:
|
2017-11-23 13:38:52 +00:00
|
|
|
|
|
|
|
```
|
|
|
|
@grahamcofborg build list of attrs
|
|
|
|
looks good to me!
|
|
|
|
```
|
|
|
|
|
Support ofborg comments inline with other text
The old design of the parser treated all whitespace the same and
mandated that `grahamcofborg` (plus the `@`) be the first token in the
text. This allowed for some ridiculous but command calls:
grahamcofborg build foo
bar
baz
This used to become a build instruction for foo, bar, and baz. After
this change, it is just an instruction for building foo. This allows
for comments for people to be intertwined with comments for the bot:
grahamcofborg build foo
Let's see what happens!
Before this would unintentionally become a build instruction for
`foo`, `Let's`, `see`, `what`, `happens!`, and is now only going to
build `foo`.
Additionally, this comment would do nothing:
Let's see what happens!
grahamcofborg build foo
Or a more real case where people expected this to work:
/cc grahamc for ^^
GrahamcOfBorg eval
This will continue to not produce a build instruction, because
grahamcofborg must be the first word of a line:
foo bar grahamcofborg build foo
Note: I've removed `@`s from all usernames to avoid accidental email.
2017-12-22 13:51:55 +00:00
|
|
|
This is will build `list`, `of`, `attrs`, `looks`, `good`, `to`, `me!`:
|
|
|
|
|
|
|
|
```
|
|
|
|
@grahamcofborg build list of attrs looks good to me!
|
|
|
|
```
|
2017-11-23 13:38:52 +00:00
|
|
|
|
2017-12-16 13:57:30 +00:00
|
|
|
|
2017-12-20 12:01:32 +00:00
|
|
|
# How does OfBorg call nix-build?
|
2017-12-16 13:57:30 +00:00
|
|
|
|
|
|
|
Builds are run like:
|
|
|
|
|
2017-12-20 12:01:32 +00:00
|
|
|
> HOME=/homeless-shelter NIX_PATH=nixpkgs=$(pwd) nix-build ./default.nix
|
|
|
|
> --no-out-link --keep-going -A hello
|
|
|
|
> --option restrict-eval true
|
|
|
|
> --option build-timeout 1800
|
|
|
|
> --argstr system thesystem
|
|
|
|
> --show-trace
|
|
|
|
|
|
|
|
# How does OfBorg call nix-instantiate?
|
|
|
|
|
|
|
|
NixOS evals are run like:
|
|
|
|
|
|
|
|
> HOME=/homeless-shelter NIX_PATH=nixpkgs=$(pwd) nix-instantiate ./nixos/release.nix
|
|
|
|
> -A manual
|
|
|
|
> --option restrict-eval true
|
|
|
|
> --option build-timeout 1800
|
|
|
|
> --argstr system thesystem
|
|
|
|
> --show-trace
|
|
|
|
|
|
|
|
Nixpkgs evals are run like:
|
|
|
|
|
|
|
|
> HOME=/homeless-shelter NIX_PATH=nixpkgs=$(pwd) nix-instantiate ./pkgs/top-level/release.nix
|
|
|
|
> -A manual
|
|
|
|
> --option restrict-eval true
|
|
|
|
> --option build-timeout 1800
|
2017-12-16 13:57:30 +00:00
|
|
|
> --argstr system thesystem
|
2017-12-20 12:01:32 +00:00
|
|
|
> --show-trace
|
2017-12-16 13:57:30 +00:00
|
|
|
|
|
|
|
|
|
|
|
---
|
|
|
|
|
2017-11-23 13:38:52 +00:00
|
|
|
|
2017-10-29 21:10:26 +00:00
|
|
|
|
|
|
|
|
2017-12-20 02:46:29 +00:00
|
|
|
# Running a builder
|
2017-11-04 16:21:55 +00:00
|
|
|
|
2017-12-20 02:46:29 +00:00
|
|
|
```
|
|
|
|
nix-shell ./shell.nix
|
|
|
|
$ cd ofborg
|
|
|
|
$ cargo build
|
|
|
|
```
|
2017-11-04 16:21:55 +00:00
|
|
|
|
2017-12-20 02:46:29 +00:00
|
|
|
```
|
|
|
|
cargo build
|
|
|
|
```
|
2017-10-29 21:10:26 +00:00
|
|
|
|
2017-12-20 02:46:29 +00:00
|
|
|
then copy example.config.json to config.json and edit its vars. Set
|
|
|
|
`nix.remote` to an empty string if you're not using the daemon.
|
2017-11-04 16:21:55 +00:00
|
|
|
|
2017-12-20 02:46:29 +00:00
|
|
|
Run
|
|
|
|
|
|
|
|
```
|
|
|
|
./target/debug/builder ./config.json
|
|
|
|
```
|
|
|
|
|
|
|
|
|
2018-01-27 04:02:51 +00:00
|
|
|
Note the config.public.json for the public pieces of how I run ofborg,
|
|
|
|
which is merged with config.known-users.json and a third private
|
|
|
|
config file of credentials. These files contain some special keys like
|
|
|
|
|
|
|
|
- known users
|
|
|
|
- authorized users
|
|
|
|
- log storage
|
|
|
|
|
|
|
|
they are only used in the backend processing tasks, and there is no
|
|
|
|
need for them on builders. However, to update the list in
|
|
|
|
config.known-users.json, run `./scripts/update-known-users.sh`.
|
2017-12-20 02:46:29 +00:00
|
|
|
|
|
|
|
## old php stuff...
|
2017-10-29 21:42:23 +00:00
|
|
|
|
2018-01-29 03:24:44 +00:00
|
|
|
Only Graham needs to do this, since I run the only remaining PHP
|
|
|
|
components.
|
|
|
|
|
2017-10-29 21:10:26 +00:00
|
|
|
```php
|
|
|
|
<?php
|
|
|
|
|
|
|
|
require_once __DIR__ . '/vendor/autoload.php';
|
|
|
|
use PhpAmqpLib\Connection\AMQPSSLConnection;
|
|
|
|
use PhpAmqpLib\Message\AMQPMessage;
|
|
|
|
|
2018-01-29 03:24:44 +00:00
|
|
|
function rabbitmq_conn($timeout = 3) {
|
|
|
|
$host = 'events.nix.gsc.io';
|
2017-10-29 21:10:26 +00:00
|
|
|
$connection = new AMQPSSLConnection(
|
2018-01-29 03:24:44 +00:00
|
|
|
$host, 5671,
|
|
|
|
'eventsuser, eventspassword, '/',
|
|
|
|
array(
|
2017-10-29 21:10:26 +00:00
|
|
|
'verify_peer' => true,
|
|
|
|
'verify_peer_name' => true,
|
2018-01-29 03:24:44 +00:00
|
|
|
'peer_name' => $host,
|
2017-10-29 21:10:26 +00:00
|
|
|
'verify_depth' => 10,
|
2018-01-29 03:24:44 +00:00
|
|
|
'ca_file' => '/etc/ssl/certs/ca-certificates.crt',
|
|
|
|
), array(
|
|
|
|
'connection_timeout' => $timeout,
|
2017-10-29 21:10:26 +00:00
|
|
|
)
|
|
|
|
);
|
|
|
|
|
|
|
|
return $connection;
|
|
|
|
}
|
|
|
|
|
|
|
|
function gh_client() {
|
|
|
|
$client = new \Github\Client();
|
|
|
|
$client->authenticate('githubusername',
|
|
|
|
'githubpassword',
|
|
|
|
Github\Client::AUTH_HTTP_PASSWORD);
|
|
|
|
|
|
|
|
return $client;
|
|
|
|
}
|
2018-01-29 03:24:44 +00:00
|
|
|
|
2017-10-29 21:10:26 +00:00
|
|
|
```
|