infra/services/monitoring/lgtm/alerts/forkos.yaml

groups:
    - name: ForkOS automation
      rules:
        - alert: SyncFailedTooOften
          expr: 'changes(node_systemd_unit_state{name=~"ows.*.service",state="failed"}[1d]) > 2'
          for: 30m
          labels:
            severity: critical
          annotations:
            description: On {{ $labels.instance }}, the synchronization job has failed more than twice in the last 24 hours, check if there's a conflict or a stdenv change.
            summary: Synchronization job {{ $labels.name }} has failed more than twice in the last 24 hours
feat(alerts): add a sync failed too often alert Signed-off-by: Raito Bezarius <masterancpp@gmail.com> 2024-08-09 14:05:19 +00:00			`groups:`
feat: check formatting and validity of alerts Fixes #94. 2024-10-07 19:41:23 +00:00			`- name: ForkOS automation`
			`rules:`
			`- alert: SyncFailedTooOften`
			`expr: 'changes(node_systemd_unit_state{name=~"ows.*.service",state="failed"}[1d]) > 2'`
			`for: 30m`
			`labels:`
			`severity: critical`
			`annotations:`
			`description: On {{ $labels.instance }}, the synchronization job has failed more than twice in the last 24 hours, check if there's a conflict or a stdenv change.`
			`summary: Synchronization job {{ $labels.name }} has failed more than twice in the last 24 hours`