Set up alerting for Grafana/Mimir
Look into Grafana Alloy -> push to Mimir instead of Prometheus pull
8d2a367e92
grafana-agent: make
bagel.monitoring.grafana-agent.exporters
an attrset
db8c831c2f
grafana-agent: set
hostname
label on all metrics
ba0d50624d
Switch to push metrics with Grafana Agent
40ba3c4ae7
Prepare for remote push metrics
346a74eabc
Wire up Grafana to Alertmanager
Enable Mimir Alertmanager, add example alert
8d2a367e92
grafana-agent: make
bagel.monitoring.grafana-agent.exporters
an attrset
db8c831c2f
grafana-agent: set
hostname
label on all metrics
ba0d50624d
Switch to push metrics with Grafana Agent
40ba3c4ae7
Prepare for remote push metrics
346a74eabc
Wire up Grafana to Alertmanager
Enable Mimir Alertmanager, add example alert
I actually did this intentionally, but I can add all the exporters manually too.
Enable Mimir Alertmanager, add example alert
Yeah, I can do that. I've never really bothered beyond the one job per machine thing but this can also work and if it makes life easier for people, I don't care either way.
d26dd9f2a6
Switch to push metrics with Grafana Agent
461e63b683
Prepare for remote push metrics
8d22df82bd
Wire up Grafana to Alertmanager
22c87569b7
Enable Mimir Alertmanager, add example alert
30859b2872
terraform: store state on S3
ddd0c365ae
Switch to push metrics with Grafana Agent
31ee302ec9
Prepare for remote push metrics
WIP: Enable Mimir Alertmanager, add example alert
systems: add fodwatch.forkos.org