14 commits

Author	SHA1	Message	Date
Ilya K	9f0e601d84	Scrape grafana/loki/mimir own metrics	2024-07-08 10:25:15 +03:00
Ilya K	209f71c63a	Update node_exporter dashboard for new metrics structure	2024-07-08 10:16:37 +03:00
Ilya K	563e0685d4	Metrics fixups ... - fix grafana-agent config format - rekey metrics-push-password for fodwatch	2024-07-08 10:01:25 +03:00
emily	8d2a367e92	grafana-agent: make bagel.monitoring.grafana-agent.exporters an attrset ... This allows us to use multiple jobs, one for each additional exporter, and set their `job_name` accordingly. `job_name` is exported as `job` label on the resulting metrics. This allows us to quickly get an understanding what metrics of an exporter are actually available by simply filtering all metrics by `{job="$jobname"}`	2024-07-08 09:34:26 +03:00
emily	db8c831c2f	grafana-agent: set hostname label on all metrics ... This is handy to quickly see all metrics exported by a node, without having to mangle with the already existing `instance` label. `hostname` is essentially a variant of `instance` but without ports.	2024-07-08 09:34:26 +03:00
Ilya K	ba0d50624d	Switch to push metrics with Grafana Agent	2024-07-08 09:34:24 +03:00
Ilya K	40ba3c4ae7	Prepare for remote push metrics	2024-07-08 09:33:59 +03:00
Ilya K	346a74eabc	Wire up Grafana to Alertmanager	2024-07-08 09:33:59 +03:00
Ilya K	e8e262c6a4	Enable Mimir Alertmanager, add example alert ... Still TODO: actually connect it to Matrix	2024-07-08 09:33:59 +03:00
Ilya K	5b0f3c4541	Split node_exporter and cadvisor config, disable cadvisor for nodes that are themselves containers	2024-07-05 20:06:43 +03:00
Ilya K	2441d18f17	Add Loki + Promtail setup	2024-07-05 16:10:31 +00:00
Ilya K	03cb9c390c	Add postgres exporter	2024-07-05 16:10:31 +00:00
Ilya K	42f8ad8fa4	Add nginx log exporter	2024-07-05 16:10:31 +00:00
Ilya K	63b31e98cf	Add Grafana/Prometheus/Mimir minimal setup ... More later, Loki also later.	2024-07-05 16:10:31 +00:00