Monitoring: Prometheus blackbox probes #15

Closed
opened 2026-03-05 18:45:51 -06:00 by jeremy · 0 comments
Owner

Add Prometheus blackbox HTTP probes for the Farm Manager health endpoints on all 3 nodes.

Targets to add to blackbox config

Target URL Module
farm-manager-api http://192.168.86.192:8888/health http_2xx
farm-agent-pdocker01 http://192.168.86.192:8889/health http_2xx
farm-agent-pdocker02 http://192.168.86.100:8889/health http_2xx
farm-agent-bart http://192.168.86.167:8889/health http_2xx

Tasks

  • Add 4 targets to the blackbox probe configuration in Prometheus
  • Hot-reload Prometheus config: curl -X POST http://localhost:9090/-/reload
  • Verify probes appear in Prometheus targets page
  • Add alerting rule: alert if farm-manager-api down for 2 minutes
  • Update Grafana service health dashboard to include Farm Manager rows

Notes

  • Prometheus config on hf-pdocker-01 in /mnt/docker-data/configs/prometheus/
  • Blackbox targets in blackbox.yml or prometheus.yml scrape config
Add Prometheus blackbox HTTP probes for the Farm Manager health endpoints on all 3 nodes. ## Targets to add to blackbox config | Target | URL | Module | |--------|-----|--------| | farm-manager-api | http://192.168.86.192:8888/health | http_2xx | | farm-agent-pdocker01 | http://192.168.86.192:8889/health | http_2xx | | farm-agent-pdocker02 | http://192.168.86.100:8889/health | http_2xx | | farm-agent-bart | http://192.168.86.167:8889/health | http_2xx | ## Tasks - [ ] Add 4 targets to the blackbox probe configuration in Prometheus - [ ] Hot-reload Prometheus config: `curl -X POST http://localhost:9090/-/reload` - [ ] Verify probes appear in Prometheus targets page - [ ] Add alerting rule: alert if farm-manager-api down for 2 minutes - [ ] Update Grafana service health dashboard to include Farm Manager rows ## Notes - Prometheus config on hf-pdocker-01 in /mnt/docker-data/configs/prometheus/ - Blackbox targets in blackbox.yml or prometheus.yml scrape config
jeremy added this to the v1.0 milestone 2026-03-05 18:45:51 -06:00
jeremy added the infrastructure label 2026-03-05 18:45:51 -06:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: jeremy/farm-manager#15