Dashboard, metrics and traces do not cover ipx-directory or ipx-web #210
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Found checking observability after the #203 and #205 deploys. Loki collects all three containers' logs, but the Grafana dashboard (grafana/dashboard.py) reads only {container="iPX"}. ipx-directory has no panels (requests by status and token, snapshots, feed check failures, refresher progress), no Prometheus metrics and no traces. ipx-web (Caddy) has no access log, no metrics and no traces, so static file and page requests are seen nowhere; ipx's log shows the page only as /api/page-check. ipx's own /metrics and traces are unchanged, though page routes such as GET / no longer appear in its panels.
Done in
751a45fandcd09938, deployed, dashboard installed (54 panels). Caddy now logs one JSON line a request, without ?token= or request headers (its error log filtered the same; checked by sending a token, cookie and Access header and finding none in the log). New rows: Page (requests by status, response time, from ipx-web) and Directory (feeds shared, snapshots, refused as private, feed checks and failures, requests by token, failing feeds, snapshots by server), and a warnings panel for both containers. The directory logs a line per refresher round (feeds checked); its first comes when feeds fall due again, six hours after the first fill. Not done: Prometheus metrics and traces for the directory and ipx-web; logs carry what the panels need at this traffic.