The logs repeat what metrics and the line itself already say #363

New Issue

rays · 2026-10-25T08:00:01-07:00

rays commented

2026-10-25 08:00:01 -07:00

Found reading production's logs (2026-10-25), 24 hours:

iPX logs scan_done after every scan: 921 lines a day, 22% of its lines, nearly all "scan complete, 1 feed(s)". Since #114 a scan is one or two feeds every few minutes, and ipx_jobs_total{kind="scan"}, ipx_feed_fetches_total and ipx_last_scan_age_seconds hold all of it. The dashboard's "Feeds checked" series and the prod check's check 4 read the line.
ipx-directory writes each line's span twice, as span and again in spans, and neither adds anything: a request line's span repeats its method, path and status under OpenTelemetry's names, refresh.feeds repeats checked, and a feed span is empty. ipx already leaves the list out.

ipx::http repeats Caddy's access line and the request's span, but each holds what the others do not (ipx's route pattern and time; Caddy's 502s and the client's address), so it stays.

Found reading production's logs (2026-10-25), 24 hours: * iPX logs `scan_done` after every scan: 921 lines a day, 22% of its lines, nearly all "scan complete, 1 feed(s)". Since #114 a scan is one or two feeds every few minutes, and `ipx_jobs_total{kind="scan"}`, `ipx_feed_fetches_total` and `ipx_last_scan_age_seconds` hold all of it. The dashboard's "Feeds checked" series and the prod check's check 4 read the line. * ipx-directory writes each line's span twice, as `span` and again in `spans`, and neither adds anything: a request line's span repeats its method, path and status under OpenTelemetry's names, `refresh.feeds` repeats `checked`, and a `feed` span is empty. ipx already leaves the list out. `ipx::http` repeats Caddy's access line and the request's span, but each holds what the others do not (ipx's route pattern and time; Caddy's 502s and the client's address), so it stays.

rays added the enhancement label 2026-10-25 08:00:01 -07:00

rays referenced this issue from a commit

2026-10-25 08:01:52 -07:00

The logs stop repeating what metrics and their own fields say (#363)

rays commented

2026-10-25 08:05:34 -07:00

Fixed in 6352324: scan_done is logged at debug (the page's log view keeps it, Loki no longer gets it), and ipx-directory's JSON lines carry no span or span list. The dashboard's "feeds checked" reads ipx_feed_fetches_total, and the prod check's check 4 reads ipx_jobs_total and ipx_downloads_pending. Deployed: ipx and ipx-directory, 2026-10-25.

Fixed in 6352324: scan_done is logged at debug (the page's log view keeps it, Loki no longer gets it), and ipx-directory's JSON lines carry no span or span list. The dashboard's "feeds checked" reads ipx_feed_fetches_total, and the prod check's check 4 reads ipx_jobs_total and ipx_downloads_pending. Deployed: ipx and ipx-directory, 2026-10-25.

rays closed this issue

2026-10-25 08:05:35 -07:00

rays referenced this issue

2026-10-25 08:07:48 -07:00

Every API request is logged three times, and ipx has no request metric to stand in for its line #364

Sign in to join this conversation.

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: rays/ipx#363