The Herd with Colin Cowherd no longer updates: its feed is over the 50 MB cap #357

Closed
opened 2026-10-24 05:37:50 -07:00 by rays · 1 comment
Owner

Since 2026-10-20 the feed the-herd-with-colin-cowherd fails on every check (once a day, at about 03:17 UTC) with reading body: larger than 50 MB, too large to be a feed. The cap (MAX_BODY in crates/feed/src/fetch.rs) came in with #295 on 2026-10-19 (a214727); the failures began the next day.

The feed is real and simply large: Omny's podcast.rss for the show is 62,575,756 bytes (curl, 2026-10-24), 200 OK, in 2.8 s. So no new episodes reach anyone who subscribes.

Found by: query.py metric 'sum(count_over_time({container="iPX"} |= "the-herd-with-colin-cowherd" |= "larger than 50 MB" [$range]))' 30d → 5, first 2026-10-20T03:16:23Z.

Options: raise the cap (to 100 MB, say) and keep the bound #295 wanted, or stream-parse so a large feed costs no more memory than a small one. Note the container now has mem_limit: 2g; peak RSS since the last deploy is 240 MB.

Since 2026-10-20 the feed `the-herd-with-colin-cowherd` fails on every check (once a day, at about 03:17 UTC) with `reading body: larger than 50 MB, too large to be a feed`. The cap (`MAX_BODY` in crates/feed/src/fetch.rs) came in with #295 on 2026-10-19 (a214727); the failures began the next day. The feed is real and simply large: Omny's podcast.rss for the show is 62,575,756 bytes (curl, 2026-10-24), 200 OK, in 2.8 s. So no new episodes reach anyone who subscribes. Found by: `query.py metric 'sum(count_over_time({container="iPX"} |= "the-herd-with-colin-cowherd" |= "larger than 50 MB" [$range]))' 30d` → 5, first 2026-10-20T03:16:23Z. Options: raise the cap (to 100 MB, say) and keep the bound #295 wanted, or stream-parse so a large feed costs no more memory than a small one. Note the container now has `mem_limit: 2g`; peak RSS since the last deploy is 240 MB.
rays added the bug label 2026-10-24 05:37:50 -07:00
Author
Owner

Fixed in b72e657: a feed is read up to 200 MB, not 50. Deployed to ipx (1.5.1-dev) and ipx-directory. A forced check of the-herd-with-colin-cowherd brought in 41 new entries in 5 s; ipx's peak memory over that time was 195 MB.

Fixed in b72e657: a feed is read up to 200 MB, not 50. Deployed to ipx (1.5.1-dev) and ipx-directory. A forced check of the-herd-with-colin-cowherd brought in 41 new entries in 5 s; ipx's peak memory over that time was 195 MB.
rays closed this issue 2026-10-24 05:54:33 -07:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: rays/ipx#357