Add friendly scrape names and a completeness check

This commit is contained in:
Fisto
2026-09-21 10:40:53 +02:00
parent 19bf6e16fc
commit 3bba051971
7 changed files with 219 additions and 8 deletions
+9
View File
@@ -40,6 +40,15 @@ mobile draft at 390px.
- [x] C11 preview caching: Discord-hosted image/GIF previews (WebP 320px, hash-addressed, 5 MiB
cap, one attempt) run after every walk in both modes. Live run `...-20260916090722`:
`previewed: 2`; thumbs served over `/api/media/<scrape>/<item>/thumb` (200).
- [x] C59 Scrape names and the completeness check. Scrape listings (History, Clean media,
Bot-tab job/lane cards) now lead with the first two words of the channel or group-chat name
plus the scrape id. New `poc/scripts/verify-scrapes.ts` (`pnpm verify:scrapes`) checks every
index: done state, no lastError, messages non-zero, messages vs the Discord search total, and
the oldest message against the source's snowflake creation time (60-day grace). Scrapes a
later full walk supersedes are reported as `old`, not failures. Result: 10 complete, 4
superseded, 1 genuinely incomplete — the early DM test scrape
`805255536223715370-20260916215657` (10 messages, pagination stopped before the fix, never
re-scraped).
- [x] C58 Titles from Discord's embed cache. Gone YouTube videos have no oEmbed answer, but
Discord keeps the embed title (and, with the rebuilt core bundle, the author/channel). The
title lane now asks the source message's embed first and only then the provider oEmbed; the