Archive/DiscordChatExporter
1
0
Fork 0
mirror of https://github.com/Tyrrrz/DiscordChatExporter.git synced 2026-06-10 00:02:37 -06:00
Code Issues Actions Packages Projects Releases Wiki Activity
DiscordChatExporter/docs/plans/2026-05-28-008-live-documents-scrape-proof-plan.md
Boden 88e864c72a feat(scrape): add Documents scrape workflow and token discovery 
Auto-discover token files, provide run-documents-scrape and
prove-incremental-append helpers, and document the end-to-end operator flow.

Co-authored-by: Cursor <cursoragent@cursor.com>
2026-05-28 02:23:34 -05:00

1.3 KiB
Raw Blame History

title: fix: Live Documents scrape proof and token discovery type: fix status: completed date: 2026-05-28 origin: LFG repeat — ensure ~/Documents/** append scrape works with proper auth depends_on: docs/plans/2026-05-28-007-verify-documents-auth-bootstrap-plan.md

fix: Live Documents scrape proof and token discovery

Summary

Append-safe scraping is implemented but live Discord auth has never been exercised in this environment. Add automatic token-file discovery, a unified operator entrypoint, and a grow-only proof harness that records message counts before/after a scrape.

Requirements

ID Requirement Files
L1 Host runner discovers DISCORD_TOKEN_FILE from standard paths when unset scripts/run-discord-scrape-host.sh, smoke test
L2 run-documents-scrape.sh runs verify → auth check → preflight → scrape scripts/run-documents-scrape.sh
L3 prove-incremental-append.sh asserts same paths and non-shrinking message counts scripts/prove-incremental-append.sh, smoke test

Success Criteria

  • ./scripts/run-documents-scrape.sh --dry-run passes without token
  • With valid token, ./scripts/prove-incremental-append.sh --target KotOR_discord_msgs shows grow-only counts
  • Smoke tests pass