Archive/DiscordChatExporter
1
0
Fork 0
mirror of https://github.com/Tyrrrz/DiscordChatExporter.git synced 2026-06-09 15:52:37 -06:00
Code Issues Actions Packages Projects Releases Wiki Activity
DiscordChatExporter/docs/recurring-scrape-operator-checklist.md
Boden 3fd42d924e feat(scrape): sync GUI bridge doc into linux-x64 folder 
Add sync-gui-bridge-doc.sh to copy the versioned bridge markdown beside
the GUI zip; includes offline smoke test (18 total via run-all-smokes).
2026-05-29 16:10:17 -05:00

1.9 KiB
Raw Blame History

Recurring scrape operator checklist

Use this after cloning or opening the source repo (DiscordChatExporter, not the GUI zip alone).

One-time setup

  1. ./scripts/operator-handoff.sh — recommended: disk summary, verify-operator-ready, and documents dry-run in one step. Or ./scripts/verify-operator-ready.sh alone for prerequisites only.
  2. cp scrape.env.example scrape.env and set DISCORD_TOKEN, or ./scripts/sync-token-from-gui.sh --force (reads GUI Settings.dat).
  3. ./scripts/bootstrap-recurring-scrape.sh --dry-run — confirm every enabled target has seeded JSON under output_dir.
  4. ./scripts/bootstrap-recurring-scrape.sh — verify archives, build image, preflight Discord.
  5. ./scripts/run-documents-scrape.sh — first incremental append-only scrape.
  6. ./scripts/prove-incremental-append.sh --target <name> — optional grow-only proof.
  7. ./scripts/audit-archive-json.sh — optional; lists invalid JSON before cron runs.

Monthly automation

./scripts/setup-cron.sh --dry-run
./scripts/setup-cron.sh --skip-preflight   # after bootstrap preflight already succeeded

Defaults: first day of month at 04:00. Override with --interval weekly, --at HH:MM, or --cron '0 4 1 * *'.

Installed jobs are marked # BEGIN discord-scrape in crontab -l. Logs append to logs/discord-scrape.log.

Narrow a run

./scripts/run-documents-scrape.sh --target KotOR_discord_msgs
./scripts/setup-cron.sh --target KotOR_discord_msgs --channel CHANNEL_ID

GUI zip only

See gui-zip-recurring-scrape-bridge.md, run ./scripts/sync-gui-bridge-doc.sh, or use ../DiscordChatExporter.linux-x64/bootstrap-recurring-scrape.sh.

Validate scripts after changes:

./scripts/run-all-smokes.sh

Merge / review summary: recurring-scrape-merge-readiness.md

Full detail: .docs/Recurring-Scrape-Setup.md