Archive/DiscordChatExporter
1
0
Fork 0
mirror of https://github.com/Tyrrrz/DiscordChatExporter.git synced 2026-06-09 15:52:37 -06:00
Code Issues Actions Packages Projects Releases Wiki Activity
DiscordChatExporter/docs/recurring-scrape-operator-checklist.md
Boden 058aaa0960 feat(scrape): add bootstrap CI smoke and operator checklist 
Document bootstrap-first workflow; verify dry-run in CI; live
bootstrap preflight validated against Documents archives.
2026-05-29 14:02:06 -05:00

1.2 KiB
Raw Blame History

Recurring scrape operator checklist

Use this after cloning or opening the source repo (DiscordChatExporter, not the GUI zip alone).

One-time setup

  1. cp scrape.env.example scrape.env and set DISCORD_TOKEN (user token recommended for guild history).
  2. ./scripts/bootstrap-recurring-scrape.sh --dry-run — confirm every enabled target has seeded JSON under output_dir.
  3. ./scripts/bootstrap-recurring-scrape.sh — verify archives, build image, preflight Discord.
  4. ./scripts/run-documents-scrape.sh — first incremental append-only scrape.
  5. ./scripts/prove-incremental-append.sh --target <name> — optional grow-only proof.

Monthly automation

./scripts/setup-cron.sh --dry-run
./scripts/setup-cron.sh

Defaults: first day of month at 04:00. Override with --interval weekly, --at HH:MM, or --cron '0 4 1 * *'.

Narrow a run

./scripts/run-documents-scrape.sh --target KotOR_discord_msgs
./scripts/setup-cron.sh --target KotOR_discord_msgs --channel CHANNEL_ID

GUI zip only

See ../DiscordChatExporter.linux-x64/RECURRING-SCRAPE.md or run ../DiscordChatExporter.linux-x64/bootstrap-recurring-scrape.sh.

Full detail: .docs/Recurring-Scrape-Setup.md