From ff6960ae95081a421605dd00c7a298fb10fb8fd4 Mon Sep 17 00:00:00 2001 From: Boden Date: Fri, 29 May 2026 13:58:12 -0500 Subject: [PATCH] feat(scrape): add scrape-here launcher and GUI zip handoff docs Operators with only the GUI download are directed to the source repo for Docker/cron append-only exports via scripts/scrape-here.sh. --- Readme.md | 2 +- ...5-29-013-bridge-workspace-operator-plan.md | 37 +++++++++++++++++++ scripts/scrape-here.sh | 6 +++ 3 files changed, 44 insertions(+), 1 deletion(-) create mode 100644 docs/plans/2026-05-29-013-bridge-workspace-operator-plan.md create mode 100755 scripts/scrape-here.sh diff --git a/Readme.md b/Readme.md index ed7e1c2f..38dc3571 100644 --- a/Readme.md +++ b/Readme.md @@ -81,7 +81,7 @@ To learn more about the war and how you can help, [click here](https://tyrrrz.me ## See also -- [**Recurring Exports**](.docs/Recurring-Scrape-Setup.md) — automated scheduled exports using cron (Linux/macOS) +- [**Recurring Exports**](.docs/Recurring-Scrape-Setup.md) — automated scheduled exports using cron (Linux/macOS). If you only have the GUI zip (`DiscordChatExporter.linux-x64`), use `scripts/scrape-here.sh` from the source repository (build with `docker compose build`, then `./scripts/scrape-here.sh scrape`). - [**Documented solutions**](docs/solutions/) — searchable learnings (append-only scrape, Docker/cron workflow); YAML frontmatter: `module`, `tags`, `problem_type` - [**Chat Analytics**](https://github.com/mlomb/chat-analytics) — solution for analyzing chat patterns of Discord users, using exports produced by **DiscordChatExporter**. - [**DiscordChatExporter-frontend**](https://github.com/slatinsky/DiscordChatExporter-frontend) — convenient viewer for exports produced by **DiscordChatExporter**. diff --git a/docs/plans/2026-05-29-013-bridge-workspace-operator-plan.md b/docs/plans/2026-05-29-013-bridge-workspace-operator-plan.md new file mode 100644 index 00000000..2800f73e --- /dev/null +++ b/docs/plans/2026-05-29-013-bridge-workspace-operator-plan.md @@ -0,0 +1,37 @@ +--- +title: feat: Bridge GUI workspace to recurring scrape automation +type: feat +status: completed +date: 2026-05-29 +origin: LFG — Cursor workspace is DiscordChatExporter.linux-x64; automation lives in source repo +--- + +# feat: Bridge GUI workspace to recurring scrape automation + +## Summary + +Operators who open the prebuilt `DiscordChatExporter.linux-x64` folder need a clear path to Docker/cron/append scrape tooling in the sibling source repository without hunting paths. + +## Requirements + +| ID | Requirement | +|----|-------------| +| R1 | Source repo documents linux-x64 → source repo handoff | +| R2 | `scripts/scrape-here.sh` dispatches to host runner from any cwd inside repo | +| R3 | `RECURRING-SCRAPE.md` in linux-x64 workspace points to source repo commands | +| R4 | All `scripts/tests/*.sh` pass | + +## Implementation Units + +### U1. Repo launcher script + +**Files:** `scripts/scrape-here.sh`, `Readme.md` + +### U2. GUI workspace pointer doc + +**Files:** `../DiscordChatExporter.linux-x64/RECURRING-SCRAPE.md` (outside git; operator artifact) + +## Verification + +- Run all `scripts/tests/*.sh` +- `scripts/scrape-here.sh help` exits 0 diff --git a/scripts/scrape-here.sh b/scripts/scrape-here.sh new file mode 100755 index 00000000..f162a09b --- /dev/null +++ b/scripts/scrape-here.sh @@ -0,0 +1,6 @@ +#!/usr/bin/env bash +# Run recurring append-only scrape tooling from the source repository root. +set -Eeuo pipefail + +REPO_ROOT=$(cd "$(dirname "${BASH_SOURCE[0]}")/.." && pwd -P) +exec "$REPO_ROOT/scripts/run-discord-scrape-host.sh" "$@"