feat(scrape): add scrape-here launcher and GUI zip handoff docs

Operators with only the GUI download are directed to the source repo
for Docker/cron append-only exports via scripts/scrape-here.sh.
This commit is contained in:
Boden 2026-05-29 13:58:12 -05:00
parent 85a733464f
commit ff6960ae95
3 changed files with 44 additions and 1 deletions

View file

@ -81,7 +81,7 @@ To learn more about the war and how you can help, [click here](https://tyrrrz.me
## See also ## See also
- [**Recurring Exports**](.docs/Recurring-Scrape-Setup.md) — automated scheduled exports using cron (Linux/macOS) - [**Recurring Exports**](.docs/Recurring-Scrape-Setup.md) — automated scheduled exports using cron (Linux/macOS). If you only have the GUI zip (`DiscordChatExporter.linux-x64`), use `scripts/scrape-here.sh` from the source repository (build with `docker compose build`, then `./scripts/scrape-here.sh scrape`).
- [**Documented solutions**](docs/solutions/) — searchable learnings (append-only scrape, Docker/cron workflow); YAML frontmatter: `module`, `tags`, `problem_type` - [**Documented solutions**](docs/solutions/) — searchable learnings (append-only scrape, Docker/cron workflow); YAML frontmatter: `module`, `tags`, `problem_type`
- [**Chat Analytics**](https://github.com/mlomb/chat-analytics) — solution for analyzing chat patterns of Discord users, using exports produced by **DiscordChatExporter**. - [**Chat Analytics**](https://github.com/mlomb/chat-analytics) — solution for analyzing chat patterns of Discord users, using exports produced by **DiscordChatExporter**.
- [**DiscordChatExporter-frontend**](https://github.com/slatinsky/DiscordChatExporter-frontend) — convenient viewer for exports produced by **DiscordChatExporter**. - [**DiscordChatExporter-frontend**](https://github.com/slatinsky/DiscordChatExporter-frontend) — convenient viewer for exports produced by **DiscordChatExporter**.

View file

@ -0,0 +1,37 @@
---
title: feat: Bridge GUI workspace to recurring scrape automation
type: feat
status: completed
date: 2026-05-29
origin: LFG — Cursor workspace is DiscordChatExporter.linux-x64; automation lives in source repo
---
# feat: Bridge GUI workspace to recurring scrape automation
## Summary
Operators who open the prebuilt `DiscordChatExporter.linux-x64` folder need a clear path to Docker/cron/append scrape tooling in the sibling source repository without hunting paths.
## Requirements
| ID | Requirement |
|----|-------------|
| R1 | Source repo documents linux-x64 → source repo handoff |
| R2 | `scripts/scrape-here.sh` dispatches to host runner from any cwd inside repo |
| R3 | `RECURRING-SCRAPE.md` in linux-x64 workspace points to source repo commands |
| R4 | All `scripts/tests/*.sh` pass |
## Implementation Units
### U1. Repo launcher script
**Files:** `scripts/scrape-here.sh`, `Readme.md`
### U2. GUI workspace pointer doc
**Files:** `../DiscordChatExporter.linux-x64/RECURRING-SCRAPE.md` (outside git; operator artifact)
## Verification
- Run all `scripts/tests/*.sh`
- `scripts/scrape-here.sh help` exits 0

6
scripts/scrape-here.sh Executable file
View file

@ -0,0 +1,6 @@
#!/usr/bin/env bash
# Run recurring append-only scrape tooling from the source repository root.
set -Eeuo pipefail
REPO_ROOT=$(cd "$(dirname "${BASH_SOURCE[0]}")/.." && pwd -P)
exec "$REPO_ROOT/scripts/run-discord-scrape-host.sh" "$@"