Archive/DiscordChatExporter
1
0
Fork 0
mirror of https://github.com/Tyrrrz/DiscordChatExporter.git synced 2026-06-09 15:52:37 -06:00
Code Issues Actions Packages Projects Releases Wiki Activity
DiscordChatExporter/docs/plans/2026-06-04-067-feat-per-target-container-memory-plan.md
Copilot 8ca55f299b feat(scrape): per-target container_memory in scrape config 
Single --target runs apply optional container_memory from
scrape-targets.json when global DCE_CONTAINER_MEMORY is unset.
KotOR_discord_msgs defaults to 8g; scrape.env still overrides.
2026-06-03 09:55:33 -05:00

2.1 KiB
Raw Blame History

title type status date origin
feat: Per-target container_memory in scrape-targets.json feat complete 2026-06-04 /lfg — plan 063 deferred per-target memory; KotOR yes_general catch-up should auto-apply 8g when scraping KotOR_discord_msgs alone without global scrape.env change

feat: Per-target container_memory in scrape-targets.json

Summary

Optional container_memory on each target in scrape-targets.json. When run-discord-scrape-host.sh runs with exactly one --target, apply that target's memory cap to compose unless DCE_CONTAINER_MEMORY is already set non-zero in the environment or scrape.env.

Problem

Operators must set global DCE_CONTAINER_MEMORY=8g in scrape.env for KotOR yes_general catch-up, affecting every scrape including lightweight targets. A per-target knob keeps default runs unlimited while auto-raising memory for KotOR-only runs.

Requirements

ID Requirement
R1 Targets may include optional container_memory (e.g. 8g)
R2 Host runner applies it when exactly one --target is selected and global DCE_CONTAINER_MEMORY is unset or 0
R3 Explicit DCE_CONTAINER_MEMORY in shell or scrape.env wins over config
R4 Run plan banner shows per-target memory when applied
R5 KotOR_discord_msgs configured with container_memory: "8g"
R6 Host smoke asserts config-driven memory when env omits global cap
R7 DCE_MIN_FREE_MB=0 ./scripts/run-all-smokes.sh → 21/21

Implementation Units

U1. Config field + host apply

Files: scripts/lib/scrape-run-plan.sh, scripts/run-discord-scrape-host.sh, config/scrape-targets.json

U2. Smoke + docs

Files: scripts/tests/run-discord-scrape-host-smoke.sh, docs/recurring-scrape-merge-readiness.md, docs/recurring-scrape-operator-checklist.md

Verification

./scripts/tests/run-discord-scrape-host-smoke.sh
DCE_MIN_FREE_MB=0 ./scripts/run-all-smokes.sh

Scope Boundaries

Deferred

  • Live KotOR catch-up execution inside LFG
  • Numeric max across multiple --target flags
  • Structured JSON run logs