1528 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
Boden	1e35761dbb	test(scrape): lock mixed-length snowflake cursor selection ... Add cursor-mixed-length smoke where string max_by would pick the wrong --after value; padded sort_by in last_message_id already picks the max.	2026-05-29 16:33:00 -05:00
Boden	396832b047	docs(scrape): LFG closure for operator proof path ... Document run-operator-proof in setup and GUI bridge; record plan 033.	2026-05-29 16:28:11 -05:00
Boden	65c9fb2206	feat(scrape): operator proof script and podman-compose smoke fix ... Add run-operator-proof for one-target handoff/scrape/prove flows. Prefer podman-compose on Podman hosts but honor DCE_DOCKER_BIN overrides so offline smokes keep using fake compose shims.	2026-05-29 16:20:25 -05:00
Boden	3fd42d924e	feat(scrape): sync GUI bridge doc into linux-x64 folder ... Add sync-gui-bridge-doc.sh to copy the versioned bridge markdown beside the GUI zip; includes offline smoke test (18 total via run-all-smokes).	2026-05-29 16:10:17 -05:00
Boden	9c22a3efee	docs(scrape): track GUI zip bridge doc in source repo ... Add docs/gui-zip-recurring-scrape-bridge.md and cross-links so GUI-only users have a versioned quick-start beside the linux-x64 zip folder.	2026-05-29 16:08:36 -05:00
Boden	c4371c9f7d	docs(scrape): LFG closure — operator handoff in setup guides ... Point README and Recurring-Scrape-Setup at operator-handoff.sh, document disk preflight, and harden operator-handoff smoke against pipefail flakes.	2026-05-29 16:05:42 -05:00
Boden	c0818715a8	feat(scrape): add operator-handoff verification script ... Single entrypoint runs disk summary, verify-operator-ready, and run-documents-scrape --dry-run before cron or full scrapes.	2026-05-29 16:03:22 -05:00
Boden	44eadee634	feat(scrape): disk preflight on host runner for cron jobs ... run-discord-scrape-host.sh runs verify --disk-only before preflight/scrape so setup-cron monthly jobs fail fast when archive roots are low on space. Harden bootstrap smoke to surface failures when dry-run fails.	2026-05-29 16:00:11 -05:00
Boden	32b7f47d45	feat(scrape): disk-only verify flag and documents scrape preflight ... run-documents-scrape.sh checks archive free space before live Discord calls; verify-operator-ready.sh adds --disk-only for lightweight checks.	2026-05-29 15:54:08 -05:00
Boden	1142e376b5	fix(scrape): disk preflight before compose and skippable disk errors ... Fail fast when archive or repo paths lack free space (DCE_MIN_FREE_MB), treat disk-full export failures as skippable channels, and add an offline disk-space smoke. Smokes default DCE_MIN_FREE_MB=0 so CI stays portable.	2026-05-29 15:27:39 -05:00
Boden	a4fd78275d	fix(scrape): avoid stdin drain in per-target validation loop ... Docker compose was consuming the while-read target list after the first server. Load enabled target names with mapfile before any scrape runs.	2026-05-29 14:23:30 -05:00
Boden	76b4231d7a	feat(scrape): per-target validation with continue-on-error ... Run scrape and audit per enabled server independently; log summary counts. Full host validation started via --per-target --continue-on-error.	2026-05-29 14:20:37 -05:00
Boden	1742a9d41e	feat(scrape): add run-operator-validation orchestrator ... Sync GUI token, verify readiness, run documents scrape, and audit JSON with timestamped logs. Live eod_discord validation passed on host.	2026-05-29 14:19:04 -05:00
Boden	00bcbc5b21	feat(scrape): add verify-operator-ready host checks ... One command validates compose, auth, config, and seeded archives before bootstrap or cron. Includes offline smoke test (14 smokes total).	2026-05-29 14:16:10 -05:00
Boden	927d5e9607	docs(scrape): add merge readiness index and doc cross-links ... Single reviewer/operator page for the recurring scrape feature with validation commands; link from root and .docs indexes.	2026-05-29 14:14:44 -05:00
Boden	89091d76ef	feat(scrape): add run-all-smokes.sh and align CI docs ... Single entrypoint for offline smokes; CI uses it instead of listing each script. Update setup guide and operator checklist with full smoke table.	2026-05-29 14:13:31 -05:00
Boden	10cd2a534d	feat(scrape): offline prove smoke and snapshot-only mode ... Add --snapshot-only and --compare-snapshots to prove-incremental-append, fix EXIT trap status, wire prove smoke into CI, and document LFG closure plan.	2026-05-29 14:12:18 -05:00
Boden	a2aeaaab9c	fix(scrape): audit and salvage corrupt archive JSON ... Add audit-archive-json and salvage-truncated-export helpers, skip invalid JSON during prove snapshots, and wire an audit smoke test into CI.	2026-05-29 14:09:46 -05:00
Boden	a0db7aec52	feat(scrape): sync token from GUI Settings.dat for live exports ... Add sync-token-from-gui.sh; bootstrap points to it when channels are forbidden. Verified live incremental scrape on eod_discord with GUI token.	2026-05-29 14:05:45 -05:00
Boden	8c7ae90f3f	feat(scrape): warn on bot-token preflight and document cron install ... Bootstrap surfaces forbidden-channel guidance; operator checklist documents the installed monthly cron job.	2026-05-29 14:03:01 -05:00
Boden	058aaa0960	feat(scrape): add bootstrap CI smoke and operator checklist ... Document bootstrap-first workflow; verify dry-run in CI; live bootstrap preflight validated against Documents archives.	2026-05-29 14:02:06 -05:00
Boden	2b39a721a9	feat(scrape): add bootstrap-recurring-scrape one-shot operator flow ... Verify archives, build compose image, and preflight in one script. Forward scrape-here --help; add scrape-here-smoke to CI.	2026-05-29 13:59:04 -05:00
Boden	ff6960ae95	feat(scrape): add scrape-here launcher and GUI zip handoff docs ... Operators with only the GUI download are directed to the source repo for Docker/cron append-only exports via scripts/scrape-here.sh.	2026-05-29 13:58:12 -05:00
Boden	85a733464f	docs(review): mark residual findings R1-R3 resolved	2026-05-29 13:56:36 -05:00
Boden	25e1a7e600	fix(scrape): address residual review findings R1–R3 ... Use padded sort for last_message_id cursor, surface guild channel discovery errors, and document DCE_ARCHIVE_ROOT in compose.	2026-05-29 13:56:29 -05:00
Boden	c713ee5e64	docs(review): record residual review findings	2026-05-29 13:54:46 -05:00
Boden	ef9aa90bb0	fix(review): apply autofix feedback ... Correct merge dateRange.before preference, preflight log accuracy, and remove dead failed_channels path in scrape_target.	2026-05-29 13:54:36 -05:00
Boden	90bd9da143	feat(scrape): harden preflight and cron config for Documents archives ... Preflight probes skip forbidden channels when seeded archives exist. Cron installer passes container config path and supports --config override. Compose and docs align with append-only ~/Documents scrape workflow.	2026-05-29 13:49:09 -05:00
Boden	d415f9246b	docs: fix relative links in Recurring-Scrape-Setup Next Steps ... Links from .docs/ should not prefix .docs/ again. Co-authored-by: Cursor <cursoragent@cursor.com>	2026-05-29 00:29:49 -05:00
Boden	32d7e92ac8	chore(ci): run Documents workflow smokes in recurring-scrape job ... Wire documents-scrape and verify-documents-auth smoke tests into CI and document which scripts run locally versus in GitHub Actions. Co-authored-by: Cursor <cursoragent@cursor.com>	2026-05-29 00:21:10 -05:00
Boden	57d472f8e8	fix(scrape): auth discovery, skip forbidden channels, mount host script ... Discover Discord tokens from env, token files, GUI Settings.dat, and desktop leveldb; bind-mount the host scrape script so container preflight uses partition/--after cursors; skip inaccessible channels without aborting targets; fix set -e and busybox mktemp for incremental exports under ~/Documents. Co-authored-by: Cursor <cursoragent@cursor.com>	2026-05-28 14:57:16 -05:00
Boden	88e864c72a	feat(scrape): add Documents scrape workflow and token discovery ... Auto-discover token files, provide run-documents-scrape and prove-incremental-append helpers, and document the end-to-end operator flow. Co-authored-by: Cursor <cursoragent@cursor.com>	2026-05-28 02:23:34 -05:00
Boden	9e55378c84	feat(scrape): add Documents verify and auth bootstrap helpers ... Add scripts to confirm enabled targets map to seeded ~/Documents archives and to create scrape.env from exported DISCORD_TOKEN credentials. Co-authored-by: Cursor <cursoragent@cursor.com>	2026-05-28 01:18:05 -05:00
Boden	8c14dbbf45	fix(scrape): append safely under Documents with flexible auth ... Bootstrap channel-map entries from existing archive filenames, reject merges that would shrink large JSON exports, accept exported DISCORD_TOKEN when scrape.env is missing, and disable the duplicate OpenKotOR target folder. Co-authored-by: Cursor <cursoragent@cursor.com>	2026-05-28 00:58:03 -05:00
Boden	7cab7280c4	feat: add gh PR run approval helper for fork CI unblock ... Adds scripts/gh-approve-pr-runs.sh with GITHUB_TOKEN bootstrap, explicit admin-rights policy classification, smoke coverage, and CI wiring. Marks the remaining 2026-05-24 recurring scrape plans completed. Co-authored-by: Cursor <cursoragent@cursor.com>	2026-05-28 00:30:49 -05:00
Boden	df499568d9	fix: harden recurring scrape scripts from review residuals ... Use max message ID for incremental exports, validate custom cron expressions, drop eval from host/preflight paths, restrict reauth to executable repo scripts, and run smoke tests in CI. Co-authored-by: Cursor <cursoragent@cursor.com>	2026-05-28 00:08:22 -05:00
Boden	ebc153868f	fix(review): apply autofix feedback ... Strengthen recurring-scrape smoke tests to exercise real setup-cron lifecycle, duplicate-config validation, guild resolution failures, and preflight failure crontab safety. Mark validation plan completed. Co-authored-by: Cursor <cursoragent@cursor.com>	2026-05-27 14:24:09 -05:00
Boden	a445b60481	fix(review): apply autofix feedback	2026-05-27 13:20:09 -05:00
Boden	d66b9dab63	feat(validation): comprehensive recurring scraper validation suite and documentation ... IMPLEMENTATION UNITS (U1-U6): U1: Append-only merge test coverage - Enhanced run-discord-scrape-smoke.sh with additional test scenarios - Created append-partial-write.json and append-concurrent-conflict.json fixtures - Added assertions for message sorting, deduplication, and idempotency - All 10 merge scenarios validated U2: Error handling validation - Created error-path-smoke.sh with 6 error scenario tests - Added test configs for invalid paths, missing files, bad JSON - Verified fail-closed behavior on all error paths - No silent data loss on any failure U3: Cron idempotency and lifecycle - Created cron-idempotency-smoke.sh with full lifecycle testing - Created fixture crontab with unrelated entries (preservation test) - Verified idempotent install, update, and remove operations - Confirmed dry-run and entry preservation U4: Preflight and end-to-end setup - Created end-to-end-preflight-smoke.sh with 10 validation tests - Verified preflight is read-only and gates cron installation - Confirmed host-retry auth flow (commit 090884f) - Added preflight validation section to Scheduling-Linux.md U5: Documentation completion - Updated Readme.md with recurring-scraper link - Created Recurring-Scrape-Setup.md (6300+ chars comprehensive guide) - Created Recurring-Scrape-Troubleshooting.md (9200+ chars with 30+ scenarios) - Enhanced .docs/Scheduling-Linux.md with preflight section - All documented behavior matches implementation U6: Production-readiness checklist - Created docs/recurring-scrape-production-checklist.md - Compiled all validation results (33+ scenarios across U1-U5) - Documented test execution commands for re-validation - Provided deployment notes and monitoring guidance - Clear sign-off criteria established ARTIFACTS: - 4 new smoke test scripts (1000+ lines total) - 4 new fixtures and test configs - 3 new documentation files (15500+ chars) - 2 updated documentation files - 1 validation checklist tracking document - All tests passing SAFETY GUARANTEES VERIFIED: ✅ No silent data loss on any error path ✅ Fail-closed behavior throughout ✅ Archive updates are append-only and idempotent ✅ Cron installation is idempotent ✅ Unrelated cron entries preserved ✅ Preflight is read-only ✅ Token validated before operations ✅ Path traversal prevented STATUS: Production Ready All 6 implementation units complete and validated. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>	2026-05-27 12:57:32 -05:00
Your Name	0c92823061	fix(review): apply autofix feedback ... Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>	2026-05-24 22:19:57 -05:00
Your Name	090884fed6	fix(auth): add host retry flow for discord scrape ... Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>	2026-05-24 21:07:55 -05:00
Your Name	d63cc1ef2f	fix(review): apply autofix feedback ... Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>	2026-05-24 21:07:20 -05:00
Your Name	07151924cf	fix(review): apply autofix feedback ... Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>	2026-05-24 20:30:37 -05:00
Your Name	96873b5e7d	docs(strategy): add recurring scrape strategy ... Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>	2026-05-24 17:59:02 -05:00
Your Name	43f5fa3b71	Add recurring CLI scrape automation ... Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>	2026-05-24 17:04:07 -05:00
Your Name	48b52041a5	fix(review): apply autofix feedback ... Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>	2026-05-24 17:02:28 -05:00
tyrrrz	6258394fc0	Remove lang version from build props	2026-05-03 16:01:32 +03:00
tyrrrz	e6472543e0	Refactor fetching Avalonia TopLevel	2026-05-02 11:30:14 +03:00
dependabot[bot]	ee163d6de7	Bump actions/upload-artifact from 7.0.0 to 7.0.1 in the actions group (#1528) ... Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>	2026-05-01 16:31:01 +03:00
tyrrrz	5838c0546e	Update for Avalonia 12	2026-05-01 16:30:11 +03:00