Commit graph

79 commits

Author SHA1 Message Date
ed 4df033ecc3 [DB-V6]: store usernames; closes #530 2025-08-15 21:33:13 +00:00
ed e1b9ac631f separate histpath and dbpath options (#149)
the up2k databases are, by default, stored in a `.hist` subfolder
inside each volume, next to thumbnails and transcoded audio

add a new option for storing the databases in a separate location,
making it possible to tune the underlying filesystem for optimal
performance characteristics

the `--hist` global-option and `hist` volflag still behave like
before, but `--dbpath` and volflag `dbpath` will override the
histpath for the up2k-db and up2k-snap exclusivey
2025-03-30 16:08:28 +00:00
ed 3051b13108 try to avoid printing mojibake in logs
unprintable and side-effect-inducing paths and names are hex-escaped,
preserving greppability and making log-parsing slightly more okay
2024-12-18 01:45:54 +01:00
ed 697a4fa8a4 exclude search results by regex (#120)
a better alternative to using `--no-idx` for this purpose since
this also excludes recent uploads, not just during fs-indexing,
and it doesn't prevent deduplication

also speeds up searches by a tiny amount due to building the
sanchecks into the exclude-filter while parsing the config,
instead of during each search query
2024-11-26 23:57:01 +00:00
ed 2ab8924e2d tests/debug: plug some resource leaks 2024-11-22 22:21:43 +00:00
ed 7ffd805a03 add RSS feed output; closes #109 2024-10-18 23:24:12 +00:00
ed 58cf01c2ad fix linter warnings 2024-09-20 22:24:39 +00:00
ed 2927bbb2d6 strip dev-only asserts at build stage 2024-09-14 22:17:35 +00:00
ed 7c2beba555 add file/folder sharing; closes #84 2024-08-18 22:49:13 +00:00
ed 3d245431fc linter fixes 2024-08-05 18:48:16 +00:00
ed ebb1981803 py2: reduce ram usage 2024-08-01 20:01:42 +00:00
ed e8db3dd37f fix tests on windows 2024-04-25 22:25:38 +00:00
ed 95d9e693c6 d2d should disable search/unpost even if db exists 2024-04-22 18:55:13 +00:00
ed 0c50ea1757 list dotfiles only for specific volumes or users (#66):
* permission `.` grants dotfile visibility if user has `r` too
* `-ed` will grant dotfiles to all `r` accounts (same as before)
* volflag `dots` likewise

also drops compatibility for pre-0.12.0 `-v` syntax
(`-v .::red` will no longer translate to `-v .::r,ed`)
2023-12-16 15:38:48 +00:00
ed 46d667716e support python 3.15 2023-12-14 10:49:10 +00:00
ed a9730499c0 don't suggest loading more search results beyond server cap 2023-11-21 22:38:35 +00:00
ed 8526ef9368 srch-dbg: handle jumpvols correctly 2023-11-19 11:35:13 +00:00
ed ef33ce94cd filter shadowed files from search results (#61),
also adds optimization to stop opening cursors
when max results has already been hit
2023-11-19 11:04:36 +00:00
ed c7f826dbbe search by upload time 2023-10-19 23:57:27 +00:00
ed 0dc3c23b42 add alternative filekey generator; closes #52 2023-10-06 13:41:22 +00:00
ed e197895c10 support hashed passwords; closes #39 2023-06-25 21:50:33 +00:00
ed 6acf436573 u2idx pool instead of per-socket;
prevents running out of FDs thanks to thousands of sqlite3 sessions
and neatly sidesteps what could possibly be a race in python's
sqlite3 bindings where it sometimes forgets to close the fd
2023-04-20 20:36:13 +00:00
ed bba8a3c6bc fix truncated search results 2023-03-16 20:12:13 +00:00
ed 6a05850f21 also undupe search hits from overlapping volumes 2023-02-17 20:48:57 +00:00
ed e413007eb0 hide dotfiles from search results by default 2023-01-31 18:13:33 +00:00
ed 447ed5ab37 windows fixes 2022-12-12 21:59:50 +00:00
ed 7704b9c8a2 sqlite durability profiles 2022-12-10 10:01:33 +00:00
ed 999b7ae919 safer to merge wal on startup instead 2022-12-09 19:58:13 +00:00
ed 195eb53995 merge wal on shutdown 2022-12-07 23:09:40 +00:00
ed 9b0f519e4e switch to wal for ~2x faster uploads 2022-12-07 20:52:17 +00:00
ed edad3246e0 make pylance happier 2022-10-29 20:40:25 +00:00
ed 4bcd30da6b cleaner daemon instancing 2022-10-23 12:05:44 +02:00
ed 438384425a add types, isort, errorhandling 2022-06-16 01:07:15 +02:00
ed 4e5a323c62 more cleanup 2022-06-08 01:05:35 +02:00
ed 715401ca8e fix timezone in search, zipfiles, fuse 2022-05-15 13:51:44 +02:00
ed 0143380306 help the query planner 2022-05-13 01:41:39 +02:00
ed c73ff3ce1b avoid sqlite deadlock on windows 2022-04-28 22:46:53 +02:00
ed 2ab1325c90 add option to load more search results 2022-04-28 21:55:01 +02:00
ed 2c6bb195a4 search: get rid of inner-joins to fix -tags 2022-03-02 00:35:04 +01:00
ed f55e982cb5 configurable max-hits 2022-02-12 16:22:35 +01:00
ed 686c7defeb fix path-search in nontop volumes 2022-02-12 16:00:14 +01:00
ed a3efc4c726 encode quoted queries into raw 2021-11-22 21:53:23 +01:00
ed 0278bf328f support raw-queries with quotes 2021-11-22 20:59:07 +01:00
ed f050647b43 rescan volumes on sigusr1 2021-11-06 18:20:31 +01:00
ed b2ae14695a show multiple filesearch hits 2021-10-04 21:53:28 +02:00
ed 5886a42901 url escaping 2021-09-26 16:59:02 +02:00
ed 06bbf0d656 filekeys in search results 2021-09-18 17:26:13 +02:00
ed 8b58e951e3 metadata search with keys containing _- 2021-08-07 21:38:52 +02:00
ed 0c625a4e62 store upload ip and time 2021-07-29 00:30:10 +02:00
ed d020527c6f centralize mojibake support stuff 2021-07-24 21:56:55 +02:00