Commit graph

322 commits

Author SHA1 Message Date
ed c930d8f773 add mtp debug mode 2022-09-03 19:58:10 +02:00
ed d48a7d2398 provide tagparsers with uploader info 2022-08-15 20:23:17 +02:00
ed 7a460de3c2 windows db fix 2022-08-15 18:01:28 +02:00
ed 1c69ccc6cd v1.3.12 2022-08-13 00:58:49 +02:00
ed 9ccd327298 add directory hashing (boots ~3x faster) 2022-08-12 23:17:18 +02:00
ed 11df36f3cf add option to exit after scanning volumes 2022-08-12 21:20:13 +02:00
ed ad18b6e15e stop reindexing empty files on startup 2022-08-12 16:31:36 +02:00
ed 92ed4ba3f8 parallelize python hashing too 2022-08-10 23:12:01 +02:00
ed 4aaa111925 v1.3.9 2022-08-04 00:39:37 +02:00
ed e31248f018 include version info on startup and in crash dumps 2022-08-04 00:11:52 +02:00
ed 4e7455268a tag-scanner perf 2022-08-03 22:33:20 +02:00
ed 680f8ae814 add xdev/xvol indexing guards 2022-08-03 22:20:28 +02:00
ed 90555a4cea clean-shutdown while hashing huge files 2022-08-03 21:06:10 +02:00
ed 5384c2e0f5 reentrant cleanup 2022-08-02 20:56:05 +02:00
ed 0ee574a718 forget uploads that failed to initialize 2022-08-02 06:15:18 +02:00
ed dac2fad48e v1.3.8 2022-07-27 16:07:26 +02:00
ed 77f624b01e improve shumantime + use it everywhere 2022-07-27 15:07:04 +02:00
ed e24ffebfc8 indicate write-activity on splashpage 2022-07-27 14:53:15 +02:00
ed 660705a436 defer volume reindexing on db activity 2022-07-27 11:48:47 +02:00
ed 76adac7c72 up2k-hook-ytid: add mp4/webm/mkv metadata scanner 2022-07-26 22:09:18 +02:00
ed 5dc75ebb67 async e2ts / e2v + forget deleted shadowed 2022-07-26 12:47:40 +02:00
ed d686ce12b6 lsof db on stuck transaction 2022-07-25 02:07:59 +02:00
ed 10430b347f fix dumb prisonparty bug 2022-07-22 20:49:35 +02:00
ed 4a76663fb2 ensure free disk space 2022-07-17 22:33:08 +02:00
ed 3fa377a580 sqlite diag 2022-07-16 20:43:26 +02:00
ed c2a0b1b4c6 autopotato 2022-07-15 02:39:32 +02:00
ed 48b957f1d5 add -e2v (file integrity checker) 2022-07-13 00:48:39 +02:00
ed 3683984c8d abort volume indexing on ^C 2022-07-12 21:46:07 +02:00
ed 6f75b02723 misc 2022-07-12 03:16:30 +02:00
ed d1a03c6d17 zerobyte semantics 2022-07-11 23:17:33 +02:00
ed c6c31702c2 cheaper file deletion 2022-07-11 01:50:18 +02:00
ed c5b04f6fef mtp daisychaining 2022-07-08 22:29:05 +02:00
ed 4792c2770d fix a spin 2022-07-03 02:39:15 +02:00
ed 1c0071d9ce perf 2022-07-03 01:40:30 +02:00
ed 5d3034c231 detect sparse support from st_blocks 2022-06-23 18:23:42 +02:00
ed fe67c52ead configurable list of sparse-supporting filesystems +
close nonsparse files after each write to force flush
2022-06-19 22:38:52 +02:00
ed 190e11f7ea update deps + misc 2022-06-16 21:43:40 +02:00
ed 62fbb04c9d allow moving files between filesystems 2022-06-16 18:46:50 +02:00
ed 728dc62d0b optimize nonsparse uploads (fat32, exfat, hpfs) 2022-06-16 17:51:42 +02:00
ed 438384425a add types, isort, errorhandling 2022-06-16 01:07:15 +02:00
ed 4e5a323c62 more cleanup 2022-06-08 01:05:35 +02:00
ed 4c4b3790c7 fix read-spin on d/c during json post + errorhandling 2022-06-07 19:02:52 +02:00
ed bd60b464bb fix misleading log-msg 2022-06-07 14:12:55 +02:00
ed 0143380306 help the query planner 2022-05-13 01:41:39 +02:00
ed 1d9f9f221a louder 2022-05-12 20:55:37 +02:00
ed 2075a8b18c skip nonregular files when indexing filesystem 2022-05-09 19:56:17 +00:00
ed 4878eb2c45 support symlinks as volume root 2022-04-30 20:26:26 +02:00
ed 0d9567575a avoid hashing busy uploads during rescan 2022-04-29 23:16:23 +02:00
ed e82f176289 fix deadlock on rescan during upload 2022-04-29 23:14:51 +02:00
ed 2933dce3ef mtime blank uploads + helptext 2022-04-24 22:58:11 +02:00
ed f35e41baf1 allow unposting with write-only access 2022-04-16 23:35:04 +02:00
ed 36c20bbe53 fix setting mtime on windows 2022-04-15 20:08:55 +02:00
ed cba9e5b669 add hardlinks (symlink alternative) for up2k dedup 2022-04-15 19:13:53 +02:00
ed 951fdb27ca dont scan orphaned volumes 2022-04-14 17:11:51 +02:00
ed f0988c0e32 filter some volflags from up2k dump 2022-04-08 21:56:24 +02:00
ed c10c70c1e5 misc 2022-03-04 21:30:31 +01:00
ed 1044aa071b deal with consecutive dupes even without sqlite 2021-12-06 23:51:44 +01:00
ed 241ef5b99d preserve mtimes when juggling symlinks 2021-12-04 01:58:04 +01:00
ed c9b1c48c72 sizelimit registry + persist without e2d 2021-11-16 21:31:24 +01:00
ed 12b3a62586 fix dumb mistakes 2021-11-15 20:13:16 +01:00
ed b206c5d64e handle multiple simultaneous uploads of the same file 2021-11-14 15:03:11 +01:00
ed 807f272895 missed one 2021-11-06 18:33:32 +01:00
ed f050647b43 rescan volumes on sigusr1 2021-11-06 18:20:31 +01:00
ed f5f9e3ac97 reduce rescan/lifetime wakeups 2021-10-27 22:23:03 +02:00
ed 744727087a better rmtree semantics 2021-10-27 09:40:20 +02:00
ed 6dade82d2c run tag scrapers in parallel on new uploads 2021-10-27 00:47:50 +02:00
ed 6b737bf1d7 abort tagging if the file has poofed 2021-10-27 00:11:58 +02:00
ed e4ca4260bb support mounting entire disks on windows 2021-10-20 00:51:00 +02:00
ed 4f97d7cf8d normalize collision suffix 2021-10-19 00:49:35 +02:00
ed 088899d59f fix unpost in jumpvols 2021-10-18 21:08:31 +02:00
ed 2f021a0c2b skip indexing files by regex 2021-10-12 01:40:19 +02:00
ed d1be37a04a nice 2021-10-09 01:33:27 +02:00
ed b0fd8bf7d4 optimize indexer for huge filesystems 2021-10-09 01:24:19 +02:00
ed a6935b0293 allow uploading empty files 2021-10-02 23:34:12 +02:00
ed 5886a42901 url escaping 2021-09-26 16:59:02 +02:00
ed f10d03c238 add --no-symlink 2021-09-26 13:49:29 +02:00
ed f9a66ffb0e up2k: fully parallelize handshakes/uploads 2021-09-26 12:57:16 +02:00
ed 0bb9154747 catch more tagparser panics 2021-09-26 03:56:30 +02:00
ed 30c3f45072 fix deleting recently uploaded files without e2d 2021-09-26 03:45:16 +02:00
ed 0d5ca67f32 up2k-srv: add option to reuse file-handles 2021-09-26 03:44:22 +02:00
ed 076d32dee5 up2k-srv: try all dupes for matching path 2021-09-24 19:21:19 +02:00
ed 32a1c7c5d5 cosmetic 2021-09-18 02:07:29 +02:00
ed 0e884df486 keep empty folders after deleting all files 2021-09-15 23:31:49 +02:00
ed 02e3d44998 fix move/delete without -e2d (thx exci) 2021-09-07 21:20:34 +02:00
ed 21662c9f3f error-message cleanup 2021-09-07 20:51:07 +02:00
ed ca16c4108d add options to disallow renaming/moving dotfiles 2021-09-06 00:17:35 +02:00
ed 4802f8cf07 better msg when unposting a deleted file 2021-08-24 00:24:50 +02:00
ed 5f42237f2c v0.13.5 2021-08-16 08:40:26 +02:00
ed c1d77e1041 add upload lifetimes 2021-08-09 22:17:41 +02:00
ed 8d755d41e0 per-volume rescan interval 2021-08-09 01:31:20 +02:00
ed ee86b06676 compat + perf + ux 2021-08-08 04:02:58 +02:00
ed 9a45549b66 adding upload rules 2021-08-07 03:45:50 +02:00
ed ae3a01038b v0.12.12 2021-08-06 11:10:04 +02:00
ed 451d757996 fix renaming single symlinks 2021-08-03 20:12:51 +02:00
ed a918cc67eb only drop tags when its safe 2021-07-31 13:19:02 +02:00
ed c164fc58a2 add unpost 2021-07-29 23:53:08 +02:00
ed 0c625a4e62 store upload ip and time 2021-07-29 00:30:10 +02:00
ed 129d33f1a0 mv/del: recursive rmdir 2021-07-27 19:15:58 +02:00
ed 1ad7a3f378 await and monitor workers on startup 2021-07-27 15:48:00 +00:00
ed 7671d791fa rename works + more symlink fixes 2021-07-26 17:44:20 +02:00
ed 980c6fc810 add scheduled rescans + fix mv bugs 2021-07-26 02:34:56 +02:00
ed fb40a484c5 mv(folder) works 2021-07-26 01:26:58 +02:00
ed daa9dedcaa rm works 2021-07-26 00:29:28 +02:00
ed e648252479 mv works (at least in trivial cases) 2021-07-25 21:15:43 +02:00
ed 27cce086c6 fileman ui 2021-07-25 01:09:14 +02:00
ed 05a1a31cab too soon 2021-07-24 22:20:02 +02:00
ed d020527c6f centralize mojibake support stuff 2021-07-24 21:56:55 +02:00
ed 4451485664 mv/rm (serverside), 100% untested 2021-07-24 20:08:31 +02:00
ed a4e1a3738a more deletion progress 2021-07-23 23:42:07 +02:00
ed e3684e25f8 treat symlinks as regular files in db 2021-07-22 19:34:40 +02:00
ed 1359213196 prefer native sqlite3 backup (journal-aware) 2021-07-22 19:10:42 +02:00
ed 8eb8043a3d fix 3rdparty namecase 2021-07-18 22:50:29 +02:00
ed ebc9de02b0 case-insensitive tag search 2021-07-18 21:34:36 +02:00
ed 3ca41be2b4 do up2k snapshot on shutdown 2021-07-17 14:48:35 +02:00
ed bac301ed66 get rid of iffy default-args 2021-07-12 00:15:13 +02:00
ed 8fcde2a579 move tcp accept into mp-worker 2021-07-09 15:49:36 +02:00
ed 21c3570786 detect more recursive symlinks 2021-07-05 23:50:03 +02:00
ed 2f85c1fb18 add logging to file 2021-07-05 23:30:33 +02:00
ed 51546c9e64 add missing -nw check 2021-07-04 16:10:20 +02:00
ed 87200d9f10 make -nw apply to more stuff 2021-06-30 19:23:45 +02:00
ed f1a1c2ea45 recover from opening a corrupt database 2021-06-22 17:19:56 +02:00
ed 6249bd4163 add pebkac hints 2021-06-22 17:18:34 +02:00
ed 15a3ee252e support backslash in filenames 2021-06-20 15:50:06 +02:00
ed be055961ae adjust up2k hashlen to match base64 window 2021-06-20 15:32:36 +02:00
ed 10362aa02e v0.11.18 2021-06-18 00:30:37 +02:00
ed 241a143366 add --rproxy for explicit proxy level 2021-06-13 22:22:31 +02:00
ed d53c212516 add mtp queue to status page 2021-06-12 02:23:48 +02:00
ed 88ce008e16 more status on admin panel 2021-06-12 01:39:14 +02:00
ed 60ac68d000 single authsrv instance per process 2021-06-11 23:01:13 +02:00
ed fbe656957d fix race 2021-06-11 18:12:06 +02:00
ed 1078d933b4 adding --no-hash 2021-06-10 18:08:30 +02:00
ed d6bf300d80 option to store state out-of-volume (mostly untested) 2021-06-10 01:27:04 +02:00
ed 5ded5a4516 alphabetical up2k indexing 2021-06-08 21:42:08 +02:00
ed 9d729d3d1a add thread names 2021-06-08 20:14:23 +02:00
ed 4dd5d4e1b7 when rootless, blank instead of block rootdir 2021-06-08 18:35:55 +02:00
ed c533da9129 fix single-threaded mtag 2021-06-04 19:00:24 +02:00
ed ea4441e25c v0.11.2 2021-06-01 02:47:37 +02:00
ed e5f34042f9 more precise volume state in admin panel 2021-06-01 02:32:53 +02:00
ed d102bb3199 fix on-upload hasher (0.11.1 regression) 2021-06-01 01:20:34 +02:00
ed 0be7c5e2d8 live db/tags rescan 2021-05-29 23:35:07 +02:00
ed 3948214050 drop deleted files from snap 2021-05-29 09:03:18 +02:00
ed d25881d5c3 mojibake fixes 2021-05-29 09:01:59 +02:00
ed 118ebf668d fix bugs 2021-05-29 05:43:09 +02:00
ed a86f09fa46 mtp: file extension filtering 2021-05-29 04:18:57 +02:00
ed deea66ad0b support multiple tags from mtp helpers 2021-05-29 03:43:14 +02:00
ed 69dc433e1c ffprobe parser less bad 2021-05-27 01:41:12 +02:00
ed 483dd527c6 add cache eviction 2021-05-25 19:46:35 +02:00
ed 4dff726310 initial thumbnail and icon stuff 2021-05-25 03:37:01 +02:00
ed 405ae1308e v0.10.21 2021-05-16 20:22:33 +02:00
ed 0fcfe79994 general-purpose file parsing 2021-05-16 07:04:18 +02:00