385 commits

Author	SHA1	Message	Date
ed	118bdcc26e	120x faster folder moves/renames	2022-10-08 19:11:03 +02:00
ed	78fa96f0f4	add unpost sanchk	2022-10-08 18:23:41 +02:00
ed	b8a93e74bf	fix default upload expiration + ux	2022-10-07 21:38:01 +02:00
ed	b299aaed93	fix some cases of deleted files not being forgotten	2022-09-26 22:19:46 +02:00
ed	4f4f106c48	add ability to forget uploads by deleting the files	2022-09-25 14:24:01 +02:00
ed	e70e926a40	support up2k uploads from old browsertabs	2022-09-24 14:35:51 +02:00
ed	0b87a4a810	allow setting lifetimes from up2k ui	2022-09-19 23:49:07 +02:00
ed	09cea66aa8	add ability to set lifetime per-file during upload	2022-09-18 13:12:38 +02:00
ed	5e9bc1127d	fix windows symlink creation	2022-09-17 13:27:54 +02:00
ed	0006f933a2	hmac uploader-ip when avoiding filename collisions	2022-09-11 08:27:45 +02:00
ed	590c763659	add unforgetti beam	2022-09-07 08:09:32 +02:00
ed	11d1267f8c	option to keep files in index when deleted	2022-09-07 01:07:21 +02:00
ed	995cd10df8	bump timeouts for zfs / bursty filesystems	2022-09-04 21:21:54 +02:00
ed	c930d8f773	add mtp debug mode	2022-09-03 19:58:10 +02:00
ed	d48a7d2398	provide tagparsers with uploader info	2022-08-15 20:23:17 +02:00
ed	7a460de3c2	windows db fix	2022-08-15 18:01:28 +02:00
ed	1c69ccc6cd	v1.3.12	2022-08-13 00:58:49 +02:00
ed	9ccd327298	add directory hashing (boots ~3x faster)	2022-08-12 23:17:18 +02:00
ed	11df36f3cf	add option to exit after scanning volumes	2022-08-12 21:20:13 +02:00
ed	ad18b6e15e	stop reindexing empty files on startup	2022-08-12 16:31:36 +02:00
ed	92ed4ba3f8	parallelize python hashing too	2022-08-10 23:12:01 +02:00
ed	4aaa111925	v1.3.9	2022-08-04 00:39:37 +02:00
ed	e31248f018	include version info on startup and in crash dumps	2022-08-04 00:11:52 +02:00
ed	4e7455268a	tag-scanner perf	2022-08-03 22:33:20 +02:00
ed	680f8ae814	add xdev/xvol indexing guards	2022-08-03 22:20:28 +02:00
ed	90555a4cea	clean-shutdown while hashing huge files	2022-08-03 21:06:10 +02:00
ed	5384c2e0f5	reentrant cleanup	2022-08-02 20:56:05 +02:00
ed	0ee574a718	forget uploads that failed to initialize	2022-08-02 06:15:18 +02:00
ed	dac2fad48e	v1.3.8	2022-07-27 16:07:26 +02:00
ed	77f624b01e	improve shumantime + use it everywhere	2022-07-27 15:07:04 +02:00
ed	e24ffebfc8	indicate write-activity on splashpage	2022-07-27 14:53:15 +02:00
ed	660705a436	defer volume reindexing on db activity	2022-07-27 11:48:47 +02:00
ed	76adac7c72	up2k-hook-ytid: add mp4/webm/mkv metadata scanner	2022-07-26 22:09:18 +02:00
ed	5dc75ebb67	async e2ts / e2v + forget deleted shadowed	2022-07-26 12:47:40 +02:00
ed	d686ce12b6	lsof db on stuck transaction	2022-07-25 02:07:59 +02:00
ed	10430b347f	fix dumb prisonparty bug	2022-07-22 20:49:35 +02:00
ed	4a76663fb2	ensure free disk space	2022-07-17 22:33:08 +02:00
ed	3fa377a580	sqlite diag	2022-07-16 20:43:26 +02:00
ed	c2a0b1b4c6	autopotato	2022-07-15 02:39:32 +02:00
ed	48b957f1d5	add -e2v (file integrity checker)	2022-07-13 00:48:39 +02:00
ed	3683984c8d	abort volume indexing on ^C	2022-07-12 21:46:07 +02:00
ed	6f75b02723	misc	2022-07-12 03:16:30 +02:00
ed	d1a03c6d17	zerobyte semantics	2022-07-11 23:17:33 +02:00
ed	c6c31702c2	cheaper file deletion	2022-07-11 01:50:18 +02:00
ed	c5b04f6fef	mtp daisychaining	2022-07-08 22:29:05 +02:00
ed	4792c2770d	fix a spin	2022-07-03 02:39:15 +02:00
ed	1c0071d9ce	perf	2022-07-03 01:40:30 +02:00
ed	5d3034c231	detect sparse support from st_blocks	2022-06-23 18:23:42 +02:00
ed	fe67c52ead	configurable list of sparse-supporting filesystems + ... close nonsparse files after each write to force flush	2022-06-19 22:38:52 +02:00
ed	190e11f7ea	update deps + misc	2022-06-16 21:43:40 +02:00
ed	62fbb04c9d	allow moving files between filesystems	2022-06-16 18:46:50 +02:00
ed	728dc62d0b	optimize nonsparse uploads (fat32, exfat, hpfs)	2022-06-16 17:51:42 +02:00
ed	438384425a	add types, isort, errorhandling	2022-06-16 01:07:15 +02:00
ed	4e5a323c62	more cleanup	2022-06-08 01:05:35 +02:00
ed	4c4b3790c7	fix read-spin on d/c during json post + errorhandling	2022-06-07 19:02:52 +02:00
ed	bd60b464bb	fix misleading log-msg	2022-06-07 14:12:55 +02:00
ed	0143380306	help the query planner	2022-05-13 01:41:39 +02:00
ed	1d9f9f221a	louder	2022-05-12 20:55:37 +02:00
ed	2075a8b18c	skip nonregular files when indexing filesystem	2022-05-09 19:56:17 +00:00
ed	4878eb2c45	support symlinks as volume root	2022-04-30 20:26:26 +02:00
ed	0d9567575a	avoid hashing busy uploads during rescan	2022-04-29 23:16:23 +02:00
ed	e82f176289	fix deadlock on rescan during upload	2022-04-29 23:14:51 +02:00
ed	2933dce3ef	mtime blank uploads + helptext	2022-04-24 22:58:11 +02:00
ed	f35e41baf1	allow unposting with write-only access	2022-04-16 23:35:04 +02:00
ed	36c20bbe53	fix setting mtime on windows	2022-04-15 20:08:55 +02:00
ed	cba9e5b669	add hardlinks (symlink alternative) for up2k dedup	2022-04-15 19:13:53 +02:00
ed	951fdb27ca	dont scan orphaned volumes	2022-04-14 17:11:51 +02:00
ed	f0988c0e32	filter some volflags from up2k dump	2022-04-08 21:56:24 +02:00
ed	c10c70c1e5	misc	2022-03-04 21:30:31 +01:00
ed	1044aa071b	deal with consecutive dupes even without sqlite	2021-12-06 23:51:44 +01:00
ed	241ef5b99d	preserve mtimes when juggling symlinks	2021-12-04 01:58:04 +01:00
ed	c9b1c48c72	sizelimit registry + persist without e2d	2021-11-16 21:31:24 +01:00
ed	12b3a62586	fix dumb mistakes	2021-11-15 20:13:16 +01:00
ed	b206c5d64e	handle multiple simultaneous uploads of the same file	2021-11-14 15:03:11 +01:00
ed	807f272895	missed one	2021-11-06 18:33:32 +01:00
ed	f050647b43	rescan volumes on sigusr1	2021-11-06 18:20:31 +01:00
ed	f5f9e3ac97	reduce rescan/lifetime wakeups	2021-10-27 22:23:03 +02:00
ed	744727087a	better rmtree semantics	2021-10-27 09:40:20 +02:00
ed	6dade82d2c	run tag scrapers in parallel on new uploads	2021-10-27 00:47:50 +02:00
ed	6b737bf1d7	abort tagging if the file has poofed	2021-10-27 00:11:58 +02:00
ed	e4ca4260bb	support mounting entire disks on windows	2021-10-20 00:51:00 +02:00
ed	4f97d7cf8d	normalize collision suffix	2021-10-19 00:49:35 +02:00
ed	088899d59f	fix unpost in jumpvols	2021-10-18 21:08:31 +02:00
ed	2f021a0c2b	skip indexing files by regex	2021-10-12 01:40:19 +02:00
ed	d1be37a04a	nice	2021-10-09 01:33:27 +02:00
ed	b0fd8bf7d4	optimize indexer for huge filesystems	2021-10-09 01:24:19 +02:00
ed	a6935b0293	allow uploading empty files	2021-10-02 23:34:12 +02:00
ed	5886a42901	url escaping	2021-09-26 16:59:02 +02:00
ed	f10d03c238	add --no-symlink	2021-09-26 13:49:29 +02:00
ed	f9a66ffb0e	up2k: fully parallelize handshakes/uploads	2021-09-26 12:57:16 +02:00
ed	0bb9154747	catch more tagparser panics	2021-09-26 03:56:30 +02:00
ed	30c3f45072	fix deleting recently uploaded files without e2d	2021-09-26 03:45:16 +02:00
ed	0d5ca67f32	up2k-srv: add option to reuse file-handles	2021-09-26 03:44:22 +02:00
ed	076d32dee5	up2k-srv: try all dupes for matching path	2021-09-24 19:21:19 +02:00
ed	32a1c7c5d5	cosmetic	2021-09-18 02:07:29 +02:00
ed	0e884df486	keep empty folders after deleting all files	2021-09-15 23:31:49 +02:00
ed	02e3d44998	fix move/delete without -e2d (thx exci)	2021-09-07 21:20:34 +02:00
ed	21662c9f3f	error-message cleanup	2021-09-07 20:51:07 +02:00
ed	ca16c4108d	add options to disallow renaming/moving dotfiles	2021-09-06 00:17:35 +02:00
ed	4802f8cf07	better msg when unposting a deleted file	2021-08-24 00:24:50 +02:00
ed	5f42237f2c	v0.13.5	2021-08-16 08:40:26 +02:00
ed	c1d77e1041	add upload lifetimes	2021-08-09 22:17:41 +02:00
ed	8d755d41e0	per-volume rescan interval	2021-08-09 01:31:20 +02:00
ed	ee86b06676	compat + perf + ux	2021-08-08 04:02:58 +02:00
ed	9a45549b66	adding upload rules	2021-08-07 03:45:50 +02:00
ed	ae3a01038b	v0.12.12	2021-08-06 11:10:04 +02:00
ed	451d757996	fix renaming single symlinks	2021-08-03 20:12:51 +02:00
ed	a918cc67eb	only drop tags when its safe	2021-07-31 13:19:02 +02:00
ed	c164fc58a2	add unpost	2021-07-29 23:53:08 +02:00
ed	0c625a4e62	store upload ip and time	2021-07-29 00:30:10 +02:00
ed	129d33f1a0	mv/del: recursive rmdir	2021-07-27 19:15:58 +02:00
ed	1ad7a3f378	await and monitor workers on startup	2021-07-27 15:48:00 +00:00
ed	7671d791fa	rename works + more symlink fixes	2021-07-26 17:44:20 +02:00
ed	980c6fc810	add scheduled rescans + fix mv bugs	2021-07-26 02:34:56 +02:00
ed	fb40a484c5	mv(folder) works	2021-07-26 01:26:58 +02:00
ed	daa9dedcaa	rm works	2021-07-26 00:29:28 +02:00
ed	e648252479	mv works (at least in trivial cases)	2021-07-25 21:15:43 +02:00
ed	27cce086c6	fileman ui	2021-07-25 01:09:14 +02:00
ed	05a1a31cab	too soon	2021-07-24 22:20:02 +02:00
ed	d020527c6f	centralize mojibake support stuff	2021-07-24 21:56:55 +02:00
ed	4451485664	mv/rm (serverside), 100% untested	2021-07-24 20:08:31 +02:00
ed	a4e1a3738a	more deletion progress	2021-07-23 23:42:07 +02:00
ed	e3684e25f8	treat symlinks as regular files in db	2021-07-22 19:34:40 +02:00
ed	1359213196	prefer native sqlite3 backup (journal-aware)	2021-07-22 19:10:42 +02:00
ed	8eb8043a3d	fix 3rdparty namecase	2021-07-18 22:50:29 +02:00
ed	ebc9de02b0	case-insensitive tag search	2021-07-18 21:34:36 +02:00
ed	3ca41be2b4	do up2k snapshot on shutdown	2021-07-17 14:48:35 +02:00
ed	bac301ed66	get rid of iffy default-args	2021-07-12 00:15:13 +02:00
ed	8fcde2a579	move tcp accept into mp-worker	2021-07-09 15:49:36 +02:00
ed	21c3570786	detect more recursive symlinks	2021-07-05 23:50:03 +02:00
ed	2f85c1fb18	add logging to file	2021-07-05 23:30:33 +02:00
ed	51546c9e64	add missing -nw check	2021-07-04 16:10:20 +02:00
ed	87200d9f10	make -nw apply to more stuff	2021-06-30 19:23:45 +02:00
ed	f1a1c2ea45	recover from opening a corrupt database	2021-06-22 17:19:56 +02:00
ed	6249bd4163	add pebkac hints	2021-06-22 17:18:34 +02:00
ed	15a3ee252e	support backslash in filenames	2021-06-20 15:50:06 +02:00
ed	be055961ae	adjust up2k hashlen to match base64 window	2021-06-20 15:32:36 +02:00
ed	10362aa02e	v0.11.18	2021-06-18 00:30:37 +02:00
ed	241a143366	add --rproxy for explicit proxy level	2021-06-13 22:22:31 +02:00
ed	d53c212516	add mtp queue to status page	2021-06-12 02:23:48 +02:00
ed	88ce008e16	more status on admin panel	2021-06-12 01:39:14 +02:00
ed	60ac68d000	single authsrv instance per process	2021-06-11 23:01:13 +02:00
ed	fbe656957d	fix race	2021-06-11 18:12:06 +02:00
ed	1078d933b4	adding --no-hash	2021-06-10 18:08:30 +02:00
ed	d6bf300d80	option to store state out-of-volume (mostly untested)	2021-06-10 01:27:04 +02:00
ed	5ded5a4516	alphabetical up2k indexing	2021-06-08 21:42:08 +02:00
ed	9d729d3d1a	add thread names	2021-06-08 20:14:23 +02:00
ed	4dd5d4e1b7	when rootless, blank instead of block rootdir	2021-06-08 18:35:55 +02:00
ed	c533da9129	fix single-threaded mtag	2021-06-04 19:00:24 +02:00
ed	ea4441e25c	v0.11.2	2021-06-01 02:47:37 +02:00
ed	e5f34042f9	more precise volume state in admin panel	2021-06-01 02:32:53 +02:00
ed	d102bb3199	fix on-upload hasher (0.11.1 regression)	2021-06-01 01:20:34 +02:00
ed	0be7c5e2d8	live db/tags rescan	2021-05-29 23:35:07 +02:00
ed	3948214050	drop deleted files from snap	2021-05-29 09:03:18 +02:00
ed	d25881d5c3	mojibake fixes	2021-05-29 09:01:59 +02:00
ed	118ebf668d	fix bugs	2021-05-29 05:43:09 +02:00
ed	a86f09fa46	mtp: file extension filtering	2021-05-29 04:18:57 +02:00
ed	deea66ad0b	support multiple tags from mtp helpers	2021-05-29 03:43:14 +02:00
ed	69dc433e1c	ffprobe parser less bad	2021-05-27 01:41:12 +02:00
ed	483dd527c6	add cache eviction	2021-05-25 19:46:35 +02:00
ed	4dff726310	initial thumbnail and icon stuff	2021-05-25 03:37:01 +02:00
ed	405ae1308e	v0.10.21	2021-05-16 20:22:33 +02:00
ed	0fcfe79994	general-purpose file parsing	2021-05-16 07:04:18 +02:00
ed	58ba71a76f	option to hide incomplete uploads	2021-05-13 22:56:52 +02:00
ed	26e18ae800	disallow uploading logues	2021-05-12 23:22:43 +02:00
ed	eed82dbb54	remove dead code	2021-04-21 18:44:47 +02:00
ed	505a8fc6f6	up2k: sparse alloc on windows	2021-04-21 18:32:21 +02:00
ed	e4801d9b06	support msys2-python	2021-04-21 18:28:44 +02:00
ed	f8c11faada	don't start 2t stuff if there's no backend avail	2021-04-19 13:17:34 +02:00
ed	217d15fe81	up2k: cheap progress bars	2021-04-17 00:57:35 +02:00
ed	1195b8f17e	v0.10.3	2021-03-29 04:47:59 +02:00
ed	4ed9528d36	5x faster reply on 1st req on new conns	2021-03-25 19:29:16 +01:00
ed	d8d1f94a86	v0.9.12	2021-03-23 01:24:37 +01:00
ed	c6c0eeb0ff	better volflags presentation	2021-03-23 00:28:11 +01:00
ed	e70c74a3b5	support nullmapping subfolders with -v :/foo/bar:cd2d	2021-03-23 00:08:23 +01:00
ed	7f8d7d6006	v0.9.9	2021-03-21 17:15:47 +01:00
ed	8dbbea473f	mtp incoming files too	2021-03-21 15:21:07 +01:00
ed	d07f147423	fixes	2021-03-21 06:00:21 +01:00
ed	f5cb9f92b9	better task recovery on restart	2021-03-21 05:57:24 +01:00
ed	afbfa04514	fixes	2021-03-21 01:55:12 +01:00
ed	b07445a363	search ratecontrol and timeouts cause it can get bad	2021-03-20 07:32:01 +00:00
ed	a83d3f8801	prevent dupe tags from mtp (replace id3 tags)	2021-03-20 01:00:57 +01:00
ed	21e1cd87ca	nice on windows	2021-03-19 23:43:34 +01:00
ed	c0e31851da	add timeouts for mtp calls	2021-03-19 21:22:56 +01:00
ed	6599c3eced	no racing pls	2021-03-19 20:42:33 +01:00
ed	5d6c61a861	add mtp eta	2021-03-19 01:20:01 +01:00
ed	deae9fe95a	vscode is entirely too helpful	2021-03-19 00:14:42 +01:00
ed	abd65c6334	support metadata plugins	2021-03-19 00:08:31 +01:00
ed	d3aae8ed6a	more mojibake fixes	2021-03-07 18:58:26 +01:00
ed	b9a4e47ea2	mojibake support for the spa stuff	2021-03-06 22:48:49 +01:00
ed	57d994422d	logging cleanup	2021-03-06 17:38:56 +01:00
ed	6ecd745323	so much for sessionStorage	2021-03-06 16:34:55 +01:00
ed	24fdada0a0	did you know rhel 7 has an sqlite3 from 2015	2021-03-06 02:28:49 +01:00
ed	bb5169710a	warn people when they're gonna have a bad time	2021-03-06 00:30:05 +01:00
ed	2b4ccdbebb	multithread the slow mtag backends	2021-03-04 20:28:03 +01:00
ed	da01413b7b	remove speedbumps	2021-03-04 01:21:04 +01:00
ed	914e22c53e	async tagging of incoming files	2021-03-03 18:36:05 +01:00
ed	b0b97a2648	fix bugs	2021-03-03 00:46:15 +01:00
ed	46e10b0e9f	yab	2021-03-01 03:15:41 +01:00
ed	8441206e26	read media-tags from files (for display/searching)	2021-03-01 02:50:10 +01:00