mirrors/copyparty
1
0
Fork 0
mirror of https://github.com/9001/copyparty.git synced 2025-08-17 09:02:15 -06:00
Code Issues Actions Packages Projects Releases Wiki Activity
3420 commits 4 branches 342 tags 55 MiB
Commit graph

337 commits

Author SHA1 Message Date
ed 132a83501e add chunk stitching; twice as fast long-distance uploads: 
rather than sending each file chunk as a separate HTTP request,
sibling chunks will now be fused together into larger HTTP POSTs
which results in unreasonably huge speed boosts on some routes
( `2.6x` from Norway to US-East,  `1.6x` from US-West to Finland )

the `x-up2k-hash` request header now takes a comma-separated list
of chunk hashes, which must all be sibling chunks, resulting in
one large consecutive range of file data as the post body

a new global-option `--u2sz`, default `1,64,96`, sets the target
request size as 64 MiB, allowing the settings ui to specify any
value between 1 and 96 MiB, which is cloudflare's max value

this does not cause any issues for resumable uploads; thanks to the
streaming HTTP POST parser, each chunk will be verified and written
to disk as they arrive, meaning only the untransmitted chunks will
have to be resent in the event of a connection drop -- of course
assuming there are no misconfigured WAFs or caching-proxies

the previous up2k approach of uploading each chunk in a separate HTTP
POST was inefficient in many real-world scenarios, mainly due to TCP
window-scaling behaving erratically in some IXPs / along some routes

a particular link from Norway to Virginia,US is unusably slow for
the first 4 MiB, only reaching optimal speeds after 100 MiB, and
then immediately resets the scale when the request has been sent;
connection reuse does not help in this case

on this route, the basic-uploader was somehow faster than up2k
with 6 parallel uploads; only time i've seen this
 2024-07-21 23:35:37 +00:00
ed ac1e11e4ce v1.13.4 2024-07-16 04:57:26 +00:00
ed c9281f8912 option to return media-links for uploads 2024-06-07 12:56:02 +00:00
ed f00b939402 v1.13.3 2024-06-01 23:24:35 +00:00
ed 400d700845 v1.13.2 2024-05-10 14:31:50 +00:00
ed 38e4fdfe03 batch-convert audio waveforms with ?tar&p 2024-05-10 12:55:35 +00:00
ed c04662798d play compressed s3xmodit chiptunes 
adds support for playing gz, xz, and zip-compressed tracker files

using the de-facto naming convention for compressed modules;

* mod: mdz, mdgz, mdxz
* s3m: s3z, s3gz, s3xz
* xm: xmz, xmgz, xmxz
* it: itz, itgz, itxz
 2024-05-10 12:45:17 +00:00
ed 19d156ff4e option to add custom UI translations 2024-05-09 23:09:45 +00:00
ed feed08deb2 doc: export --help to html and link it 2024-05-08 22:01:58 +00:00
ed b6cf2d3089 --html-head can take a filepath and/or jinja2 2024-05-01 20:24:18 +00:00
ed 42d00050c1 v1.13.0 2024-04-20 22:32:50 +00:00
ed 897ffbbbd0 pipe: add to docs 2024-04-19 00:02:28 +00:00
ed 9937c2e755 add ArozOS to comparison 2024-04-16 21:00:47 +00:00
ed fe700dcf1a v1.12.2 2024-04-12 21:10:02 +00:00
ed 443acf2f8b update nuitka notes 2024-04-10 22:04:43 +00:00
ed ea002ee71d v1.12.1 2024-04-09 23:34:31 +00:00
ed a0022805d1 v1.12.0 (closes #64) 2024-04-06 20:11:49 +00:00
ed d94b5b3fc9 fau doesn't work on iphones; compensate by preloading much earlier 2024-04-06 18:43:45 +00:00
ed 59a53ba9ac on phones, fix playback halting if next song didn't buffer in time 2024-04-06 00:25:28 +00:00
ed 5ab54763c6 remove pyoxidizer (unmaintained) 
partially reverts e430b2567a

the remaining stuff might be useful for other cpython alternatives
 2024-04-05 17:51:26 +00:00
ed f471b05aa4 todo: fix playback stopping on phones if slow preload 2024-04-02 23:20:58 +00:00
ed bdfe2c1a5f mention unproductive optimizations 2024-03-24 22:07:23 +00:00
ed bccc44dc21 v1.11.2 2024-03-23 17:24:36 +00:00
ed 2f20d29edd idp: mention lack of volume persistence 2024-03-23 16:35:45 +00:00
ed c6acd3a904 add option --s-rd-sz (socket read size): 
counterpart of `--s-wr-sz` which existed already

the default (256 KiB) appears optimal in the most popular scenario
(linux host with storage on local physical disk, usually NVMe)

was previously 32 KiB, so large uploads should now use 17% less CPU

also adds sanchecks for values of `--iobuf`, `--s-rd-sz`, `--s-wr-sz`

also adds file-overwrite feature for multipart posts
 2024-03-23 16:35:14 +00:00
ed 9700a12366 v1.11.1 2024-03-18 17:09:56 +00:00
ed ee80cdb9cf docs: real-ip (with or without cloudflare) 2024-03-18 16:30:51 +00:00
ed e78af02241 docs: 
* add readme section on using amazon/aws s3 as storage
* mention http/https confusion caused by incorrectly configured cloudflare
* improve custom-font notes
* docker: ftp-server howto
* docker: suggest moving hist-folders into the config path

and switch the idp docker-compose files to use the
main image, in anticipation of v1.11
 2024-03-14 23:26:26 +00:00
ed b377791be7 support cidr notation for --xff-src, --ipa, --*-ipa 
the old `10.88.` syntax is still supported,
translating to `10.88.0.0/16`

also fix `--tftp-ipa` when optimizations are enabled
 2024-03-14 19:07:35 +01:00
ed 78919e65d6 idp: docs 2024-03-13 22:50:50 +00:00
ed 84b52ea8c5 idp: docs / cleanup 2024-03-13 22:13:34 +00:00
ed fd89f7ecb9 idp: abandon idea for persisting idp volumes; 
too fraught with subtle dangers, such as other copyparty instances
ending up sharing knowledge of volumes unintentionally, and
configuration becoming mysteriously sticky (not to mention
this would all become hella difficult to reason about)

instead, rely entirely on users seeing the big red warning
added in 2ebfdc25 if their configuration is dangerous

this decision has the drawback that there will be server stuttering
whenever a new user makes themselves known since the last restart,
as it realizes the volumes exist and does the usual e2ds indexing,
instead of doing it early during startup

but it's probably good enough
 2024-03-13 21:49:49 +00:00
ed 2ebfdc2562 idp: add anon-read sanchk 2024-03-13 21:36:36 +00:00
ed dbf1cbc8af idp: hide login/logout UI + improve html_head handling 2024-03-13 18:22:24 +00:00
ed a259704596 Merge branch 'hovudstraum' into idp 2024-03-13 17:28:48 +00:00
ed f8966222e4 todo-done: IdP secret-tokens 2024-03-12 23:06:20 +00:00
ed d71f844b43 IdP: add safeguard --idp-h-key and also require --xff-src 2024-03-12 22:57:47 +00:00
ed f193f398c1 Merge branch 'hovudstraum' into idp 2024-03-12 17:31:27 +00:00
ed 3f05b6655c add UI to abort an unfinished upload; suggested in #77 
to abort an upload, refresh the page and access the unpost tab,
which now includes unfinished uploads (sorted before completed ones)

can be configured through u2abort (global or volflag);
by default it requires both the IP and account to match

https://a.ocv.me/pub/g/nerd-stuff/2024-0310-stoltzekleiven.jpg
 2024-03-11 01:32:02 +01:00
ed a1ad608267 add TODO.md, closes #78 2024-03-09 09:02:16 +00:00
ed bec3fee9ee idp(#62): add unfinished docker-compose attempts 2024-02-27 02:01:06 +00:00
ed c8ea4066b1 less confusing explanation hopefully 2024-02-25 04:43:32 +00:00
ed 6cc7101d31 custom-fonts: add config file example (#74) 2024-02-25 00:15:57 +00:00
ed 263adec70a add support for custom fonts; closes #74 2024-02-24 23:30:17 +00:00
ed ac96fd9c96 get rid of brotli due to poor support; closes #73 
some reverse-proxies expect plaintext replies, and
we don't have a brotli decompressor to satisfy this

additionally, because brotli is https-gated (thx google),
it was already an impractical mess anyways

the sfx is now 7 KiB larger
 2024-02-24 22:24:44 +00:00
ed 1b52ef1f8a Merge branch 'hovudstraum' into idp 2024-02-23 22:25:48 +00:00
ed 13e77777d7 v1.10.2 2024-02-21 21:32:11 +00:00
ed eeecc50757 v1.10.1 2024-02-18 15:54:38 +00:00
ed a0da0122b9 v1.10.0 2024-02-15 00:00:41 +00:00
ed d636316a19 add tftp server 2024-02-10 18:37:21 +00:00
ed 35165f8472 Merge branch 'hovudstraum' into idp 2024-02-03 19:14:49 +00:00
ed fabeebd96b v1.9.31 2024-02-03 15:33:11 +00:00
ed b1cf588452 add lore 2024-02-03 15:05:27 +00:00
ed caf7e93f5e IdP (#62): add groups + dynamic vols (non-persistent) 
features which should be good to go:
* user groups
* assigning permissions by group
* dynamically created volumes based on username/groupname
* rebuild vfs when new users/groups appear

but several important features still pending;
* detect dangerous configurations
   * dynamic vol below readable path
* remember volumes created during previous runs
   * helps prevent unintended access
   * correct filesystem-scan on startup
 2024-01-30 19:13:42 +01:00
ed eefa0518db change FFmpeg from BtbN to gyan/codex; 
deps are more up-to-date and slightly better codec selection
 2024-01-28 22:04:01 +00:00
ed 6c2c6090dc notes: hardlink/symlink conversion + phone cam sync 2024-01-27 18:52:08 +00:00
ed fade751a3e v1.9.30 2024-01-25 22:52:42 +00:00
ed 14bccbe45f backports from IdP branch: 
* allow mounting `/` (the entire filesystem) as a volume
  * not that you should (really, you shouldn't)
* improve `-v` helptext
* change IdP group symbol to @ because % is used for file inclusion
  * not technically necessary but is less confusing in docs
 2024-01-25 21:39:30 +00:00
ed 64cac003d8 add missing historic changelog entries 2024-01-24 01:28:29 +00:00
ed 140f6e0389 add contextlet + igloo irc config + upd changelog 2024-01-14 04:58:24 +00:00
ed 9bc09ce949 accept file POSTs without specifying the act field; 
primarily to support uploading from Igloo IRC but also generally useful
(not actually tested with Igloo IRC yet because it's a paid feature
so just gonna wait for spiky to wake up and tell me it didn't work)
 2024-01-08 19:09:53 +00:00
ed 987caec15d v1.9.28 2023-12-31 18:49:42 +00:00
ed 39554b4bc3 guard against unintended access if user-db is corrupted 2023-12-24 16:12:18 +01:00
ed 97d9c149f1 IdP config draft (#62) 2023-12-24 13:46:26 +01:00
ed d15000062d v1.9.27 2023-12-08 21:33:12 +00:00
ed a360ac29da v1.9.26 2023-12-08 01:36:01 +00:00
ed c7770904e6 v1.9.25 2023-12-01 23:26:16 +00:00
ed e6bcee28d6 v1.9.22 2023-12-01 00:31:02 +00:00
ed 00812cb1da new option --ipa; client IP allowlist: 
connections from outside the specified list of IP prefixes are rejected
(docker-friendly alternative to -i 127.0.0.1)

also mkdir any missing folders when logging to file
 2023-11-30 20:45:43 +00:00
ed 16766e702e add basic-docker-compose (#59) 2023-11-30 20:14:38 +00:00
ed c4ba123779 v1.9.21 2023-11-25 14:17:58 +00:00
ed eddce00765 v1.9.20 2023-11-21 23:25:41 +00:00
ed 9ccc238799 v1.9.19 2023-11-19 12:29:19 +00:00
ed deef32335e v1.9.18 2023-11-18 21:06:55 +00:00
ed ee3333362f v1.9.17 2023-11-11 17:38:43 +00:00
ed 7c0c6b94a3 drop asyncore; pyftpdlib has vendored it 2023-11-11 17:20:00 +00:00
ed dabdaaee33 v1.9.16 2023-11-04 21:58:01 +00:00
ed c07e0110f8 v1.9.15 2023-10-24 16:43:26 +00:00
ed 250aa28185 v1.9.13 2023-10-21 13:14:41 +00:00
ed e4001550c1 v1.9.11 2023-10-09 00:36:54 +00:00
ed acc363133f v1.9.10 2023-10-08 20:51:49 +00:00
ed e7fff77735 v1.9.9 2023-10-07 22:29:37 +00:00
ed fcc3336760 v1.9.8 2023-10-06 17:50:35 +00:00
ed fae5a36e6f v1.9.7 2023-09-30 23:32:51 +00:00
ed cae5ccea62 v1.9.6 2023-09-23 12:15:24 +00:00
ed a996a09bba v1.9.5 2023-09-09 13:36:56 +00:00
ed 714fd1811a add option to generate pax-format tar archives 
and forgot to commit the nix module
 2023-09-08 21:13:23 +00:00
ed ba02c9cc12 readme fix + make hacker theme more hacker 2023-09-08 19:35:12 +00:00
ed cadaeeeace v1.9.4 2023-09-02 00:18:53 +00:00
ed 700111ffeb v1.9.3 2023-08-31 22:11:31 +00:00
ed ac21fa7782 v1.9.2 2023-08-26 21:16:30 +00:00
ed 14497b2425 docs: 
* mention cloudflare-specific nginx config

versus.md:
* seafile has a size limit on zip downloads
* seafile and nextcloud are slow at uploading many small files

u2c: improve error message in funky environments
 2023-08-25 21:57:26 +00:00
ed cafe53c055 v1.9.0 2023-08-20 22:02:40 +00:00
ed 999ee2e7bc v1.8.8 2023-07-25 15:50:48 +00:00
ed d0aa20e17c v1.8.7 2023-07-23 15:43:38 +00:00
ed 9eaa9904e0 v1.8.6 2023-07-21 00:36:37 +00:00
ed 3dcc386b6f v1.8.3 2023-07-16 22:00:04 +00:00
ed 85a637af09 v1.8.2 2023-07-14 15:58:39 +00:00
ed a10cad54fc v1.8.1 2023-07-07 22:20:01 +00:00
ed e197895c10 support hashed passwords; closes #39 2023-06-25 21:50:33 +00:00