Nick Craig-Wood
07313554bf
b2: reduce default chunk size to 16M and increase upload concurrency to 8
...
The 96M default chunk size dates from 2016 when 100,000,000 bytes was
the minimum part size B2 allowed. The minimum is now 5,000,000 bytes.
Measurements against B2 EU on a 1 Gbit/s link show that each part has
a fixed overhead of about a second regardless of size, so throughput
is governed by chunk size multiplied by upload concurrency rather than
by chunk size alone. 16M chunks with concurrency 8 upload a 1 GiB file
as fast as 96M chunks with concurrency 4 while using a third of the
memory per transfer, and retry much less data when a part fails.
This also means that files between --multi-thread-cutoff and the chunk
size are no longer uploaded as a single part large file, which B2
rejects with "large files must have at least 2 parts", unless the
cutoff is set below 16M.
2026-09-10 15:57:25 +01:00
..
2026-07-31 16:56:33 +01:00
2026-07-31 16:56:33 +01:00
2026-07-28 17:35:11 +01:00
2026-04-02 16:32:54 +01:00
2026-04-02 16:32:54 +01:00
2026-04-02 16:32:54 +01:00
2026-09-08 10:27:49 +01:00
2026-09-05 17:53:08 +01:00
2026-09-05 17:53:08 +01:00
2026-09-10 15:57:25 +01:00
2026-04-13 16:45:00 +01:00
2026-09-05 17:53:08 +01:00
2026-07-31 16:56:33 +01:00
2025-07-21 20:23:16 +02:00
2026-07-31 16:56:33 +01:00
2026-09-04 19:00:22 +01:00
2026-04-02 16:32:54 +01:00
2026-04-02 16:32:54 +01:00
2026-04-02 16:32:54 +01:00
2026-04-02 16:32:54 +01:00
2025-08-26 12:04:00 +02:00
2026-08-27 17:28:04 +01:00
2025-11-01 15:52:41 +01:00
2026-09-05 17:53:08 +01:00
2026-04-02 16:32:54 +01:00
2026-03-28 12:29:53 +00:00
2026-07-31 16:56:33 +01:00
2026-09-08 10:51:05 +01:00
2026-07-31 16:56:33 +01:00
2026-01-23 16:55:52 +00:00
2026-04-02 16:32:54 +01:00
2026-04-02 16:32:54 +01:00
2026-05-01 15:56:56 +01:00
2026-05-01 15:56:56 +01:00
2026-04-02 16:32:54 +01:00
2026-07-02 11:21:21 +01:00
2026-07-31 16:56:33 +01:00
2026-04-02 16:32:54 +01:00
2026-04-02 16:32:54 +01:00
2026-07-31 16:56:33 +01:00
2026-07-31 16:56:33 +01:00
2026-08-18 14:29:43 +01:00
2026-04-02 16:32:54 +01:00
2026-04-02 16:32:54 +01:00
2026-04-02 16:32:54 +01:00
2026-08-12 10:59:44 +01:00
2026-09-03 12:06:27 +01:00
2026-07-31 16:56:33 +01:00
2026-07-31 16:56:33 +01:00
2026-08-20 12:16:48 +01:00
2023-11-28 19:10:04 +00:00
2026-04-02 16:32:54 +01:00
2026-07-31 16:56:33 +01:00
2026-05-14 10:53:04 +01:00
2023-09-11 12:28:23 +01:00
2026-04-02 16:32:54 +01:00
2025-07-21 20:23:16 +02:00
2026-07-31 16:56:33 +01:00
2026-07-31 16:56:33 +01:00
2026-07-31 16:56:33 +01:00
2026-07-31 16:56:33 +01:00
2026-04-02 16:32:54 +01:00
2026-04-02 16:32:54 +01:00
2026-07-31 16:56:33 +01:00
2026-04-02 16:32:54 +01:00
2026-04-21 21:06:49 +02:00
2026-04-02 16:32:54 +01:00
2026-05-01 15:56:56 +01:00
2026-04-02 16:32:54 +01:00
2026-07-31 16:56:33 +01:00
2025-10-14 16:24:07 +01:00
2026-07-31 16:56:33 +01:00
2026-04-02 16:32:54 +01:00
2026-04-02 16:32:54 +01:00
2026-04-02 16:32:54 +01:00
2026-07-31 16:56:33 +01:00
2025-11-01 15:33:38 +01:00
2026-06-28 23:53:05 +02:00
2026-08-26 17:42:57 +01:00
2026-07-31 16:56:33 +01:00
2026-08-26 17:42:57 +01:00
2026-04-02 16:32:54 +01:00
2026-04-02 16:32:54 +01:00
2026-08-27 17:59:08 +02:00
2026-04-02 16:32:54 +01:00
2026-09-08 15:27:44 +01:00
2026-08-27 17:59:08 +02:00
2026-04-02 16:32:54 +01:00
2026-09-05 17:53:08 +01:00
2026-01-30 17:08:44 +00:00
2026-04-02 16:32:54 +01:00
2026-04-02 16:32:54 +01:00
2026-08-26 12:00:22 +01:00
2026-07-31 16:56:33 +01:00
2026-07-31 16:56:33 +01:00