Jarek Kowalski 1ef3d243a0 repo: big performance improvement for WriteContent with repo server (#1182) ...

* repo: big performance improvement for WriteContent with repo server

When re-uploading previously snapshotted directory we fetch directory
content `k<hash>` and very frequently end up writing the exact same
content. By caching last N content IDs we can avoid costly round-trip
to the server since we know that content ID was present in the session.

Also added small number of asynchronous writes, which also helps with
upload performance. Background writes are awaited before Flush().

Performance when snapshotting lots of small files (source code):

31.9 GB files:471205 dirs:75817, warm cache
Before: 260s
After: 55s (4-5x faster)

* fixed tests

2021-07-09 22:39:04 -07:00

..

api_content.go

upgraded linter to 1.41.0 (#1144)

2021-06-16 19:44:55 -07:00

api_error.go

server: reworked authn/authz (#788)

2021-01-21 07:31:34 -08:00

api_estimate.go

cli: test + misc improvements (#1083)

2021-05-17 21:47:11 -07:00

api_manifest.go

server: refactored authentication and authorization (#871)

2021-03-08 22:25:22 -08:00

api_mount.go

Upgraded linter to 1.40.1 (#1072)

2021-05-15 12:12:34 -07:00

api_object_get.go

server: refactored authentication and authorization (#871)

2021-03-08 22:25:22 -08:00

api_policies.go

repo: refactored repository interfaces (#780)

2021-01-20 11:41:47 -08:00

api_repo.go

mechanical: added ctx parameter to repo.{Direct}WriteSession callback (#1114)

2021-06-02 23:12:30 -07:00

api_restore.go

Restore UI (#823)

2021-02-11 02:08:47 -08:00

api_snapshots.go

Tagging of kopia snapshots and listing of snapshots by tag (#1030)

2021-04-30 06:16:19 -07:00

api_sources.go

mechanical: added ctx parameter to repo.{Direct}WriteSession callback (#1114)

2021-06-02 23:12:30 -07:00

api_tasks.go

Added support for Tasks in the UI (#818)

2021-02-08 17:54:39 -08:00

api_user.go

Kopia UI improvements for repository management (#592)

2020-09-07 08:00:19 -07:00

grpc_session.go

mechanical: added ctx parameter to repo.{Direct}WriteSession callback (#1114)

2021-06-02 23:12:30 -07:00

htmlui_embed.go

Replace go-bindata with //go:embed (#844)

2021-02-23 01:09:40 -08:00

htmlui_fallback.go

Replace go-bindata with //go:embed (#844)

2021-02-23 01:09:40 -08:00

index.html

Replace go-bindata with //go:embed (#844)

2021-02-23 01:09:40 -08:00

server_authz_checks.go

Added repository user authorization support + server flag refactoring + refresh (#890)

2021-03-18 23:03:27 -07:00

server_test.go

repo: big performance improvement for WriteContent with repo server (#1182)

2021-07-09 22:39:04 -07:00

server.go

mechanical: added ctx parameter to repo.{Direct}WriteSession callback (#1114)

2021-06-02 23:12:30 -07:00

source_manager.go

mechanical: added ctx parameter to repo.{Direct}WriteSession callback (#1114)

2021-06-02 23:12:30 -07:00