Commit Graph

2671 Commits

Author SHA1 Message Date
dependabot[bot]
f41ecf4df8 build(deps): bump github.com/klauspost/reedsolomon from 1.11.1 to 1.11.2 (#2586)
Bumps [github.com/klauspost/reedsolomon](https://github.com/klauspost/reedsolomon) from 1.11.1 to 1.11.2.
- [Release notes](https://github.com/klauspost/reedsolomon/releases)
- [Commits](https://github.com/klauspost/reedsolomon/compare/v1.11.1...v1.11.2)

---
updated-dependencies:
- dependency-name: github.com/klauspost/reedsolomon
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-11-19 10:29:11 -08:00
Jarek Kowalski
d782dbe550 refactor(repository): refactored Repository close logic (#2589)
This ensures metric registry is always closed on last Close().
2022-11-19 06:52:03 +00:00
Jarek Kowalski
3d38ec8405 feat(repository): added Snapshot(bool) option to reset metrics (#2588) 2022-11-19 05:29:24 +00:00
dependabot[bot]
6c0b01b551 build(deps): bump golang.org/x/mod from 0.6.0 to 0.7.0 (#2570)
Bumps [golang.org/x/mod](https://github.com/golang/mod) from 0.6.0 to 0.7.0.
- [Release notes](https://github.com/golang/mod/releases)
- [Commits](https://github.com/golang/mod/compare/v0.6.0...v0.7.0)

---
updated-dependencies:
- dependency-name: golang.org/x/mod
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-11-16 20:08:54 -08:00
dependabot[bot]
ce96853302 build(deps): bump github.com/aws/aws-sdk-go from 1.44.136 to 1.44.139 (#2581) 2022-11-16 23:29:28 +00:00
dependabot[bot]
b4c8844ce1 build(deps): bump github.com/aws/aws-sdk-go from 1.44.135 to 1.44.136 (#2569) 2022-11-11 23:31:23 +00:00
dependabot[bot]
3a3e2b9512 build(deps): bump golang.org/x/net from 0.1.0 to 0.2.0 (#2566)
Bumps [golang.org/x/net](https://github.com/golang/net) from 0.1.0 to 0.2.0.
- [Release notes](https://github.com/golang/net/releases)
- [Commits](https://github.com/golang/net/compare/v0.1.0...v0.2.0)

---
updated-dependencies:
- dependency-name: golang.org/x/net
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-11-10 16:15:23 -08:00
dependabot[bot]
91dc0f7175 build(deps): bump github.com/aws/aws-sdk-go from 1.44.129 to 1.44.135 (#2567) 2022-11-10 23:39:25 +00:00
dependabot[bot]
3ab930a1c0 build(deps): bump minimist from 1.2.6 to 1.2.7 in /app (#2536)
Bumps [minimist](https://github.com/minimistjs/minimist) from 1.2.6 to 1.2.7.
- [Release notes](https://github.com/minimistjs/minimist/releases)
- [Changelog](https://github.com/minimistjs/minimist/blob/main/CHANGELOG.md)
- [Commits](https://github.com/minimistjs/minimist/compare/v1.2.6...v1.2.7)

---
updated-dependencies:
- dependency-name: minimist
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-11-09 22:22:21 -08:00
Jarek Kowalski
78edd92692 refactor(repository): refactored Prometheus metrics (#2532)
This may be a breaking change for users who rely on particular kopia metrics (unlikely):

- introduced blob-level metrics:

* `kopia_blob_download_full_blob_bytes_total`
* `kopia_blob_download_partial_blob_bytes_total`
* `kopia_blob_upload_bytes_total`
* `kopia_blob_storage_latency_ms` - per-method latency distribution
* `kopia_blob_errors_total` - per-method error counter

- updated cache metrics to indicate particular cache

* `kopia_cache_hit_bytes_total{cache="CACHE_TYPE"}`
* `kopia_cache_hit_total{cache="CACHE_TYPE"}`
* `kopia_cache_malformed_total{cache="CACHE_TYPE"}`
* `kopia_cache_miss_total{cache="CACHE_TYPE"}`
* `kopia_cache_miss_errors_total{cache="CACHE_TYPE"}`
* `kopia_cache_miss_bytes_total{cache="CACHE_TYPE"}`
* `kopia_cache_store_errors_total{cache="CACHE_TYPE"}`

where `CACHE_TYPE` is one of `contents`, `metadata` or `index-blobs`

- reorganized and unified content-level metrics:

* `kopia_content_write_bytes_total`
* `kopia_content_write_duration_nanos_total`

* `kopia_content_compression_attempted_bytes_total`
* `kopia_content_compression_attempted_duration_nanos_total`
* `kopia_content_compression_savings_bytes_total`
* `kopia_content_compressible_bytes_total`
* `kopia_content_non_compressible_bytes_total`
* `kopia_content_after_compression_bytes_total`

* `kopia_content_decompressed_bytes_total`
* `kopia_content_decompressed_duration_nanos_total`

* `kopia_content_encrypted_bytes_total`
* `kopia_content_encrypted_duration_nanos_total`

* `kopia_content_hashed_bytes_total`
* `kopia_content_hashed_duration_nanos_total`

* `kopia_content_deduplicated_bytes_total`

* `kopia_content_read_bytes_total`
* `kopia_content_read_duration_nanos_total`

* `kopia_content_decrypted_bytes_total`
* `kopia_content_decrypted_duration_nanos_total`

* `kopia_content_uploaded_bytes_total`

Also introduced `internal/metrics` framework which constructs Prometheus metrics in a uniform way and will allow us to include some of these metrics in telemetry report in future PRs.
2022-11-10 05:30:06 +00:00
dependabot[bot]
3ff7b5a840 build(deps): bump go.opentelemetry.io/otel/exporters/jaeger (#2557) 2022-11-09 00:05:31 +00:00
dependabot[bot]
abe25d0a4d build(deps): bump google.golang.org/api from 0.102.0 to 0.103.0 (#2560) 2022-11-08 23:26:46 +00:00
dependabot[bot]
95b5f77175 build(deps): bump github.com/prometheus/client_golang (#2559) 2022-11-08 23:21:20 +00:00
dependabot[bot]
243dd1c2b6 build(deps): bump cloud.google.com/go/storage from 1.27.0 to 1.28.0 (#2556) 2022-11-07 23:36:56 +00:00
ashmrtn
4024071fc0 fix(repository): Manifest label comparison when value is empty (#2543)
Allow matching on labels with empty values. Previously, the "empty
value" for a map string ("") would match the empty value of the label
key, causing the system to return all manifests. This separates key
existence from value equality to handle labels with empty values.
2022-11-04 08:02:13 -07:00
dependabot[bot]
cd4fa5dd34 build(deps): bump github.com/klauspost/compress from 1.15.11 to 1.15.12 (#2547)
Bumps [github.com/klauspost/compress](https://github.com/klauspost/compress) from 1.15.11 to 1.15.12.
- [Release notes](https://github.com/klauspost/compress/releases)
- [Changelog](https://github.com/klauspost/compress/blob/master/.goreleaser.yml)
- [Commits](https://github.com/klauspost/compress/compare/v1.15.11...v1.15.12)

---
updated-dependencies:
- dependency-name: github.com/klauspost/compress
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-11-04 08:01:26 -07:00
dependabot[bot]
98d2c42e52 build(deps): bump github.com/aws/aws-sdk-go from 1.44.128 to 1.44.129 (#2546) 2022-11-02 23:49:34 +00:00
dependabot[bot]
c874684bd6 build(deps): bump github.com/prometheus/client_golang (#2545) 2022-11-02 23:38:18 +00:00
dependabot[bot]
a8a06f6cb4 build(deps): bump github.com/minio/minio-go/v7 from 7.0.41 to 7.0.43 (#2544) 2022-11-02 23:35:33 +00:00
dependabot[bot]
fd7f4e63c7 build(deps): bump github.com/aws/aws-sdk-go from 1.44.125 to 1.44.128 (#2541) 2022-11-02 04:13:39 +00:00
dependabot[bot]
e18fc93bfe build(deps-dev): bump electron-notarize from 1.2.1 to 1.2.2 in /app (#2537)
Bumps [electron-notarize](https://github.com/electron/notarize) from 1.2.1 to 1.2.2.
- [Release notes](https://github.com/electron/notarize/releases)
- [Changelog](https://github.com/electron/notarize/blob/main/.releaserc.json)
- [Commits](https://github.com/electron/notarize/compare/v1.2.1...v1.2.2)

---
updated-dependencies:
- dependency-name: electron-notarize
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-11-01 20:32:34 -07:00
dependabot[bot]
da407ca396 build(deps): bump go.uber.org/zap from 1.21.0 to 1.23.0 (#2345)
Bumps [go.uber.org/zap](https://github.com/uber-go/zap) from 1.21.0 to 1.23.0.
- [Release notes](https://github.com/uber-go/zap/releases)
- [Changelog](https://github.com/uber-go/zap/blob/master/CHANGELOG.md)
- [Commits](https://github.com/uber-go/zap/compare/v1.21.0...v1.23.0)

---
updated-dependencies:
- dependency-name: go.uber.org/zap
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-11-01 20:32:13 -07:00
dependabot[bot]
6eca8ac83c build(deps): bump github.com/stretchr/testify from 1.8.0 to 1.8.1 (#2540) 2022-11-02 00:52:43 +00:00
dependabot[bot]
b30c949d41 build(deps): bump github.com/klauspost/reedsolomon from 1.11.0 to 1.11.1 (#2484)
Bumps [github.com/klauspost/reedsolomon](https://github.com/klauspost/reedsolomon) from 1.11.0 to 1.11.1.
- [Release notes](https://github.com/klauspost/reedsolomon/releases)
- [Commits](https://github.com/klauspost/reedsolomon/compare/v1.11.0...v1.11.1)

---
updated-dependencies:
- dependency-name: github.com/klauspost/reedsolomon
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-11-01 17:38:44 -07:00
dependabot[bot]
b790779533 build(deps): bump go.opentelemetry.io/otel/sdk from 1.11.0 to 1.11.1 (#2529) 2022-11-01 15:56:51 +00:00
dependabot[bot]
2e057e8ccf build(deps): bump go.opentelemetry.io/otel/trace from 1.11.0 to 1.11.1 (#2521) 2022-11-01 15:29:22 +00:00
Jarek Kowalski
c26335bd33 chore(ci): fix netlify build (#2535) 2022-10-31 22:42:37 -07:00
Jarek Kowalski
0554e2f7ce refactor(general): introduced generics to reduce boilerplate code (#2527)
This removes tons of boilerplate code around:

- retry loop
- connection management
- storage registration

* used generics in runInParallel
* introduced generics in freepool
* introduced strong typing for workshare.Pool and workshare.AsyncGroup
* fixed linter error on openbsd
2022-10-29 01:56:51 +00:00
Jarek Kowalski
f69424961f chore(ci): upgrade golang to 1.19.2 and linter to 1.50.1 (#2526)
Lack of generics support is blocking various dependency upgrades,
so this unblocks that.

Temporarily disabled `checklocks` linter until it is fixed upstream.
2022-10-28 11:02:47 -07:00
dependabot[bot]
ec5fe211cf build(deps): bump github.com/aws/aws-sdk-go from 1.44.118 to 1.44.125 (#2524) 2022-10-27 23:43:05 +00:00
dependabot[bot]
e57bbb81a4 build(deps): bump google.golang.org/api from 0.99.0 to 0.101.0 (#2518) 2022-10-25 23:34:35 +00:00
atom
c5efed01f4 feat(cli): Support displaying storage values in base-2 [#2492] (#2502)
* Update display on repository summary

* Apply throughout app

* Situate units_test

* Update Command Line documentation

* Envar cleanup

* Rename to BytesString

* Restore envar string available for test

* Remove extraneous empty check and restore UIPreferences field for frontend

* PR: config bool cleanup and missed `BaseEnv`s

* Fix lint and test
2022-10-24 19:00:36 -07:00
Jakob Kukla
7d47658cbb docs(site): Fix typo 2022-10-21 05:39:38 +00:00
dependabot[bot]
62912f6cab build(deps): bump github.com/aws/aws-sdk-go from 1.44.117 to 1.44.118 (#2514) 2022-10-18 23:34:53 +00:00
dependabot[bot]
117dfe6e04 build(deps): bump github.com/aws/aws-sdk-go from 1.44.116 to 1.44.117 (#2512) 2022-10-17 23:35:13 +00:00
dependabot[bot]
a44e5cc66c build(deps): bump google.golang.org/api from 0.98.0 to 0.99.0 (#2505) 2022-10-15 00:11:41 +00:00
dependabot[bot]
c0d80c532e build(deps): bump github.com/aws/aws-sdk-go from 1.44.115 to 1.44.116 (#2506) 2022-10-15 00:07:21 +00:00
dependabot[bot]
d64cc960d3 build(deps): bump google.golang.org/grpc from 1.50.0 to 1.50.1 (#2503) 2022-10-14 23:38:35 +00:00
dependabot[bot]
8a4b869efb build(deps): bump github.com/minio/minio-go/v7 from 7.0.39 to 7.0.41 (#2504) 2022-10-14 23:31:53 +00:00
Le Duane
b0b111c3aa feat(repository): add more split size options: 128K, 256K, 512K (#2496)
* new splitter options

* tabs

* add more options

* update all splitters with new sizes

* remove un-used splitters

* no space

Co-authored-by: Thomas Duane <tduane@sofi.org>
2022-10-14 18:03:07 +00:00
dependabot[bot]
25f6073092 build(deps): bump github.com/aws/aws-sdk-go from 1.44.114 to 1.44.115 (#2499) 2022-10-13 20:50:18 +00:00
dependabot[bot]
5a95c80127 build(deps): bump go.opentelemetry.io/otel/exporters/jaeger (#2498) 2022-10-13 20:18:17 +00:00
dependabot[bot]
0d0a258bdb build(deps): bump golang.org/x/text from 0.3.7 to 0.3.8 (#2494)
Bumps [golang.org/x/text](https://github.com/golang/text) from 0.3.7 to 0.3.8.
- [Release notes](https://github.com/golang/text/releases)
- [Commits](https://github.com/golang/text/compare/v0.3.7...v0.3.8)

---
updated-dependencies:
- dependency-name: golang.org/x/text
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-10-13 12:49:30 -07:00
dependabot[bot]
1c5bc1ed23 build(deps): bump github.com/aws/aws-sdk-go from 1.44.112 to 1.44.114 (#2490) 2022-10-07 23:37:12 +00:00
dependabot[bot]
82e7d567e2 build(deps): bump google.golang.org/grpc from 1.49.0 to 1.50.0 (#2489) 2022-10-06 23:39:03 +00:00
dependabot[bot]
1f22bed8f7 build(deps): bump github.com/aws/aws-sdk-go from 1.44.111 to 1.44.112 (#2487) 2022-10-05 23:39:51 +00:00
dependabot[bot]
e8520eb1ed build(deps): bump github.com/aws/aws-sdk-go from 1.44.110 to 1.44.111 (#2485) 2022-10-04 23:44:48 +00:00
dependabot[bot]
fb865ef878 build(deps): bump github.com/aws/aws-sdk-go from 1.44.109 to 1.44.110 (#2483) 2022-10-04 00:03:25 +00:00
dependabot[bot]
29ec24583a build(deps-dev): bump playwright from 1.26.0 to 1.26.1 in /app (#2472) 2022-10-02 05:24:32 +00:00
dependabot[bot]
ec564f8e9e build(deps-dev): bump concurrently from 7.3.0 to 7.4.0 in /app (#2473)
Bumps [concurrently](https://github.com/open-cli-tools/concurrently) from 7.3.0 to 7.4.0.
- [Release notes](https://github.com/open-cli-tools/concurrently/releases)
- [Commits](https://github.com/open-cli-tools/concurrently/compare/v7.3.0...v7.4.0)

---
updated-dependencies:
- dependency-name: concurrently
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-10-02 04:39:41 +00:00