mirror/kopia
1
0
Fork 0
mirror of https://github.com/kopia/kopia.git synced 2026-03-10 02:06:34 -04:00
Code Issues Packages Projects Releases Wiki Activity
2,735 Commits 8 Branches 88 Tags
9fdcc8013d43ada258f765bd957bf1900f6ea6ed
Commit Graph

2735 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
dependabot[bot]
9fdcc8013d build(deps): bump go.uber.org/multierr from 1.8.0 to 1.9.0 (#2734) 
Bumps [go.uber.org/multierr](https://github.com/uber-go/multierr) from 1.8.0 to 1.9.0.
- [Release notes](https://github.com/uber-go/multierr/releases)
- [Changelog](https://github.com/uber-go/multierr/blob/master/CHANGELOG.md)
- [Commits](https://github.com/uber-go/multierr/compare/v1.8.0...v1.9.0)

---
updated-dependencies:
- dependency-name: go.uber.org/multierr
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-02-07 06:19:37 -08:00
Jarek Kowalski
2801ab1640 feat(repository): added streaming of FindManifests responses (#2733) 
This change adds a new streaming response to the FindManifests API. The
server will deliver the response in chunks of N manifests where N is
requested by the client. This allows the client to process the response
in chunks and improves pipelining of responses.

For now client will hold the entire response in memory since this
is what FindManifests() API currently does. This will be fixed in a
follow up change.

Replaces #2713
Fixes #2660
 2023-02-07 06:19:09 -08:00
dependabot[bot]
98e8229f2d build(deps): bump github.com/aws/aws-sdk-go from 1.44.185 to 1.44.195 (#2738) 2023-02-06 23:29:18 +00:00
dependabot[bot]
ebb9dbbc67 build(deps): bump google.golang.org/grpc from 1.51.0 to 1.52.3 (#2736) 2023-02-03 23:35:25 +00:00
dependabot[bot]
c1f80e0c74 build(deps): bump go.opentelemetry.io/otel/exporters/jaeger (#2731) 2023-02-03 00:07:39 +00:00
dependabot[bot]
cbeb6d3c3c build(deps): bump go.opentelemetry.io/otel/sdk from 1.11.2 to 1.12.0 (#2732) 2023-02-02 23:41:50 +00:00
dependabot[bot]
e0dab229c0 build(deps): bump google.golang.org/api from 0.108.0 to 0.109.0 (#2730) 2023-02-02 23:25:16 +00:00
dependabot[bot]
015226c661 build(deps): bump go.opentelemetry.io/otel from 1.11.2 to 1.12.0 (#2719) 2023-02-02 06:46:34 +00:00
dependabot[bot]
8c4bb54e83 build(deps): bump github.com/klauspost/reedsolomon from 1.11.3 to 1.11.5 (#2707) 
Bumps [github.com/klauspost/reedsolomon](https://github.com/klauspost/reedsolomon) from 1.11.3 to 1.11.5.
- [Release notes](https://github.com/klauspost/reedsolomon/releases)
- [Commits](https://github.com/klauspost/reedsolomon/compare/v1.11.3...v1.11.5)

---
updated-dependencies:
- dependency-name: github.com/klauspost/reedsolomon
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-02-01 22:19:47 -08:00
Jarek Kowalski
e6612977b7 feat(server): improved server shutdown and integration tests (#2722) 
* feat(server): improved server shutdown and integration tests

Added `--shutdown-grace-period` flag to `kopia server start` command
which can be used to specify how long the server will wait for active
connections to finish before forcibly shutting down.

This allowed removal of final out-of-process execution of
during integration tests and the need for `integration-tests` target
which was running the same tests as `tests` but in out-of-process mode.

We thus now have all the test coverage in-process without having to
build and launch `kopia` binary.

* fixed logging

* increase test timeout

* speed up and/or parallelize longest-running tests
 2023-02-01 22:19:32 -08:00
dependabot[bot]
1075614f31 build(deps): bump github.com/golang-jwt/jwt/v4 from 4.4.2 to 4.4.3 (#2726) 
Bumps [github.com/golang-jwt/jwt/v4](https://github.com/golang-jwt/jwt) from 4.4.2 to 4.4.3.
- [Release notes](https://github.com/golang-jwt/jwt/releases)
- [Changelog](https://github.com/golang-jwt/jwt/blob/main/VERSION_HISTORY.md)
- [Commits](https://github.com/golang-jwt/jwt/compare/v4.4.2...v4.4.3)

---
updated-dependencies:
- dependency-name: github.com/golang-jwt/jwt/v4
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-02-01 20:48:25 -08:00
dependabot[bot]
65088ce750 build(deps-dev): bump concurrently from 7.4.0 to 7.6.0 in /app (#2723) 2023-02-01 23:35:13 +00:00
dependabot[bot]
b0c1e6d883 build(deps): bump cloud.google.com/go/storage from 1.28.1 to 1.29.0 (#2720) 2023-01-31 23:30:11 +00:00
dependabot[bot]
21e9528e96 build(deps): bump github.com/chromedp/chromedp from 0.8.6 to 0.8.7 (#2718) 2023-01-30 23:25:52 +00:00
dependabot[bot]
10157d5650 build(deps): bump github.com/minio/minio-go/v7 from 7.0.45 to 7.0.47 (#2711) 2023-01-30 20:19:21 +00:00
dependabot[bot]
3aa730bfc0 build(deps): bump github.com/fatih/color from 1.13.0 to 1.14.1 (#2710) 
Bumps [github.com/fatih/color](https://github.com/fatih/color) from 1.13.0 to 1.14.1.
- [Release notes](https://github.com/fatih/color/releases)
- [Commits](https://github.com/fatih/color/compare/v1.13.0...v1.14.1)

---
updated-dependencies:
- dependency-name: github.com/fatih/color
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-01-28 08:12:07 -08:00
budachst
632f35e464 feat(repository): increase GRPC maximum message size to 36 MiB (#2713) 
* Update grpc_repository_client.go

Try to increase GRPC API message size

* Update grpc_repository_client.go

* Update grpc_repository_client.go

Double size of GRPC messages to 4GB.

* Update grpc_repository_client.go

Testing regression against multiple remote kopia connections. Setting GRPC message size to 4GB causes the Kopia server to fail - trying a smaller message size.

* Update grpc_repository_client.go

Estimate a rise of 900KiB per month. Bumping the message size to 36 * 2^20 to be safe for the next year.
 2023-01-28 06:17:40 +00:00
dependabot[bot]
a0d4ed8498 build(deps): bump google.golang.org/api from 0.104.0 to 0.108.0 (#2708) 2023-01-23 23:39:29 +00:00
dependabot[bot]
2fdca551c1 build(deps): bump github.com/aws/aws-sdk-go from 1.44.157 to 1.44.185 (#2706) 2023-01-23 23:28:21 +00:00
Ali Dowair
e5387cec0a docs(cli): minor improvements to upgrade CLI usage/documentation (#2686) 
* feat(cli): print upgrade owner in repository status

To help users understand the state of their repository better, this one
line change also prints out the upgrade owner's ID in the output of
`kopia repository status`.

* Upgrade `create --format-version` help message

To show that there is now a format version 3 that can be set.
 2023-01-23 12:23:05 +03:00
Jarek Kowalski
97d9420b59 chore(ci): auto-merge (#2704) 2023-01-23 06:56:04 +00:00
dependabot[bot]
85d8e58997 build(deps): bump golang.org/x/crypto from 0.3.0 to 0.5.0 (#2677) 
Bumps [golang.org/x/crypto](https://github.com/golang/crypto) from 0.3.0 to 0.5.0.
- [Release notes](https://github.com/golang/crypto/releases)
- [Commits](https://github.com/golang/crypto/compare/v0.3.0...v0.5.0)

---
updated-dependencies:
- dependency-name: golang.org/x/crypto
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-01-22 22:29:44 -08:00
dependabot[bot]
7c03d1a94b build(deps): bump golang.org/x/net from 0.2.0 to 0.5.0 (#2676) 2023-01-21 17:18:28 +00:00
dependabot[bot]
00a3c9af5e build(deps): bump golang.org/x/term from 0.2.0 to 0.4.0 (#2678) 2023-01-21 16:31:58 +00:00
ashmrtn
fba94ff61e feat(snapshots): Return ReadCloser from StreamingFiles (#2692) 
* Return ReadCloser from StreamingFile

Allow better resource management by returning something that can be closed
when dealing with StreamingFiles.

* Close StreamingFile Reader during upload

* Use NopCloser on inputs that don't implement Close

Fixup callers of the StreamingFile API by wrapping regular Readers with
NopCloser calls where necessary.
 2023-01-21 16:02:57 +00:00
dependabot[bot]
532cb63f28 build(deps): bump uuid from 8.3.2 to 9.0.0 in /app (#2478) 
Bumps [uuid](https://github.com/uuidjs/uuid) from 8.3.2 to 9.0.0.
- [Release notes](https://github.com/uuidjs/uuid/releases)
- [Changelog](https://github.com/uuidjs/uuid/blob/main/CHANGELOG.md)
- [Commits](https://github.com/uuidjs/uuid/compare/v8.3.2...v9.0.0)

---
updated-dependencies:
- dependency-name: uuid
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-01-21 08:02:35 -08:00
Jarek Kowalski
f0d237fadb chore(ci): auto-merge dependabot PRs for golang.org/x/* (#2699) 2023-01-21 07:58:33 -08:00
dependabot[bot]
aa6422d347 build(deps): bump json5 from 2.2.1 to 2.2.3 in /app (#2687) 
Bumps [json5](https://github.com/json5/json5) from 2.2.1 to 2.2.3.
- [Release notes](https://github.com/json5/json5/releases)
- [Changelog](https://github.com/json5/json5/blob/main/CHANGELOG.md)
- [Commits](https://github.com/json5/json5/compare/v2.2.1...v2.2.3)

---
updated-dependencies:
- dependency-name: json5
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-01-21 07:39:05 -08:00
Edward Betts
1e97574391 fix(general): correct spelling mistakes (#2684) 2023-01-21 07:37:15 -08:00
ashmrtn
3bb7879a8c fix(snapshots): cached stream file size (#2690) 
* Properly populate file size for cached entries

StreamingFiles don't know their size until they are read. This leads to
entries marked with size 0 because size is not compared when determining
if something is cached or not as the size is sourced from the current
(unread) entry.

Instead, create the dir entry from the previous entry. As StreamingFile
do not allow setting file mode, permissions, owner, etc using the old
entry suffices.

* Use cached entry size for stats

Also use the cached entry size when calculating stats since
StreamingFile has 0 size.

* Update tests for cached files to check size

Check at least the total size of the snapshot is updated when handling
StreamingFiles.
 2023-01-20 14:07:39 -08:00
dependabot[bot]
ba938cf58c build(deps): bump go.opentelemetry.io/otel/sdk from 1.11.1 to 1.11.2 (#2664) 2022-12-29 23:25:24 +00:00
dependabot[bot]
1b781f1482 build(deps): bump go.opentelemetry.io/otel from 1.11.1 to 1.11.2 (#2639) 
Bumps [go.opentelemetry.io/otel](https://github.com/open-telemetry/opentelemetry-go) from 1.11.1 to 1.11.2.
- [Release notes](https://github.com/open-telemetry/opentelemetry-go/releases)
- [Changelog](https://github.com/open-telemetry/opentelemetry-go/blob/main/CHANGELOG.md)
- [Commits](https://github.com/open-telemetry/opentelemetry-go/compare/v1.11.1...v1.11.2)

---
updated-dependencies:
- dependency-name: go.opentelemetry.io/otel
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-12-29 19:52:47 +00:00
Bishop Clark
37d0e56e64 docs(site): Update README.md (#2657) 
'storages' isn't really a word.  It's like 'fetch' isn't an adjective.
 2022-12-28 20:47:01 +00:00
Jarek Kowalski
f8be8f6a56 refactor(repository): extract parts repo/content into packages (#2651) 
- repolog package
- blobcrypto package
- indexblob package

Minor cleanups:

- removed dead code
- introduced New*() methods for object construction
 2022-12-17 16:19:12 +00:00
Aaron Alpar
4c0fe390e1 feat(repository): new repository upgrade sub-command to validate indices. (#2561) 
* remove unused context param

* add index validation

* add test

* add command stub

* add comments. fixup.

* Update cli/command_repository_upgrade.go

Co-authored-by: Shikhar Mall <mall.shikhar.in@gmail.com>

* fixup bad merge

* add validation to command line

* set-parameter fixup

* move poison blob to commit

* fixups from PR comments

* fix bug for set-parameter

* robust commit-mode. add upgrade test

* fixup incorrect methods

* fixup for lint

* fixup for lint

* fixup named return values

* fixup failing test

* fixup lint

* fixup for lint

* Update repo/content/committed_read_manager.go

Co-authored-by: Nick <nick@kasten.io>

* Update repo/content/committed_read_manager.go

Co-authored-by: Nick <nick@kasten.io>

* use xor instead of fixed value

* lint fixups

* fixup for lint cyclomatic complexity

* fixup bad merge

* fixup set-parameters downgrade

* Update cli/command_repository_upgrade.go

Co-authored-by: Shikhar Mall <mall.shikhar.in@gmail.com>

* Update cli/command_repository_upgrade.go

Co-authored-by: Shikhar Mall <mall.shikhar.in@gmail.com>

* fixup set-parameters downgrade

* cleanup set-parameters test

* fixup tests, refactor for index verification

* fixups and clarity

* remove set-parameter downgrade check

* index on feat-k10-12441-B-validate-index: b63879cd Merge 'master' into feat-k10-12441-B-validate-index

* trigger build

* remove needless blank line

Co-authored-by: Shikhar Mall <mall.shikhar.in@gmail.com>
Co-authored-by: Nick <nick@kasten.io>
 2022-12-13 09:42:09 -08:00
dependabot[bot]
064f3a4648 build(deps): bump github.com/aws/aws-sdk-go from 1.44.155 to 1.44.157 (#2643) 2022-12-09 23:25:14 +00:00
dependabot[bot]
4173feeb9e build(deps): bump google.golang.org/api from 0.103.0 to 0.104.0 (#2641) 2022-12-08 23:27:00 +00:00
dependabot[bot]
bca66b1ffd build(deps): bump github.com/aws/aws-sdk-go from 1.44.143 to 1.44.155 (#2638) 2022-12-07 23:38:23 +00:00
Shikhar Mall
c5b8510ba3 fix(general): prevent storage retries on ESTALE errors (#2628) 
* fix(general): prevent retries on ESTALE errors

* adding missing imports

* silent the linter for platform specific code

Co-authored-by: Shikhar Mall <small@kopia.io>
 2022-12-06 21:49:35 -08:00
dependabot[bot]
bdb91a40e4 build(deps): bump github.com/pkg/profile from 1.6.0 to 1.7.0 (#2555) 
Bumps [github.com/pkg/profile](https://github.com/pkg/profile) from 1.6.0 to 1.7.0.
- [Release notes](https://github.com/pkg/profile/releases)
- [Commits](https://github.com/pkg/profile/compare/v1.6.0...v1.7.0)

---
updated-dependencies:
- dependency-name: github.com/pkg/profile
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-12-06 20:01:07 -08:00
dependabot[bot]
dba94ebf6e build(deps): bump golang.org/x/sys from 0.2.0 to 0.3.0 (#2630) 
Bumps [golang.org/x/sys](https://github.com/golang/sys) from 0.2.0 to 0.3.0.
- [Release notes](https://github.com/golang/sys/releases)
- [Commits](https://github.com/golang/sys/compare/v0.2.0...v0.3.0)

---
updated-dependencies:
- dependency-name: golang.org/x/sys
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-12-06 20:00:44 -08:00
lciti
37d64afc21 fix(snapshots): Partly fix #544 by supporting setuid/setgid/sticky bits when snapshotting, restoring and fuse-mounting. (#2597) 
Also modified an end-to-end test to also check that these extra mode flags work when snapshotting+restoring.
Manually tested fuse-mount.

Co-authored-by: Luca Citi <lciti@ieee.org>
 2022-12-07 03:26:29 +00:00
Muescha
0e09e1a13f add homebrew installation for kopiaui (#2627) 2022-12-06 19:05:59 -08:00
dependabot[bot]
759b8a3480 build(deps): bump go.uber.org/zap from 1.23.0 to 1.24.0 (#2631) 
Bumps [go.uber.org/zap](https://github.com/uber-go/zap) from 1.23.0 to 1.24.0.
- [Release notes](https://github.com/uber-go/zap/releases)
- [Changelog](https://github.com/uber-go/zap/blob/master/CHANGELOG.md)
- [Commits](https://github.com/uber-go/zap/compare/v1.23.0...v1.24.0)

---
updated-dependencies:
- dependency-name: go.uber.org/zap
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-12-06 19:05:43 -08:00
Aaron Alpar
ca7df80e64 fix(cli): do not allow index downgrade by using set-parameter (#2629) 
* disallow downgrades

* fixup merge
 2022-12-06 18:33:55 -08:00
dependabot[bot]
04fcedad12 build(deps): bump github.com/klauspost/reedsolomon from 1.11.2 to 1.11.3 (#2610) 
Bumps [github.com/klauspost/reedsolomon](https://github.com/klauspost/reedsolomon) from 1.11.2 to 1.11.3.
- [Release notes](https://github.com/klauspost/reedsolomon/releases)
- [Commits](https://github.com/klauspost/reedsolomon/compare/v1.11.2...v1.11.3)

---
updated-dependencies:
- dependency-name: github.com/klauspost/reedsolomon
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-12-04 20:57:07 -08:00
Jarek Kowalski
c2cc25c504 feat(repository): added internal/metricid package (#2626) 
This manages mapping of metric names to IDs which allows efficient JSON
representation of counter values for each set of metrics where
only values are in the index order.

This will be used in the telemetry protocol and for storing counters in
the repository.

Added test that ensures all metrics registered in a repository have
the corresponding mapping.
 2022-12-05 04:41:42 +00:00
Jarek Kowalski
0828eb2900 feat(repository): added OnSuccessfulFlush() (#2623) 2022-12-03 23:28:29 +00:00
dependabot[bot]
5463fb7e1b build(deps-dev): bump playwright from 1.26.1 to 1.28.1 in /app (#2615) 2022-12-03 20:17:45 +00:00
dependabot[bot]
3b7fbf294d build(deps): bump cloud.google.com/go/storage from 1.28.0 to 1.28.1 (#2619) 2022-12-03 20:15:58 +00:00