mirror/kopia
1
0
Fork 0
mirror of https://github.com/kopia/kopia.git synced 2026-05-14 17:56:59 -04:00
Code Issues Packages Projects Releases Wiki Activity
3,660 Commits 6 Branches 89 Tags
1c5c4e256839dabec00eb86ee4801dfd198efe4c
Commit Graph

3660 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Jarek Kowalski
80423cf5f6 feat(server): fixed server logging file & console (#3262) 
Previously some logs from a running server were only kept in memory
(including storage activity logs) which was confusing to many folks.

This changes the behavior so that logs are sent to their regular
(console/file) file locations in addition to the UI tasks.

Old behavior can be restored by adding `--no-persistent-logs` to
server.
 2023-09-02 18:10:18 -07:00
dependabot[bot]
8df0e07e99 build(deps-dev): bump the kopia-ui-npm-dependencies group (#3261) 
Bumps the kopia-ui-npm-dependencies group in /app with 4 updates: [@playwright/test](https://github.com/Microsoft/playwright), [concurrently](https://github.com/open-cli-tools/concurrently), [electron](https://github.com/electron/electron) and [playwright](https://github.com/Microsoft/playwright).


Updates `@playwright/test` from 1.36.2 to 1.37.1
- [Release notes](https://github.com/Microsoft/playwright/releases)
- [Commits](https://github.com/Microsoft/playwright/compare/v1.36.2...v1.37.1)

Updates `concurrently` from 8.2.0 to 8.2.1
- [Release notes](https://github.com/open-cli-tools/concurrently/releases)
- [Commits](https://github.com/open-cli-tools/concurrently/compare/v8.2.0...v8.2.1)

Updates `electron` from 25.3.2 to 26.1.0
- [Release notes](https://github.com/electron/electron/releases)
- [Changelog](https://github.com/electron/electron/blob/main/docs/breaking-changes.md)
- [Commits](https://github.com/electron/electron/compare/v25.3.2...v26.1.0)

Updates `playwright` from 1.36.2 to 1.37.1
- [Release notes](https://github.com/Microsoft/playwright/releases)
- [Commits](https://github.com/Microsoft/playwright/compare/v1.36.2...v1.37.1)

---
updated-dependencies:
- dependency-name: "@playwright/test"
  dependency-type: direct:development
  update-type: version-update:semver-minor
  dependency-group: kopia-ui-npm-dependencies
- dependency-name: concurrently
  dependency-type: direct:development
  update-type: version-update:semver-patch
  dependency-group: kopia-ui-npm-dependencies
- dependency-name: electron
  dependency-type: direct:development
  update-type: version-update:semver-major
  dependency-group: kopia-ui-npm-dependencies
- dependency-name: playwright
  dependency-type: direct:development
  update-type: version-update:semver-minor
  dependency-group: kopia-ui-npm-dependencies
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-09-02 16:04:53 -07:00
Jarek Kowalski
20928258d6 test(general): fixed TestOnNthCompletion test flake, which was 1-5/10000 runs (#3263) 2023-09-02 16:04:36 -07:00
Julio Lopez
1320f0c8e8 chore(general): remove unnecessary //nolint directives (#3256) 2023-08-29 12:40:40 -07:00
Julio Lopez
d637814a5a chore(ci): add govulncheck step to lint workflow (#3252) 2023-08-27 23:53:18 -07:00
Jarek Kowalski
fe55dcb6a2 feat(repository): added hard size limit to the on-disk cache (#3238) 
* test(providers): added capacity limits to blobtesting.mapStorage

* refactor(general): added mutex map which dynamically allocates and releases named mutexes

* refactor(repository): refactored cache cleanup and limit enforcement

* refactor(repository): plumb through cache size limits in the repository

* feat(cli): added CLI options to set cache size limits

* unified flag setting and field naming

* Update cli/command_cache_set.go

Co-authored-by: Shikhar Mall <mall.shikhar.in@gmail.com>

* pr feedback

---------

Co-authored-by: Shikhar Mall <mall.shikhar.in@gmail.com>
 2023-08-24 09:38:56 -07:00
Julio Lopez
1fd1ff0151 chore(ci): add page with workflow status badges for quick reference (#3248) 2023-08-23 17:38:07 -07:00
Le Tran
cde557b0bf feat(providers): allow other GCS OAuth2.0 credential types (#3064) 
Change google client to accept more credentials type, including json config file for workload identity federation
Refactor tokenSourceFromCredentialsFile to remove duplicate code
Add unit tests

---------

Co-authored-by: Le Tran <le.tran@kasten.io>
Co-authored-by: Julio Lopez <1953782+julio-lopez@users.noreply.github.com>
 2023-08-23 16:29:44 -07:00
Julio Lopez
49621f6a44 fix(general): add checklocks annotation (#3247) 2023-08-23 16:26:08 -07:00
Vaibhav Kamra
2f1a63f47d feat(repository): allow configuring auto compaction count (#3240) 2023-08-23 15:38:06 -07:00
Jarek Kowalski
1120e4f629 chore(ci): reenable check-locks after the fix was merged upstream (#3245) 2023-08-22 19:41:03 -07:00
ashmrtn
42c251f4da Add options struct to test helper (#3244) 
Use an options struct to make it more obvious when tests are running
with read only storage.
 2023-08-23 00:00:53 +00:00
ashmrtn
af08a41222 fix(repository): Disable manifest manager compaction when in read-only mode (#3226) 
* Thread ReadOnly option to manifest manager

Don't allow attempting to compact manifests if the repo was opened
read-only.

* Add test for disabling compaction in readonly mode

* Allow content manager to say if it's readonly

This can be leveraged by higher layers to determine if they should
attempt operations such as manifest compaction.

* Rework manifest compaction checks

Use whether the content manager is in read-only mode to help determine
if manifests should be compacted or not.
 2023-08-21 17:55:39 -07:00
dependabot[bot]
17c7e45c3d build(deps): bump the common-golang-dependencies group with 4 updates (#3242) 
Bumps the common-golang-dependencies group with 4 updates: [cloud.google.com/go/storage](https://github.com/googleapis/google-cloud-go), [github.com/Azure/azure-sdk-for-go/sdk/azidentity](https://github.com/Azure/azure-sdk-for-go), [github.com/minio/minio-go/v7](https://github.com/minio/minio-go) and [google.golang.org/api](https://github.com/googleapis/google-api-go-client).


Updates `cloud.google.com/go/storage` from 1.31.0 to 1.32.0
- [Release notes](https://github.com/googleapis/google-cloud-go/releases)
- [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md)
- [Commits](https://github.com/googleapis/google-cloud-go/compare/pubsub/v1.31.0...pubsub/v1.32.0)

Updates `github.com/Azure/azure-sdk-for-go/sdk/azidentity` from 1.3.0 to 1.3.1
- [Release notes](https://github.com/Azure/azure-sdk-for-go/releases)
- [Changelog](https://github.com/Azure/azure-sdk-for-go/blob/main/documentation/release.md)
- [Commits](https://github.com/Azure/azure-sdk-for-go/compare/sdk/azcore/v1.3.0...sdk/azcore/v1.3.1)

Updates `github.com/minio/minio-go/v7` from 7.0.61 to 7.0.62
- [Release notes](https://github.com/minio/minio-go/releases)
- [Commits](https://github.com/minio/minio-go/compare/v7.0.61...v7.0.62)

Updates `google.golang.org/api` from 0.137.0 to 0.138.0
- [Release notes](https://github.com/googleapis/google-api-go-client/releases)
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md)
- [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.137.0...v0.138.0)

---
updated-dependencies:
- dependency-name: cloud.google.com/go/storage
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: common-golang-dependencies
- dependency-name: github.com/Azure/azure-sdk-for-go/sdk/azidentity
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: common-golang-dependencies
- dependency-name: github.com/minio/minio-go/v7
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: common-golang-dependencies
- dependency-name: google.golang.org/api
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: common-golang-dependencies
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-08-22 00:40:42 +00:00
dependabot[bot]
f37632b428 build(deps): bump github.com/google/uuid from 1.3.0 to 1.3.1 (#3243) 
Bumps [github.com/google/uuid](https://github.com/google/uuid) from 1.3.0 to 1.3.1.
- [Release notes](https://github.com/google/uuid/releases)
- [Changelog](https://github.com/google/uuid/blob/master/CHANGELOG.md)
- [Commits](https://github.com/google/uuid/compare/v1.3.0...v1.3.1)

---
updated-dependencies:
- dependency-name: github.com/google/uuid
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-08-21 17:31:40 -07:00
ashmrtn
b57d16d4a7 fix(repository): skip epoch compaction and advancement on read-only storage (#3225) 
* Set epoch manager not to compact if readonly

Thread read-only parameter through the stack and make use of it when
loading epochs.

* Add test for manager read-only mode

Uses a bit of a contrived setup, but the state used in the test is
possible to reach given the right set of conditions and can cause the
manager to get stuck trying to refresh.

* Pull read-only status from Storage provider
 2023-08-21 15:29:13 -07:00
ashmrtn
29320a7c33 refactor(providers): Create default provider that has common functions (#3241) 
* Rename UnsupportedBlobRetention struct

Rename this struct to DefaultProviderImplementation in preparation for
adding other simple "default" functionality to it.

* Add other functions to default provider

Add other simple function implementations to the default provider so
that other providers can just embed this to get basic behavior.

* Cleanup existing users of default provider

* Add default provider to remaining storage types

Add the default provider to remaining storage providers and remove
functions that are now implemented by the default provider.
 2023-08-21 15:27:15 -07:00
ashmrtn
08c58d53b6 feat(providers): Create IsReadOnly API for blob storage (#3230) 
* Add new blob.Storage call to see if it's readonly

Return whether the storage is readonly so higher layers in the stack can
selectively disable some functionality if needed, like compaction.

Co-authored-by: Julio Lopez <1953782+julio-lopez@users.noreply.github.com>
 2023-08-21 17:00:50 +00:00
PhracturedBlue
9237b29023 feat(server): add server support for unix domain sockets (#3216) 
* Add server support for unix domain sockets

* Ensure socket path < 104 bytes for UDS test
 2023-08-20 17:17:20 -07:00
Jarek Kowalski
a12f81bb6f chore(ci): upgraded linter to 1.54.0 (#3239) 2023-08-20 17:00:32 -07:00
Jarek Kowalski
d8461049bb chore(ci): notarization fix (#3237) 2023-08-19 19:38:18 -07:00
Jarek Kowalski
986e7df449 fix(ci): fixed notarization, switched to using API keys (#3236) 2023-08-19 19:31:09 -07:00
Nicolai Weitkemper
5786ba03ef docs(site): fix typo "maintence" (#3234) 2023-08-19 18:50:36 -07:00
Jarek Kowalski
7eca44993f feat(providers): improve performance of SFTP uploads (#3235) 
This improves the performance of gather writes (p and q blobs) in
particular on high-latency links by reducing round-trips.

Tested by uploading Kopia working directory
(3 GB, files:32157 dirs:6051) to SFTP server on LAN (TrueNAS) over WiFi:

Before: 2m4s (~24 MB/s)
After: 1m13s (~41 MB/s)
 2023-08-19 18:07:43 -07:00
ashmrtn
bb27e3147e test(repository): More precise check for retention in tests (#3220) 
* Store and return retention info in test storage

Add a new interface and function that allows getting retention
information during testing. This allows for more exact comparisons about
retention duration and mode in tests.

* Fixup how blobtesting retention extension works

Use the clock instead of the object's mod time so that extensions are
from the "current time." This aligns with how the S3 blob storage
functions.

* Update retention tests to use more precise checks

Where possible, use the information returned by GetRetention in tests
that deal with retention information. This allows for more precise
comparions of retention duration and mode instead of indirectly testing
duration by advancing the clock and attempting to modify blobs.
 2023-08-15 16:53:27 +00:00
Wenkai Yin(尹文开)
ad0b370c49 feat(providers): support for auth with Azure AD (#3131) 
Add support for auth with Azure AD

Ref #2800

Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
Co-authored-by: Julio Lopez <1953782+julio-lopez@users.noreply.github.com>
 2023-08-14 21:05:34 -07:00
dependabot[bot]
038086c1b5 build(deps): bump github.com/pkg/sftp from 1.13.5 to 1.13.6 (#3222) 
Bumps [github.com/pkg/sftp](https://github.com/pkg/sftp) from 1.13.5 to 1.13.6.
- [Release notes](https://github.com/pkg/sftp/releases)
- [Commits](https://github.com/pkg/sftp/compare/v1.13.5...v1.13.6)

---
updated-dependencies:
- dependency-name: github.com/pkg/sftp
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-08-14 19:21:15 -07:00
dependabot[bot]
a04ef8effc build(deps): bump the common-golang-dependencies group with 2 updates (#3221) 
Bumps the common-golang-dependencies group with 2 updates: [github.com/Azure/azure-sdk-for-go/sdk/azcore](https://github.com/Azure/azure-sdk-for-go) and [google.golang.org/api](https://github.com/googleapis/google-api-go-client).


Updates `github.com/Azure/azure-sdk-for-go/sdk/azcore` from 1.7.0 to 1.7.1
- [Release notes](https://github.com/Azure/azure-sdk-for-go/releases)
- [Changelog](https://github.com/Azure/azure-sdk-for-go/blob/main/documentation/release.md)
- [Commits](https://github.com/Azure/azure-sdk-for-go/compare/sdk/azcore/v1.7.0...sdk/azcore/v1.7.1)

Updates `google.golang.org/api` from 0.135.0 to 0.137.0
- [Release notes](https://github.com/googleapis/google-api-go-client/releases)
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md)
- [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.135.0...v0.137.0)

---
updated-dependencies:
- dependency-name: github.com/Azure/azure-sdk-for-go/sdk/azcore
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: common-golang-dependencies
- dependency-name: google.golang.org/api
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: common-golang-dependencies
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-08-14 19:20:46 -07:00
ashmrtn
21789ec9a4 fix(repository): Storage config blob caching (#3192) 
* Fix caching issue of storage blob config blob
* Add tests to ensure retention is set during config

Ensure retention is properly set when either changing retention options
or initializing the repo with retention.
 2023-08-11 20:36:48 -07:00
Julio Lopez
0a16623705 refactor(general): rename cache variable in test (#3211) 
It avoids a package name shadowing and linting errors in an upcoming PR.

Co-authored-by: Ashlie Martinez <ashmrtnz@alcion.ai>
 2023-08-11 11:33:40 -07:00
Julio Lopez
22cba7003d refactor(cli): minor nits for observability flags (#3209) 
Create directory in `.startMetrics` function.
Store file name prefix for metrics instead of final name.
 2023-08-10 23:30:07 -07:00
John Veness
82c83d92ac docs(site): change wording for storage provider choice (#3206) 
---------

Co-authored-by: Julio Lopez <1953782+julio-lopez@users.noreply.github.com>
 2023-08-11 05:48:43 +00:00
Julio Lopez
8b8d4a574b feat(cli): save observability metric before exiting the process (#3201) 
Objective: to facilitate capturing metrics for relatively short-lived kopia
executions.

Motivation: Currently, kopia allows a. exposing metrics via a Prometheus
exporter; and b. pushing metrics to a Prometheus gateway. In certain
scenarios, such as short lived executions, it is not possible to reliably
scrape the metrics from the exporter endpoint. And, while the pusher
approach would work, it requires starting a separate push gateway.

This change allows saving the metrics to a local file before kopia exists
by specifying the metrics output directory. For example,

`kopia --metrics-directory /tmp/kopia-metrics/ snapshot create ....`

In this case, after kopia exists, the `/tmp/kopia-metrics/` directory will
contain a file with a named of the form:
`<date>-<time>-<command_subcommand>.prom`
 2023-08-10 00:40:45 +00:00
Julio Lopez
36b84edf42 fix(infra): add timeout for make.yml build.Build step (#3202) 
Currently, on MacOS, this step hangs when attempting to notarize
the newly built binary. The job eventually times out after 360 min.

This is a temporary workaround that will terminate the job sooner to avoid
wasting runner cycles. The actual cause of the notarization timeout needs to be
investigated.

Ref: #488 #3168 #3175
 2023-08-07 22:07:47 -07:00
dependabot[bot]
705ab5df96 build(deps): bump the common-golang-dependencies group with 4 updates (#3198) 
Bumps the common-golang-dependencies group with 4 updates: [golang.org/x/crypto](https://github.com/golang/crypto), [golang.org/x/net](https://github.com/golang/net), [golang.org/x/oauth2](https://github.com/golang/oauth2) and [google.golang.org/api](https://github.com/googleapis/google-api-go-client).


Updates `golang.org/x/crypto` from 0.11.0 to 0.12.0
- [Commits](https://github.com/golang/crypto/compare/v0.11.0...v0.12.0)

Updates `golang.org/x/net` from 0.12.0 to 0.14.0
- [Commits](https://github.com/golang/net/compare/v0.12.0...v0.14.0)

Updates `golang.org/x/oauth2` from 0.10.0 to 0.11.0
- [Commits](https://github.com/golang/oauth2/compare/v0.10.0...v0.11.0)

Updates `google.golang.org/api` from 0.134.0 to 0.135.0
- [Release notes](https://github.com/googleapis/google-api-go-client/releases)
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md)
- [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.134.0...v0.135.0)

---
updated-dependencies:
- dependency-name: golang.org/x/crypto
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: common-golang-dependencies
- dependency-name: golang.org/x/net
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: common-golang-dependencies
- dependency-name: golang.org/x/oauth2
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: common-golang-dependencies
- dependency-name: google.golang.org/api
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: common-golang-dependencies
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-08-08 04:53:56 +00:00
dependabot[bot]
d2ecac3bd4 build(deps): bump go.uber.org/zap from 1.24.0 to 1.25.0 (#3199) 
Bumps [go.uber.org/zap](https://github.com/uber-go/zap) from 1.24.0 to 1.25.0.
- [Release notes](https://github.com/uber-go/zap/releases)
- [Changelog](https://github.com/uber-go/zap/blob/master/CHANGELOG.md)
- [Commits](https://github.com/uber-go/zap/compare/v1.24.0...v1.25.0)

---
updated-dependencies:
- dependency-name: go.uber.org/zap
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-08-07 21:15:08 -07:00
dependabot[bot]
0aee9442a7 build(deps): bump github.com/chromedp/chromedp from 0.9.1 to 0.9.2 (#3200) 2023-08-08 00:09:39 +00:00
Julio Lopez
9f33f70eaa refactor(cli): break down observability.startMetrics() (#3196) 
Motivation: reduce the function complexity for the linter, so additional
functionality can be added to `startMetrics()`

No functional changes.

Changes and transformations:
- Break down observability.startMetrics() into: maybeStartListener().
  maybeStartMetricsPusher() and maybeStartTraceExporter().
- Inline observabilityFlags.getExporter in maybeStartTraceExporter.
- Only create resource when exporter is non-nil.
- Simplify maybeStartListener: reduce indentation by returning early.
- Simplify maybeStartMetricsPusher: reduce indentation by returning early.
 2023-08-06 11:44:31 -07:00
Redge
0d2a7c83a0 Update Dockerfile to install tzdata (#3191) 
This patch the issue #2311 
The package tzdata is missing in the Docker image.
 2023-08-04 20:37:14 -07:00
Julio Lopez
8246c2f177 chore(cli): correct typo in blob stats command (#3194) 2023-08-03 17:32:51 -07:00
Julio Lopez
bb7affebda fix(general): change cache full logging frequency & message (#3193) 
fix(general): change cache full logging frequency to once every 10 minutes
Addresses concerns about too many messages in the logs (#3085)

fix(general): avoid logging cache key.
Instead log the cache description, which provides information about
the types of contents being cached.

Followups to #3085
 2023-08-03 20:27:23 +00:00
NickIAm
a9c5a993c8 fix(cli): prevent duplicate snapshots when --all and a source path are given (#3067) 
Adds a check for snapshot create when --all and a source path are
given simultaneously. Returns an error in this case since it would
otherwise create a  duplicate snapshot for the specified source path.

---

Co-authored-by: Julio Lopez <1953782+julio-lopez@users.noreply.github.com>
 2023-08-03 17:36:10 +00:00
Aurélien Rouëné
e98eb371ed fix(cli): log cache full when on debug level (#3085) 
Should help fixing #3059
 2023-08-03 17:30:28 +00:00
Christoph Anderson
5663728ba7 fix(ui): fixed error counter reported on task level (#3190) 
Co-authored-by: lupusA <lupuapps@gmail.com>
 2023-08-03 09:29:26 -07:00
Minyi Zou
a620349db8 test(general): add crash consistency test to validate repository consistency when kopia stops abruptly (#3142) 
* test(general): add tests for crash consistency in robustness feature

* test(general): add GenerateRandomFiles function

* test(general): rename tests for crash consistency in robustness feature

* Update tests/recovery/blobmanipulator/blobmanipulator.go

Co-authored-by: Shikhar Mall <mall.shikhar.in@gmail.com>

* Update tests/robustness/crash_consistency_test/crash_consistency_test.go

Co-authored-by: Shikhar Mall <mall.shikhar.in@gmail.com>

* test(general): add tool for crash consistency job for automatic test

* test(general): fix mistakes followed by comments

* test(general): modify Makefile with new tests

* test(general): delete absolute path

* test(general): crash consistency job make target change

* test: test in server

* test: set as local dir

* test: print log

* test: update dst path

* test(general): refactor test cases and tools

* test(general): reduce unused code

* test(general): fix bug

* test: append logs for testing

* test: remove deleted blob code

* test: handle cannot open issue

* test: remove kopia password relevant code

* test: add numbers of test and set parallel in test case

* test: block goroutine

* test: add test files

* test: refactor test tools

* test: add filter

* test: refactor file structure

* test: remove unused test job and relocate the filehandler

* test: fix error

* test: fix followed by comments

* fix: fix go lint problems

* Update tests/recovery/recovery_test/recovery_test.go

Co-authored-by: Shikhar Mall <mall.shikhar.in@gmail.com>

* fix: fix error followed by comments

* chore: don't change previous code

* chore: don't change previous code

* test: remove unused stdoutpipe

* no error print for kill -9 case

* Instead of writing your own comparison, you can use the directory comparator from the Kopia's internal diff module

* remove mu and err out

* remove error code

* Update tests/recovery/blobmanipulator/blobmanipulator.go

Co-authored-by: Shikhar Mall <mall.shikhar.in@gmail.com>

* remove useless code

---------

Co-authored-by: Minyi Zou <minyi.zou@kasten.io>
Co-authored-by: Shikhar Mall <mall.shikhar.in@gmail.com>
Co-authored-by: chaitalisg <chaitali@kasten.io>
 2023-08-02 15:54:14 -07:00
dependabot[bot]
214aa7d81d build(deps): bump the kopia-ui-npm-dependencies group (#3188) 
Bumps the kopia-ui-npm-dependencies group in /app with 5 updates:

| Package | Update |
| --- | --- |
| [electron-updater](https://github.com/electron-userland/electron-builder/tree/HEAD/packages/electron-updater) | 6.1.3 to 6.1.4 |
| [@playwright/test](https://github.com/Microsoft/playwright) | 1.36.1 to 1.36.2 |
| [electron](https://github.com/electron/electron) | 25.3.1 to 25.3.2 |
| [electron-builder](https://github.com/electron-userland/electron-builder/tree/HEAD/packages/electron-builder) | 24.4.0 to 24.6.3 |
| [playwright](https://github.com/Microsoft/playwright) | 1.36.1 to 1.36.2 |


Updates `electron-updater` from 6.1.3 to 6.1.4
- [Release notes](https://github.com/electron-userland/electron-builder/releases)
- [Changelog](https://github.com/electron-userland/electron-builder/blob/master/packages/electron-updater/CHANGELOG.md)
- [Commits](https://github.com/electron-userland/electron-builder/commits/electron-updater@6.1.4/packages/electron-updater)

Updates `@playwright/test` from 1.36.1 to 1.36.2
- [Release notes](https://github.com/Microsoft/playwright/releases)
- [Commits](https://github.com/Microsoft/playwright/compare/v1.36.1...v1.36.2)

Updates `electron` from 25.3.1 to 25.3.2
- [Release notes](https://github.com/electron/electron/releases)
- [Changelog](https://github.com/electron/electron/blob/main/docs/breaking-changes.md)
- [Commits](https://github.com/electron/electron/compare/v25.3.1...v25.3.2)

Updates `electron-builder` from 24.4.0 to 24.6.3
- [Release notes](https://github.com/electron-userland/electron-builder/releases)
- [Changelog](https://github.com/electron-userland/electron-builder/blob/master/packages/electron-builder/CHANGELOG.md)
- [Commits](https://github.com/electron-userland/electron-builder/commits/v24.6.3/packages/electron-builder)

Updates `playwright` from 1.36.1 to 1.36.2
- [Release notes](https://github.com/Microsoft/playwright/releases)
- [Commits](https://github.com/Microsoft/playwright/compare/v1.36.1...v1.36.2)

---
updated-dependencies:
- dependency-name: electron-updater
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: kopia-ui-npm-dependencies
- dependency-name: "@playwright/test"
  dependency-type: direct:development
  update-type: version-update:semver-patch
  dependency-group: kopia-ui-npm-dependencies
- dependency-name: electron
  dependency-type: direct:development
  update-type: version-update:semver-patch
  dependency-group: kopia-ui-npm-dependencies
- dependency-name: electron-builder
  dependency-type: direct:development
  update-type: version-update:semver-minor
  dependency-group: kopia-ui-npm-dependencies
- dependency-name: playwright
  dependency-type: direct:development
  update-type: version-update:semver-patch
  dependency-group: kopia-ui-npm-dependencies
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-08-01 21:37:48 -07:00
dependabot[bot]
331123e67e build(deps): bump the common-golang-dependencies group with 2 updates (#3186) 
Bumps the common-golang-dependencies group with 2 updates: [google.golang.org/api](https://github.com/googleapis/google-api-go-client) and [google.golang.org/grpc](https://github.com/grpc/grpc-go).


Updates `google.golang.org/api` from 0.133.0 to 0.134.0
- [Release notes](https://github.com/googleapis/google-api-go-client/releases)
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md)
- [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.133.0...v0.134.0)

Updates `google.golang.org/grpc` from 1.56.2 to 1.57.0
- [Release notes](https://github.com/grpc/grpc-go/releases)
- [Commits](https://github.com/grpc/grpc-go/compare/v1.56.2...v1.57.0)

---
updated-dependencies:
- dependency-name: google.golang.org/api
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: common-golang-dependencies
- dependency-name: google.golang.org/grpc
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: common-golang-dependencies
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-07-31 18:07:18 -07:00
Jarek Kowalski
e512731d72 chore(ci): switched to @electron/notarize (#3175) 2023-07-29 13:10:57 -07:00
Shikhar Mall
e1c44f7b2b feat(cli): new storage config input from file when creating a repo (#2756) 
* feat(cli): new storage config input from file when creating a repo

* feat(cli): allow token from stdin

* fix(cli): improve code coverage

---------

Co-authored-by: Shikhar Mall <small@kopia.io>
 2023-07-27 14:41:23 -07:00
Jarek Kowalski
83b88d8bbf chore(ci): fixes for ARM64 runner on AWS (#3179) 
- fixed directory iteration order
- reduced providervalidation memory usage
- disabled one test case of TestSnapshotSparseRestore
  (filed https://github.com/kopia/kopia/issues/3178 to fix)
 2023-07-27 11:30:40 -07:00