mirror/kopia
1
0
Fork 0
mirror of https://github.com/kopia/kopia.git synced 2026-05-16 02:34:10 -04:00
Code Issues Packages Projects Releases Wiki Activity
3,660 Commits 6 Branches 89 Tags
1c5c4e256839dabec00eb86ee4801dfd198efe4c
Commit Graph

3660 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Jarek Kowalski
09c1489be4 fix(ci): add rclone binaries to the list of artifacts (#1719) 2022-02-02 21:53:39 -08:00
dependabot[bot]
77d9bba1a3 build(deps): bump github.com/prometheus/client_golang (#1716) 
Bumps [github.com/prometheus/client_golang](https://github.com/prometheus/client_golang) from 1.11.0 to 1.12.1.
- [Release notes](https://github.com/prometheus/client_golang/releases)
- [Changelog](https://github.com/prometheus/client_golang/blob/main/CHANGELOG.md)
- [Commits](https://github.com/prometheus/client_golang/compare/v1.11.0...v1.12.1)

---
updated-dependencies:
- dependency-name: github.com/prometheus/client_golang
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-02-02 21:27:21 -08:00
Jarek Kowalski
d3edab594e build(ci): added rclone 1.57.0 to Docker container images (#1718) 
* build(ci): added rclone 1.57.0 to Docker container images

/bin/rclone is configured to use config in /app/rclone/rclone.conf
so the user can pass -v ~/.config/rclone:/app/rclone

* pr feedback
 2022-02-02 21:06:43 -08:00
dependabot[bot]
e56cf3ce50 build(deps): bump cloud.google.com/go/storage from 1.18.2 to 1.19.0 (#1714) 
Bumps [cloud.google.com/go/storage](https://github.com/googleapis/google-cloud-go) from 1.18.2 to 1.19.0.
- [Release notes](https://github.com/googleapis/google-cloud-go/releases)
- [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md)
- [Commits](https://github.com/googleapis/google-cloud-go/compare/storage/v1.18.2...spanner/v1.19.0)

---
updated-dependencies:
- dependency-name: cloud.google.com/go/storage
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-02-02 21:06:14 -08:00
dependabot[bot]
d6cc776d93 build(deps): bump github.com/google/go-cmp from 0.5.6 to 0.5.7 (#1708) 
Bumps [github.com/google/go-cmp](https://github.com/google/go-cmp) from 0.5.6 to 0.5.7.
- [Release notes](https://github.com/google/go-cmp/releases)
- [Commits](https://github.com/google/go-cmp/compare/v0.5.6...v0.5.7)

---
updated-dependencies:
- dependency-name: github.com/google/go-cmp
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-02-02 20:53:27 -08:00
Shikhar Mall
63bedd3446 feat(cli): allow changing retention parameters from CLI (#1680) 
Co-authored-by: Shikhar Mall <small@kopia.io>
 2022-02-02 19:04:22 -08:00
Jarek Kowalski
e15852af41 test(cli): fixed test flake in TestServerControl (#1717) 2022-02-02 18:44:48 -08:00
Onkar Bhat
6f55e65cbd feat(providers): treat token expiration errors as non-retryable (#1675) 
Token expiration errors should be treated as non-retryable errors.
 2022-02-02 17:38:32 -08:00
dependabot[bot]
38984b806e build(deps): bump github.com/klauspost/compress from 1.13.6 to 1.14.2 (#1704) 
Bumps [github.com/klauspost/compress](https://github.com/klauspost/compress) from 1.13.6 to 1.14.2.
- [Release notes](https://github.com/klauspost/compress/releases)
- [Changelog](https://github.com/klauspost/compress/blob/master/.goreleaser.yml)
- [Commits](https://github.com/klauspost/compress/compare/v1.13.6...v1.14.2)

---
updated-dependencies:
- dependency-name: github.com/klauspost/compress
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-02-02 07:52:27 -08:00
dependabot[bot]
bd2143f716 build(deps): bump github.com/sanity-io/litter from 1.5.1 to 1.5.2 (#1709) 
Bumps [github.com/sanity-io/litter](https://github.com/sanity-io/litter) from 1.5.1 to 1.5.2.
- [Release notes](https://github.com/sanity-io/litter/releases)
- [Changelog](https://github.com/sanity-io/litter/blob/main/CHANGELOG.md)
- [Commits](https://github.com/sanity-io/litter/compare/v1.5.1...v1.5.2)

---
updated-dependencies:
- dependency-name: github.com/sanity-io/litter
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-02-02 07:51:54 -08:00
dependabot[bot]
f89849a857 build(deps): bump electron-log from 4.4.4 to 4.4.5 in /app (#1700) 
Bumps [electron-log](https://github.com/megahertz/electron-log) from 4.4.4 to 4.4.5.
- [Release notes](https://github.com/megahertz/electron-log/releases)
- [Changelog](https://github.com/megahertz/electron-log/blob/master/CHANGELOG.md)
- [Commits](https://github.com/megahertz/electron-log/compare/v4.4.4...v4.4.5)

---
updated-dependencies:
- dependency-name: electron-log
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-02-02 07:40:17 -08:00
dependabot[bot]
c6b86debc2 build(deps): bump github.com/zeebo/blake3 from 0.2.1 to 0.2.2 (#1703) 
Bumps [github.com/zeebo/blake3](https://github.com/zeebo/blake3) from 0.2.1 to 0.2.2.
- [Release notes](https://github.com/zeebo/blake3/releases)
- [Commits](https://github.com/zeebo/blake3/compare/v0.2.1...v0.2.2)

---
updated-dependencies:
- dependency-name: github.com/zeebo/blake3
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-02-02 07:38:02 -08:00
dependabot[bot]
a07d3338e6 build(deps): bump google.golang.org/grpc from 1.43.0 to 1.44.0 (#1710) 
Bumps [google.golang.org/grpc](https://github.com/grpc/grpc-go) from 1.43.0 to 1.44.0.
- [Release notes](https://github.com/grpc/grpc-go/releases)
- [Commits](https://github.com/grpc/grpc-go/compare/v1.43.0...v1.44.0)

---
updated-dependencies:
- dependency-name: google.golang.org/grpc
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-02-02 07:37:35 -08:00
Jarek Kowalski
bb979d089c fix(providers): fixed rclone connection in KopiaUI (#1712) (#1713) 
v0.10.3 introduced a regression where RClone connections did not
work in KopiaUI but were ok in the CLI.

The root cause was #1691 which caused storage context to be closed
after opening the repository.

Added test that verifies that storage does not rely on the context
remaining open.
 2022-02-01 23:03:56 -08:00
dependabot[bot]
92cd81d6f3 build(deps-dev): bump concurrently from 6.5.1 to 7.0.0 in /app (#1701) 
Bumps [concurrently](https://github.com/open-cli-tools/concurrently) from 6.5.1 to 7.0.0.
- [Release notes](https://github.com/open-cli-tools/concurrently/releases)
- [Commits](https://github.com/open-cli-tools/concurrently/compare/v6.5.1...v7.0.0)

---
updated-dependencies:
- dependency-name: concurrently
  dependency-type: direct:development
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-02-01 19:41:40 -08:00
dependabot[bot]
1536150216 build(deps): bump google.golang.org/api from 0.63.0 to 0.66.0 (#1702) 
Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client) from 0.63.0 to 0.66.0.
- [Release notes](https://github.com/googleapis/google-api-go-client/releases)
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md)
- [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.63.0...v0.66.0)

---
updated-dependencies:
- dependency-name: google.golang.org/api
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-02-01 19:33:31 -08:00
dependabot[bot]
913251f0fa build(deps): bump github.com/aws/aws-sdk-go from 1.42.25 to 1.42.44 (#1706) 
Bumps [github.com/aws/aws-sdk-go](https://github.com/aws/aws-sdk-go) from 1.42.25 to 1.42.44.
- [Release notes](https://github.com/aws/aws-sdk-go/releases)
- [Changelog](https://github.com/aws/aws-sdk-go/blob/main/CHANGELOG.md)
- [Commits](https://github.com/aws/aws-sdk-go/compare/v1.42.25...v1.42.44)

---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-02-01 19:32:24 -08:00
dependabot[bot]
2f893e5d94 build(deps): bump go.uber.org/zap from 1.19.1 to 1.20.0 (#1707) 
Bumps [go.uber.org/zap](https://github.com/uber-go/zap) from 1.19.1 to 1.20.0.
- [Release notes](https://github.com/uber-go/zap/releases)
- [Changelog](https://github.com/uber-go/zap/blob/master/CHANGELOG.md)
- [Commits](https://github.com/uber-go/zap/compare/v1.19.1...v1.20.0)

---
updated-dependencies:
- dependency-name: go.uber.org/zap
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-02-01 19:32:05 -08:00
Shikhar Mall
aa5e4cfb33 refactor(cli): An in-memory storage mock setup for CLI tests (#1697) 
* refactor cli tests to allow the use of in-memory mock

* use in-memory repo for set-parameters cli tests

* move inmemory storage provider into test package

Co-authored-by: Shikhar Mall <shikhar@kasten.io>
 2022-02-01 10:29:13 -08:00
Jarek Kowalski
902348191f fix(ci): cleaned up changelog output (#1695) v0.10.3 2022-01-30 21:16:30 -08:00
Jarek Kowalski
6f324870ad fix(ui): fixed unwanted refresh of directory listing (#1694) 2022-01-30 20:24:23 -08:00
Jarek Kowalski
7d1bfb2070 feat(ci): automatically publish official releases (#1693) v0.10.2 2022-01-30 11:00:51 -08:00
Jarek Kowalski
f7b0ee52c3 fix(ci): improve changelog readability (#1692) 2022-01-30 10:05:16 -08:00
Jarek Kowalski
fd163cfc20 feat(kopiaui): connect to repository asynchronously on startup (#1691) 
This allows KopiaUI server to start when the repository directory
is not mounted or otherwise unavailable. Connection attempts will
be retried indefinitely and user will see new `Initializing` page.

This also exposes `Open` and `Connect` as tasks allowing the user to see
logs directly in the UI and cancel the operation.
 2022-01-29 18:28:52 -08:00
Jarek Kowalski
8555853973 build(deps): upgrade go-fuse to support /bin/fusermount3 (#1690) 
Fixes #1648
 2022-01-29 15:53:33 -08:00
Jarek Kowalski
f67274e229 fix(providers): fixed DoNotRecreate and tests for gcs (#1688) 
Also simplified validation test suite, which will simply test whether
the provider supports DoNotRecreate or properly rejects it without
external configuration.
 2022-01-29 09:12:07 -08:00
Jarek Kowalski
f404806557 fix(ci): fixed linter issue, do not ignore in workflow (#1687) 2022-01-29 08:15:24 -08:00
Jarek Kowalski
9cad0edb53 test(ui): added end-to-end HTML UI test (#1686) 
* test(general): refactored parsing of server output

* test(ui): added experimental end-to-end test using chromedp
 2022-01-29 01:34:45 -08:00
Jarek Kowalski
16ffe7b5a2 fix(provider): fixed b2 provider failure (#1685) 
There was a small regression in #1654 - only in negative tests.

Also removed unnecessary retries on ErrUnsupportedPutBlobOption
+ switched provider test to run once per day, instead of 12 times/day.
 2022-01-28 23:19:52 -08:00
Jarek Kowalski
400b3c5ed5 fix(server): sleep 30m after failed maintenance (#1684) 
Fixes #1651
Fixes #1652
 2022-01-27 18:27:40 -08:00
Jarek Kowalski
525d161f48 docs(site): updated apt installation instructions (#1683) 2022-01-27 09:22:59 -08:00
Ali Dowair
7ca8b85a57 feat(providers): expand PutBlob API to allow for idempotent puts (#1654) 
* Add a new PutBlob option and blob error type

When `DoNotRecreate` is set as true, the blob put operation should
only succeed if no blob with the given blob ID already exists.
Othwerwise, `ErrBlobAlreadyExists` is returned.

* Validate default storage providers' support

By default, storage providers should not support idempotent creates.
This commit adds error handling to exit early if `DoNotRecreate` is
set to true. The commit also verifies this behavior in the provider
validation test.

* Implement support for new option in GCS storage

* Push PutBlob option handling down to Impl

When PutBlob options were introduced, error handling logic for them
was implemented for the Sharded storage interface. However, the
behavior of different providers that implement Sharded can be
different, so it's better to push the options down to be processed in
the provider implementations.

* Introduce new error type for unsupported put opts

To unify error handling code and make it more maintainable, introduce
a new error type `blob.ErrUnsupportedPutBlobOption`, which is to be
returned whenever a storage provider implementation is given put
options it does not support.
 2022-01-27 08:49:06 -08:00
Jarek Kowalski
e67f84e0ba chore(general): updated linter to 1.44.0 (#1681) 2022-01-25 21:21:13 -08:00
Jarek Kowalski
e030c15803 fix(ci): generate changelog as part of the build (#1679) 2022-01-23 16:58:33 -08:00
Jarek Kowalski
c2ab5020dc build(ci): auto-generate change log (#1678) 2022-01-23 15:22:11 -08:00
Jarek Kowalski
9cb2a40816 feat(providers): improved sharded directory creation (#1665) 
When a sharded directory is missing do not attempt to create all
its parents, but only children of the repository root.

This way when a top-level directory is unmounted, we won't recreate
it unnecessarily.

This is implemented for filesystem and SFTP providers.
 2022-01-23 14:56:35 -08:00
Jarek Kowalski
41a62a7139 chore(ci): do not linter on linux/{arm,arm64} (#1677) 2022-01-23 14:56:13 -08:00
Jarek Kowalski
8451c622ef chore(ci): enforce pull request titles using deepakputhraya/action-pr-title (#1676) 2022-01-23 12:20:00 -08:00
Shikhar Mall
b592776edf feat(repository): persistence for blob-retention configuration (#1596) 
* feat: persisting retention options in repository blob

 - plumb retention parameters through wrapped storage
 - generalize aes encryption mechanism
 - rewrite the retention blob on password change
 - do not write retention blob when empty

* handle retention-blob not-found failures

* cli params to set retention modes on repository create

* enable versioned map mock storage with retention settings

* adding unit tests

* write format and retention blob with retention settings if available

* rename certain functions and constants specific to format blob

* delete retention cache on password-change

* fix: replace SetTime() api call with TouchBlob()

* Update repo/repository_test.go

Co-authored-by: Nick <nick@kasten.io>

* pr feedback and codecov improvements

* fix: rename retention-blob structures to generic blob-cfg

* fix: remove minio dependency on retention constants

Co-authored-by: Shikhar Mall <shikhar@kasten.io>
Co-authored-by: Nick <nick@kasten.io>
 2022-01-22 08:37:00 -08:00
Jarek Kowalski
aeb483a081 fix(testing): fixed robustness tests (#1661) 
Fixes #1660
Broken by #1644
 2022-01-19 17:12:23 -08:00
Aaron Jorgensen
0f4eb06369 Use gpg instead of apt-key (#1667) 
Use gpg to install signing key. `apt-key` is deprecated and will be removed after Ubuntu 22.04.
 2022-01-16 15:39:17 -08:00
Jarek Kowalski
32ed220a6c build(lint): enabled gochecknoglobals and tagged existing globals (#1664) 2022-01-15 12:54:56 -08:00
Jarek Kowalski
c129f28b16 chore(ci): moved tests to standalone GHA workflow that runs in parallel (#1663) 2022-01-15 12:12:18 -08:00
Jarek Kowalski
003b150a0e fix(ui): fixed HTTP 400 response when repository is not connected (#1659) v0.10.1 2022-01-14 08:47:41 -08:00
Jarek Kowalski
6438d28094 fix(ci): fix regression when publishing APT repository (#1658) 2022-01-14 08:06:51 -08:00
Jarek Kowalski
b615a5554a feat(ui): embed version info in index.html (#1656) v0.10.0 2022-01-13 20:11:03 -08:00
Jarek Kowalski
32d95145b1 feat(kopiaui): added menu option prompting users to manually upgrade when auto-update fails (#1655) 
Temporary workaround for #1630
 2022-01-13 19:35:23 -08:00
Jarek Kowalski
3d58566644 fix(security): prevent cross-site request forgery in the UI website (#1653) 
* fix(security): prevent cross-site request forgery in the UI website

This fixes a [cross-site request forgery (CSRF)](https://en.wikipedia.org/wiki/Cross-site_request_forgery)
vulnerability in self-hosted UI for Kopia server.

The vulnerability allows potential attacker to make unauthorized API
calls against a running Kopia server. It requires an attacker to trick
the user into visiting a malicious website while also logged into a
Kopia website.

The vulnerability only affected self-hosted Kopia servers with UI. The
following configurations were not vulnerable:

* Kopia Repository Server without UI
* KopiaUI (desktop app)
* command-line usage of `kopia`

All users are strongly recommended to upgrade at the earliest
convenience.

* pr feedback
 2022-01-13 11:31:51 -08:00
Jarek Kowalski
2385ab19c9 chore(infra): added git message linter (#1646) 2022-01-04 17:32:11 -08:00
dependabot[bot]
4dd4a8adb7 build(deps): bump github.com/aws/aws-sdk-go from 1.42.23 to 1.42.25 (#1641) 
Bumps [github.com/aws/aws-sdk-go](https://github.com/aws/aws-sdk-go) from 1.42.23 to 1.42.25.
- [Release notes](https://github.com/aws/aws-sdk-go/releases)
- [Changelog](https://github.com/aws/aws-sdk-go/blob/main/CHANGELOG.md)
- [Commits](https://github.com/aws/aws-sdk-go/compare/v1.42.23...v1.42.25)

---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-01-03 21:33:05 -08:00