Commit Graph

2476 Commits

Author SHA1 Message Date
dependabot[bot]
b074bf098a build(deps): bump github.com/aws/aws-sdk-go from 1.44.61 to 1.44.64 (#2239) 2022-07-27 23:34:03 +00:00
Shikhar Mall
26e6f59b2b feat(cli): New Upgrade CLI / Switch to Format Version 3 (upgrade coordination) (#1818)
* kopia format upgrade lock

* Update cli/command_repository_set_parameters_test.go

Co-authored-by: Ali Dowair <adowair@umich.edu>

* Update cli/command_repository_upgrade.go

Co-authored-by: Ali Dowair <adowair@umich.edu>

* Update cli/command_repository_upgrade.go

Co-authored-by: Ali Dowair <adowair@umich.edu>

* pr feedback

* pr feedback

* add a min drain time check

* env var for io-drain-timeout

* fix: add more doctext around upgrade phases

* build: wrap with EnvName

* add experimental warning

* protect upgrade cli behind env varible

* fix conflicts after relocating the upgrade lock

* generalize the command args

* drop certain features as per feedback

* sub-divide the upgrade command into begin and rollback

* Update cli/command_repository_upgrade.go

Co-authored-by: Julio Lopez <1953782+julio-lopez@users.noreply.github.com>

* Update cli/command_repository_upgrade.go

Co-authored-by: Julio Lopez <1953782+julio-lopez@users.noreply.github.com>

* missing return

* rename force flag to allow-unsafe-upgrade

Co-authored-by: Shikhar Mall <shikhar@kasten.io>
Co-authored-by: Ali Dowair <adowair@umich.edu>
Co-authored-by: Shikhar Mall <small@kopia.io>
Co-authored-by: Julio Lopez <1953782+julio-lopez@users.noreply.github.com>
2022-07-27 16:23:45 -07:00
nunotexbsd
c3d9347932 docs(site): Add FreeBSD port/package installation instructions (#2237)
* Update _index.md

Add FreeBSD port installation instructions

Co-authored-by: Ali Dowair <adowair@umich.edu>
2022-07-27 14:48:51 +03:00
dependabot[bot]
42ba517a83 build(deps): bump google.golang.org/api from 0.87.0 to 0.88.0 (#2207) 2022-07-26 00:02:46 +00:00
dependabot[bot]
f25872970c build(deps): bump github.com/chromedp/chromedp from 0.8.2 to 0.8.3 (#2229) 2022-07-25 23:36:05 +00:00
dependabot[bot]
a709135432 build(deps): bump github.com/minio/minio-go/v7 from 7.0.31 to 7.0.32 (#2228) 2022-07-25 23:35:38 +00:00
Jarek Kowalski
0e62d64576 feat(providers): add AWS IAM as a credential provider for s3 storage (#2213) (#2222)
* add AWS IAM as a credential provider for s3 storage

* Update s3_storage.go

Co-authored-by: Jarek Kowalski <jaak@jkowalski.net>

Co-authored-by: Sidhartha Mani <wlan0@users.noreply.github.com>
2022-07-23 15:23:13 +00:00
Jarek Kowalski
31c5bd94bc build(deps): bumped rclone binary to 1.59.0 (#2221) 2022-07-23 06:50:43 +00:00
dependabot[bot]
676a81f6fa build(deps): bump cloud.google.com/go/storage from 1.23.0 to 1.24.0 (#2212) 2022-07-23 06:19:54 +00:00
dependabot[bot]
a57c02ddca build(deps): bump github.com/aws/aws-sdk-go from 1.44.60 to 1.44.61 (#2217)
Bumps [github.com/aws/aws-sdk-go](https://github.com/aws/aws-sdk-go) from 1.44.60 to 1.44.61.
- [Release notes](https://github.com/aws/aws-sdk-go/releases)
- [Changelog](https://github.com/aws/aws-sdk-go/blob/main/CHANGELOG.md)
- [Commits](https://github.com/aws/aws-sdk-go/compare/v1.44.60...v1.44.61)

---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-07-23 06:13:25 +00:00
Jarek Kowalski
7eb2f915a8 fix(providers): disabled rclone write-back behavior (#2218) (#2219)
There are many solutions floating online intended to help speed up
`rclone` performance with high-latency backends, such as Google Drive or
OneDrive.

One of the often-suggested ones is `--vfs-cache-mode`, which creates
an on-disk cache and performs uploads in the background
(asynchronous write-back).

This is not necessarily wrong when a single client is used, but may
cause problems when multiple Kopia clients share repository and
some of the writes are reordered or never happen, in particular in
case of crashes.

Fixes #2216
2022-07-23 01:21:50 +00:00
dependabot[bot]
58c0e9d76d build(deps): bump github.com/klauspost/compress from 1.15.8 to 1.15.9 (#2214)
Bumps [github.com/klauspost/compress](https://github.com/klauspost/compress) from 1.15.8 to 1.15.9.
- [Release notes](https://github.com/klauspost/compress/releases)
- [Changelog](https://github.com/klauspost/compress/blob/master/.goreleaser.yml)
- [Commits](https://github.com/klauspost/compress/compare/v1.15.8...v1.15.9)

---
updated-dependencies:
- dependency-name: github.com/klauspost/compress
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-07-22 18:13:04 -07:00
dependabot[bot]
bb705ccd2a build(deps): bump github.com/aws/aws-sdk-go from 1.44.59 to 1.44.60 (#2215) 2022-07-21 23:37:33 +00:00
dependabot[bot]
caee5a7f96 build(deps): bump github.com/aws/aws-sdk-go from 1.44.58 to 1.44.59 (#2211) 2022-07-20 23:49:06 +00:00
stpr-dev
70792de138 fix(cli): content sizes are already suffixed, so 'bytes' in the string is redundant (#2209) 2022-07-20 04:57:54 +00:00
dependabot[bot]
2bd704d250 build(deps): bump github.com/aws/aws-sdk-go from 1.44.57 to 1.44.58 (#2208) 2022-07-19 23:32:46 +00:00
Jarek Kowalski
0b881968c6 refactor(repository): moved upgrade lock intent from content to repo level (#2203)
There are no real `content` dependencies here and JSON at the repo
level can store the upgrade lock in exactly the same way.
2022-07-19 11:06:29 -07:00
Jarek Kowalski
1a82061e49 chore(ci): upgraded linter to 1.47.0, added 15s ReadHeaderTimeout in web server (#2206) 2022-07-18 22:47:36 -07:00
dependabot[bot]
78220d039f build(deps): bump github.com/aws/aws-sdk-go from 1.44.56 to 1.44.57 (#2205) 2022-07-18 23:35:20 +00:00
basldfalksjdf
08b88cac19 docs(site): Fixing broken links (#2204) 2022-07-18 07:48:29 -07:00
dependabot[bot]
f963d6cc66 build(deps): bump github.com/prometheus/common from 0.36.0 to 0.37.0 (#2200) 2022-07-16 04:49:23 +00:00
dependabot[bot]
d0194933a6 build(deps): bump github.com/aws/aws-sdk-go from 1.44.53 to 1.44.56 (#2197) 2022-07-16 04:26:26 +00:00
Jarek Kowalski
191b3e5461 feat(cli): BREAKING CHANGE ensure --checkpoint-interval is <=45min (#2196)
Also hide the flag, since it's not recommended to be tweaked anyway.

The value of <=45m is very important for safety of the garbage collection algorithms - too long an interval between checkpoints could mean that GC treats contents in the middle of being uploaded as unused, because they are not reachable from any snapshots or checkpoints.

Fixes #2193
2022-07-16 04:15:32 +00:00
dependabot[bot]
e10e9b0252 build(deps-dev): bump electron from 19.0.7 to 19.0.8 in /app (#2199)
Bumps [electron](https://github.com/electron/electron) from 19.0.7 to 19.0.8.
- [Release notes](https://github.com/electron/electron/releases)
- [Changelog](https://github.com/electron/electron/blob/main/docs/breaking-changes.md)
- [Commits](https://github.com/electron/electron/compare/v19.0.7...v19.0.8)

---
updated-dependencies:
- dependency-name: electron
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-07-15 21:04:53 -07:00
Jarek Kowalski
f13ed089e2 chore(ci): auto-merge prometheus updates (#2201) 2022-07-15 21:04:04 -07:00
Jarek Kowalski
30c0aef795 chore(ci): increase dependabot PR concurrency limit (#2198) 2022-07-15 20:58:46 -07:00
dependabot[bot]
912a1be98e build(deps): bump github.com/klauspost/compress from 1.15.7 to 1.15.8 (#2192)
Bumps [github.com/klauspost/compress](https://github.com/klauspost/compress) from 1.15.7 to 1.15.8.
- [Release notes](https://github.com/klauspost/compress/releases)
- [Changelog](https://github.com/klauspost/compress/blob/master/.goreleaser.yml)
- [Commits](https://github.com/klauspost/compress/compare/v1.15.7...v1.15.8)

---
updated-dependencies:
- dependency-name: github.com/klauspost/compress
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-07-15 20:56:11 -07:00
dependabot[bot]
327f52603f build(deps): bump google.golang.org/grpc from 1.47.0 to 1.48.0 (#2188) 2022-07-13 04:13:01 +00:00
dependabot[bot]
dcd3a80639 build(deps): bump google.golang.org/api from 0.86.0 to 0.87.0 (#2187) 2022-07-13 00:06:38 +00:00
dependabot[bot]
87c1494109 build(deps): bump github.com/aws/aws-sdk-go from 1.44.52 to 1.44.53 (#2186) 2022-07-12 23:34:57 +00:00
basldfalksjdf
04bd43b27e docs(site): minor changes to Download & Installation page (#2139)
- Fix a typo
- Add some detail on functionality of KopiaUI
- Explain release zip package naming
2022-07-12 13:00:53 +00:00
basldfalksjdf
9f26ab89ed docs(site): Updating FAQs (#2182)
* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md
2022-07-12 06:08:37 +00:00
dependabot[bot]
9715e9812a build(deps): bump github.com/prometheus/common from 0.35.0 to 0.36.0 (#2181)
Bumps [github.com/prometheus/common](https://github.com/prometheus/common) from 0.35.0 to 0.36.0.
- [Release notes](https://github.com/prometheus/common/releases)
- [Commits](https://github.com/prometheus/common/compare/v0.35.0...v0.36.0)

---
updated-dependencies:
- dependency-name: github.com/prometheus/common
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-07-11 21:51:37 -07:00
dependabot[bot]
2d4199874d build(deps): bump github.com/aws/aws-sdk-go from 1.44.51 to 1.44.52 (#2180) 2022-07-11 23:36:24 +00:00
Jarek Kowalski
317cc36892 fix(repository): fixed a race where iteration goroutine wasn't closed properly (#2177) v0.11.3 2022-07-11 07:26:53 +00:00
basldfalksjdf
5fced3df4c docs(site): Updating documentation (#2170)
* site(docs): Updating repositories documentation

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update config.toml

* Update README.md

* Update _index.md

* Update _index.md

* Update README.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update config.toml

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update README.md

* Update README.md

* Update _index.md

* Update README.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update README.md
2022-07-10 23:32:15 -07:00
Jarek Kowalski
10a693ade3 fix(cli): removed unnecessary console log timestamps (#2175)
Improved test logic which missed this.
2022-07-10 23:06:46 -07:00
Jarek Kowalski
27e5d119df fix(repository): fixed panic when content cache has been disabled (rare) (#2176) 2022-07-11 05:42:49 +00:00
Jarek Kowalski
ea257b1597 feat(cli): removed unnecessary logs from cli-logs (#2174)
- removed memory tracking since it's redundant with profiling
  and prometheus support.
- various cleanups to make sure default log is clean
2022-07-10 16:25:25 -07:00
Jarek Kowalski
700f542a3d fix(cli): fixed 'cache set' CLI regression due to kingpin change (#2173)
This was caused by a default `-1ns` which is no longer supported
in latest Kingpin.

The effect was that `kopia cache set` without
`--max-list-cache-duration` would fail. Unforutnately test was passing
that flag so it was missed.

This was likely caused by https://github.com/alecthomas/kingpin/pull/329
2022-07-10 13:26:41 -07:00
Jarek Kowalski
8515d050e5 test(infra): improved support for in-process testing (#2169)
* feat(infra): improved support for in-process testing

* support for killing of a running server using simulated Ctrl-C
* support for overriding os.Stdin
* migrated many tests from the exe runner to in-process runner

* added required indirection when defining Envar() so we can later override it in tests

* refactored CLI runners by moving environment overrides to CLITestEnv
2022-07-09 18:22:50 -07:00
Jarek Kowalski
a621cd3fb6 fix(ui): fixed filesysystem restores triggered from UI (#2163)
Added comprehensive test for restore API which was previously completely
uncovered.

Fixes #2162
2022-07-08 23:50:17 -07:00
basldfalksjdf
afab59c4cb docs(site): Minor changes to Features page (#2137)
* docs(site): Minor changes to Features page

* Update _index.md

* Update site/content/docs/Features/_index.md

Co-authored-by: Ali Dowair <adowair@umich.edu>

* Update _index.md

* Update _index.md

* Update site/content/docs/Features/_index.md

Co-authored-by: Ali Dowair <adowair@umich.edu>

* Update _index.md

* Update _index.md

Co-authored-by: Ali Dowair <adowair@umich.edu>
2022-07-08 22:55:54 -07:00
dependabot[bot]
8aea728475 build(deps): bump go.opentelemetry.io/otel/exporters/jaeger (#2168)
Bumps [go.opentelemetry.io/otel/exporters/jaeger](https://github.com/open-telemetry/opentelemetry-go) from 1.7.0 to 1.8.0.
- [Release notes](https://github.com/open-telemetry/opentelemetry-go/releases)
- [Changelog](https://github.com/open-telemetry/opentelemetry-go/blob/main/CHANGELOG.md)
- [Commits](https://github.com/open-telemetry/opentelemetry-go/compare/v1.7.0...v1.8.0)

---
updated-dependencies:
- dependency-name: go.opentelemetry.io/otel/exporters/jaeger
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-07-08 22:45:58 -07:00
dependabot[bot]
dc3c9d1e4b build(deps): bump go.opentelemetry.io/otel/sdk from 1.7.0 to 1.8.0 (#2167)
Bumps [go.opentelemetry.io/otel/sdk](https://github.com/open-telemetry/opentelemetry-go) from 1.7.0 to 1.8.0.
- [Release notes](https://github.com/open-telemetry/opentelemetry-go/releases)
- [Changelog](https://github.com/open-telemetry/opentelemetry-go/blob/main/CHANGELOG.md)
- [Commits](https://github.com/open-telemetry/opentelemetry-go/compare/v1.7.0...v1.8.0)

---
updated-dependencies:
- dependency-name: go.opentelemetry.io/otel/sdk
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-07-08 21:22:59 -07:00
dependabot[bot]
97f47dbf6f build(deps): bump github.com/aws/aws-sdk-go from 1.44.50 to 1.44.51 (#2166) 2022-07-08 23:37:08 +00:00
dependabot[bot]
be958a69be build(deps): bump github.com/aws/aws-sdk-go from 1.44.49 to 1.44.50 (#2159) 2022-07-07 23:40:49 +00:00
basldfalksjdf
282134e489 docs(site): Updating FAQs (#2136) 2022-07-06 22:56:49 -07:00
Jarek Kowalski
9941a05ab1 chore(ui): upgraded UI (#2157)
* https://github.com/kopia/htmlui/pull/88
* https://github.com/kopia/htmlui/pull/90
* https://github.com/kopia/htmlui/pull/89
* https://github.com/kopia/htmlui/pull/84
* https://github.com/kopia/htmlui/pull/85
v0.11.2
2022-07-07 03:54:11 +00:00
dependabot[bot]
0215e5651b build(deps): bump github.com/aws/aws-sdk-go from 1.44.48 to 1.44.49 (#2156) 2022-07-07 01:56:17 +00:00