Commit Graph

2443 Commits

Author SHA1 Message Date
dependabot[bot]
2d4199874d build(deps): bump github.com/aws/aws-sdk-go from 1.44.51 to 1.44.52 (#2180) 2022-07-11 23:36:24 +00:00
Jarek Kowalski
317cc36892 fix(repository): fixed a race where iteration goroutine wasn't closed properly (#2177) v0.11.3 2022-07-11 07:26:53 +00:00
basldfalksjdf
5fced3df4c docs(site): Updating documentation (#2170)
* site(docs): Updating repositories documentation

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update config.toml

* Update README.md

* Update _index.md

* Update _index.md

* Update README.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update config.toml

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update README.md

* Update README.md

* Update _index.md

* Update README.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update README.md
2022-07-10 23:32:15 -07:00
Jarek Kowalski
10a693ade3 fix(cli): removed unnecessary console log timestamps (#2175)
Improved test logic which missed this.
2022-07-10 23:06:46 -07:00
Jarek Kowalski
27e5d119df fix(repository): fixed panic when content cache has been disabled (rare) (#2176) 2022-07-11 05:42:49 +00:00
Jarek Kowalski
ea257b1597 feat(cli): removed unnecessary logs from cli-logs (#2174)
- removed memory tracking since it's redundant with profiling
  and prometheus support.
- various cleanups to make sure default log is clean
2022-07-10 16:25:25 -07:00
Jarek Kowalski
700f542a3d fix(cli): fixed 'cache set' CLI regression due to kingpin change (#2173)
This was caused by a default `-1ns` which is no longer supported
in latest Kingpin.

The effect was that `kopia cache set` without
`--max-list-cache-duration` would fail. Unforutnately test was passing
that flag so it was missed.

This was likely caused by https://github.com/alecthomas/kingpin/pull/329
2022-07-10 13:26:41 -07:00
Jarek Kowalski
8515d050e5 test(infra): improved support for in-process testing (#2169)
* feat(infra): improved support for in-process testing

* support for killing of a running server using simulated Ctrl-C
* support for overriding os.Stdin
* migrated many tests from the exe runner to in-process runner

* added required indirection when defining Envar() so we can later override it in tests

* refactored CLI runners by moving environment overrides to CLITestEnv
2022-07-09 18:22:50 -07:00
Jarek Kowalski
a621cd3fb6 fix(ui): fixed filesysystem restores triggered from UI (#2163)
Added comprehensive test for restore API which was previously completely
uncovered.

Fixes #2162
2022-07-08 23:50:17 -07:00
basldfalksjdf
afab59c4cb docs(site): Minor changes to Features page (#2137)
* docs(site): Minor changes to Features page

* Update _index.md

* Update site/content/docs/Features/_index.md

Co-authored-by: Ali Dowair <adowair@umich.edu>

* Update _index.md

* Update _index.md

* Update site/content/docs/Features/_index.md

Co-authored-by: Ali Dowair <adowair@umich.edu>

* Update _index.md

* Update _index.md

Co-authored-by: Ali Dowair <adowair@umich.edu>
2022-07-08 22:55:54 -07:00
dependabot[bot]
8aea728475 build(deps): bump go.opentelemetry.io/otel/exporters/jaeger (#2168)
Bumps [go.opentelemetry.io/otel/exporters/jaeger](https://github.com/open-telemetry/opentelemetry-go) from 1.7.0 to 1.8.0.
- [Release notes](https://github.com/open-telemetry/opentelemetry-go/releases)
- [Changelog](https://github.com/open-telemetry/opentelemetry-go/blob/main/CHANGELOG.md)
- [Commits](https://github.com/open-telemetry/opentelemetry-go/compare/v1.7.0...v1.8.0)

---
updated-dependencies:
- dependency-name: go.opentelemetry.io/otel/exporters/jaeger
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-07-08 22:45:58 -07:00
dependabot[bot]
dc3c9d1e4b build(deps): bump go.opentelemetry.io/otel/sdk from 1.7.0 to 1.8.0 (#2167)
Bumps [go.opentelemetry.io/otel/sdk](https://github.com/open-telemetry/opentelemetry-go) from 1.7.0 to 1.8.0.
- [Release notes](https://github.com/open-telemetry/opentelemetry-go/releases)
- [Changelog](https://github.com/open-telemetry/opentelemetry-go/blob/main/CHANGELOG.md)
- [Commits](https://github.com/open-telemetry/opentelemetry-go/compare/v1.7.0...v1.8.0)

---
updated-dependencies:
- dependency-name: go.opentelemetry.io/otel/sdk
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-07-08 21:22:59 -07:00
dependabot[bot]
97f47dbf6f build(deps): bump github.com/aws/aws-sdk-go from 1.44.50 to 1.44.51 (#2166) 2022-07-08 23:37:08 +00:00
dependabot[bot]
be958a69be build(deps): bump github.com/aws/aws-sdk-go from 1.44.49 to 1.44.50 (#2159) 2022-07-07 23:40:49 +00:00
basldfalksjdf
282134e489 docs(site): Updating FAQs (#2136) 2022-07-06 22:56:49 -07:00
Jarek Kowalski
9941a05ab1 chore(ui): upgraded UI (#2157)
* https://github.com/kopia/htmlui/pull/88
* https://github.com/kopia/htmlui/pull/90
* https://github.com/kopia/htmlui/pull/89
* https://github.com/kopia/htmlui/pull/84
* https://github.com/kopia/htmlui/pull/85
v0.11.2
2022-07-07 03:54:11 +00:00
dependabot[bot]
0215e5651b build(deps): bump github.com/aws/aws-sdk-go from 1.44.48 to 1.44.49 (#2156) 2022-07-07 01:56:17 +00:00
Jarek Kowalski
0f680cd24e fix(ui): fixed missing directory browser button in KopiaUI (#2155)
Fixes #2145
2022-07-07 01:40:51 +00:00
Jarek Kowalski
aec08c84c2 fix(snapshots): panic: unaligned 64-bit atomic operation (#2151)
Reverted to regular sync.Pool

Fixes #2150
2022-07-06 18:34:25 -07:00
basldfalksjdf
bc0e0641bf fix(ui): "Kopia UI" to "KopiaUI" (#2140)
Just removing the extra space
2022-07-06 18:18:22 -07:00
dependabot[bot]
84171307a5 build(deps): bump github.com/minio/minio-go/v7 from 7.0.30 to 7.0.31 (#2154)
Bumps [github.com/minio/minio-go/v7](https://github.com/minio/minio-go) from 7.0.30 to 7.0.31.
- [Release notes](https://github.com/minio/minio-go/releases)
- [Commits](https://github.com/minio/minio-go/compare/v7.0.30...v7.0.31)

---
updated-dependencies:
- dependency-name: github.com/minio/minio-go/v7
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-07-07 01:18:03 +00:00
Jarek Kowalski
04fe236a5f fix(cli): fixed snapshot sizes in the snapshot list (#2148)
This is caused by a fix where fs.Directory was incorrectly reporting
its size == total size of all files in all subdirectories and
`snapshot list` was relying on that.

Fixes #2144
2022-07-06 05:54:27 +00:00
dependabot[bot]
1bed596511 build(deps): bump github.com/aws/aws-sdk-go from 1.44.47 to 1.44.48 (#2146) 2022-07-05 23:42:04 +00:00
Jarek Kowalski
a8717bbcd2 fix(ui): fixed scheduling of snapshots with Ignoring Identical Snapshots (#2141)
Related #2036
Fixes #2138
v0.11.1
2022-07-04 22:58:20 -07:00
basldfalksjdf
4271b5a0f3 docs(site): Revised main homepage (#2131)
* docs(site): Revised main homepage

* Update _index.html

* Update _index.html

* Add files via upload

We do not have to use this background image. But if we do, we should find some place to credit https://unsplash.com/photos/oyXis2kALVg. The image is free for us to use and we don't need to credit per their license -- but it is the right thing to do.

* Update _index.html

* Add files via upload

Just trying other backgrounds to see how they look.

* Add files via upload

* Add files via upload

* Update _index.html

* Update _index.html

* Update footer.html

* Update footer.html

* Update _index.html

* Update _index.html
2022-07-04 15:48:14 -07:00
Jarek Kowalski
a52ac38cdc fix(ui): fixed loading/saving UI preferences (#2135) v0.11.0 2022-07-04 11:41:26 -07:00
basldfalksjdf
4eb4f78435 docs(site): Minor changes to installation directions (#2133) 2022-07-04 11:40:09 -07:00
Jarek Kowalski
e70e3b908c fix(ui): latest fixes to HTML UI (#2134) 2022-07-04 10:09:16 -07:00
basldfalksjdf
222aa30f03 docs(site): Fixed broken link in top menu (#2132) 2022-07-03 21:30:29 -07:00
basldfalksjdf
6723efb7b5 docs(site): Cleaning up Release Notes (#2128)
* docs(site): Cleaning up Release Notes

I think it will be more efficient if we just direct people to the GitHub releases page for anyone that wants to read release notes. I don't see the need to maintain the same information in two different places, plus this section of the site has not been updated for a while.

* Update _index.md

* Delete v0.4.md

* Delete v0.5.md

* Delete v0.6.md

* Delete v0.7.md

* Delete v0.8.md

* Delete v0.9.md
2022-07-03 19:38:18 -07:00
basldfalksjdf
0f6ab64dff docs(site): Reordering side and top menus (#2130)
* docs(site): Reordering side menu

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Create _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update config.toml

* Update _index.md
2022-07-03 19:36:58 -07:00
basldfalksjdf
0511501982 docs(site): Retitling Installation to Download & Installation (#2127)
We link to this page when telling people to download Kopia (see the download button at https://kopia.io), so it will be less confusing if we rename the page to "Download & Installation". We don't need to change the URL, just the title.
2022-07-03 16:14:32 -07:00
basldfalksjdf
b8490f4b6c Update _index.md (#2126)
Mimicking language from #2123
2022-07-03 15:48:32 -07:00
basldfalksjdf
a9cdf15915 docs(site): Rewording main docs page (#2125)
* Update _index.md

Mimicking language from #2123

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md
2022-07-03 15:45:28 -07:00
basldfalksjdf
1b75c9f07b docs(site): Update README.md (#2123)
* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md
2022-07-03 15:44:58 -07:00
Jarek Kowalski
4c8a3fc3b7 fix(snapshots): fixed flaky TestParallelUploadUploadsBlobsInParallel test (#2124) 2022-07-03 19:44:27 +00:00
Jarek Kowalski
0985b80488 feat(ui): support for deprecation of certain algorithms (#2122)
Some compression algorithms are not recommended because they
allocate disproportionate amounts of memory. They are still
possible to use, just marked as NOT RECOMMENDED in the UI.
2022-07-03 19:06:14 +00:00
basldfalksjdf
085ec8fc57 docs(site): Rewording the getting started guide (#2121)
* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md
2022-07-03 18:44:10 +00:00
basldfalksjdf
6057a97e87 docs(site): Reworked the main docs page (#2118)
* Update _index.md

I am slowly working my way through the docs to update them to include the latest and greatest features of Kopia. I also aim to rework the docs so that the docs are helpful to both CLI and GUI users.

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md
2022-07-03 18:36:03 +00:00
basldfalksjdf
482f51836d docs(site): Rewording the installation docs (#2120)
* Rewording the installation docs

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md
2022-07-03 18:27:42 +00:00
basldfalksjdf
736296ee7a docs(site): Reworked the features page in the docs (#2119)
* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

* Update _index.md

Changed absolute paths for links that began with https://kopia.io/docs to relative paths.

* Update _index.md
2022-07-03 17:02:25 +00:00
Jarek Kowalski
3af5a48493 refactor(ci): removed unused ReactJS app from KopiaUI (#2117)
This was producing an empty directory, which was completely unused.
2022-07-02 17:07:26 +00:00
Jarek Kowalski
34da3a2415 feat(general): implemented custom log encoder for ZAP (#2116)
Turns out standard ConsoleEncoder is not optimized at all and we're
emitting up to 8 log entries per file. This change avoids massive
amount of allocations and brings in some latency reduction.

Backing up 100k files in a flat directory:

duration: current:7.8 baseline:7.9 change:-1.0 %
repo_size: current:1019954521.4 baseline:1019976318.9 change:-0.0 %
num_files: current:58.0 baseline:58.0 change:0%
avg_heap_objects: current:6682141.0 baseline:7508631.3 change:-11.0 %
avg_heap_bytes: current:845404672.0 baseline:867325413.9 change:-2.5 %
avg_ram: current:156.5 baseline:159.1 change:-1.7 %
max_ram: current:278.3 baseline:287.2 change:-3.1 %
avg_cpu: current:153.8 baseline:156.4 change:-1.7 %
max_cpu: current:298.4 baseline:297.1 change:+0.4 %

Backing up Linux 5.18.4:

duration: current:3.6 baseline:4.2 change:-14.2 %
repo_size: current:1081624213.7 baseline:1081635886.8 change:-0.0 %
num_files: current:60.0 baseline:60.0 change:0%
avg_heap_objects: current:5180192.3 baseline:5831270.7 change:-11.2 %
avg_heap_bytes: current:783468754.2 baseline:804350042.1 change:-2.6 %
avg_ram: current:239.0 baseline:240.6 change:-0.6 %
max_ram: current:384.8 baseline:368.0 change:+4.6 %
avg_cpu: current:259.8 baseline:230.8 change:+12.6 %
max_cpu: current:321.6 baseline:303.9 change:+5.9 %
2022-07-02 13:55:01 +00:00
Jarek Kowalski
0b6d76712f feat(snapshots): added free pool of localfs entries (#2115)
This avoids allocations of entries as large directories are traversed.

Backing up 100k small files in a single directory:

duration: current:8.1 baseline:8.6 change:-5.7 %
avg_heap_objects: current:7330688.9 baseline:7463750.6 change:-1.8 %
avg_heap_bytes: current:829248496.6 baseline:864880473.2 change:-4.1 %
avg_ram: current:159.3 baseline:159.1 change:+0.1 %
max_ram: current:283.2 baseline:285.4 change:-0.8 %
avg_cpu: current:153.1 baseline:143.6 change:+6.7 %
max_cpu: current:295.6 baseline:292.4 change:+1.1 %

Backing up Linux 5.14.8 using --parallel=4:

duration: current:6.0 baseline:6.0 change:-0.0 %
avg_heap_objects: current:5654431.1 baseline:5845078.3 change:-3.3 %
avg_heap_bytes: current:764526988.2 baseline:806833320.4 change:-5.2 %
avg_ram: current:218.2 baseline:220.1 change:-0.9 %
max_ram: current:323.5 baseline:319.5 change:+1.3 %
avg_cpu: current:144.3 baseline:145.1 change:-0.6 %
max_cpu: current:224.6 baseline:220.6 change:+1.8 %
2022-07-01 21:12:55 -07:00
dependabot[bot]
5f7ad83803 build(deps): bump electron-updater from 5.0.1 to 5.0.5 in /app (#2109)
Bumps [electron-updater](https://github.com/electron-userland/electron-builder/tree/HEAD/packages/electron-updater) from 5.0.1 to 5.0.5.
- [Release notes](https://github.com/electron-userland/electron-builder/releases)
- [Changelog](https://github.com/electron-userland/electron-builder/blob/master/packages/electron-updater/CHANGELOG.md)
- [Commits](https://github.com/electron-userland/electron-builder/commits/electron-updater@5.0.5/packages/electron-updater)

---
updated-dependencies:
- dependency-name: electron-updater
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-07-01 19:49:56 -07:00
Jarek Kowalski
b8f68df2cf feat(ui): updated UI to latest version (#2114) 2022-07-02 02:46:28 +00:00
Ali Dowair
98e10d52f1 Rename --sparse to --write-sparse-files (#2095)
This commit renames the sparse restore flag (`kopia snapshot restore`
and `kopia restore`) to conform more with the naming precedents in
the Kopia code. This is a breaking change.

The original motivation can be found here:
https://github.com/kopia/htmlui/pull/61#discussion_r899155054
2022-07-01 19:01:53 -07:00
dependabot[bot]
5aca9785dd build(deps-dev): bump concurrently from 7.2.1 to 7.2.2 in /app (#2110)
Bumps [concurrently](https://github.com/open-cli-tools/concurrently) from 7.2.1 to 7.2.2.
- [Release notes](https://github.com/open-cli-tools/concurrently/releases)
- [Commits](https://github.com/open-cli-tools/concurrently/compare/v7.2.1...v7.2.2)

---
updated-dependencies:
- dependency-name: concurrently
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-07-01 18:59:27 -07:00
dependabot[bot]
5d1637078c build(deps): bump electron-log from 4.4.7 to 4.4.8 in /app (#2108)
Bumps [electron-log](https://github.com/megahertz/electron-log) from 4.4.7 to 4.4.8.
- [Release notes](https://github.com/megahertz/electron-log/releases)
- [Changelog](https://github.com/megahertz/electron-log/blob/master/CHANGELOG.md)
- [Commits](https://github.com/megahertz/electron-log/compare/v4.4.7...v4.4.8)

---
updated-dependencies:
- dependency-name: electron-log
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-07-01 18:58:24 -07:00
dependabot[bot]
a47834b076 build(deps): bump github.com/aws/aws-sdk-go from 1.44.46 to 1.44.47 (#2112) 2022-07-02 01:41:32 +00:00