Commit Graph

1127 Commits

Author SHA1 Message Date
Jarek Kowalski
28aab656fc kopia-ui: more version number tweaks, enable snapcraft on travis 2020-02-19 23:59:03 -08:00
Jarek Kowalski
ffb31b62d1 kopia-ui: adjusted build version format 2020-02-19 23:36:28 -08:00
Jarek Kowalski
ff5abd5639 kopia-ui: don't package linux app yet, fix version numbering 2020-02-19 23:27:19 -08:00
Jarek Kowalski
98f1b26f39 kopia-ui: support for auto-update and publishing prerelease binaries from Travis to kopia/kopia-ui-release 2020-02-19 23:08:12 -08:00
Julio López
995b1cef40 Minor README edits (#250)
Co-authored-by: Niraj Tolia <ntolia@kasten.io>
2020-02-19 20:02:21 -08:00
Jarek Kowalski
11d6eb1c6c Added unit tests for HTML UI to make it a bit harder to regress.
Covered are:

- connect and create flow
- parameter pages for all providers
- connect using token
2020-02-19 18:22:45 -08:00
Jarek Kowalski
b9cfcfa166 Replace personal email with PMC mailing list address (#253) 2020-02-19 18:16:22 -08:00
Jarek Kowalski
8e812b76c0 blob: added retries to Filesystem provider, fixes #249 (#251)
Wrote a test first which failed 100% on Windows. After adding retries it passed 20 times in a row, execution time is ~10s.

Fixes #249
2020-02-19 13:17:47 -08:00
Niraj Tolia
7a8a660f1a Update CoC to reflect PMC mailing list 2020-02-18 20:59:50 -08:00
Niraj Tolia
dbfc4a2772 Add Asciicinema recording to the website 2020-02-18 19:50:35 -08:00
Jarek Kowalski
f8006f8ce0 cli: removed flags for configuring global policy on repository creation 2020-02-18 12:21:11 -08:00
Jarek Kowalski
c48f03fa78 readme: added build architecture doc
The slide was generated using Google Slides and the source is public at:

https://docs.google.com/presentation/d/1VhsANHnV5vs4vCmjVTFlMpDgDUBNtyU9Ex04EX0wNRI/edit?usp=sharing

If you need to modify it, please request permissions.
2020-02-18 12:18:33 -08:00
Jarek Kowalski
f9db94ca77 travis: disable windows signing by setting CSC_LINK and CSC_KEY_PASSWORD to empty, attempt 2 2020-02-18 06:50:35 -08:00
Jarek Kowalski
795b4f14e6 travis: disable windows signing by setting CSC_LINK and CSC_KEY_PASSWORD to empty 2020-02-17 23:29:45 -08:00
Jarek Kowalski
8208990321 travis: fix --skip-sign logic 2020-02-17 21:01:26 -08:00
Jarek Kowalski
98e877f437 travis: disable signing on windows 2020-02-17 20:19:07 -08:00
Jarek Kowalski
35a7bb6038 travis: deparallelize tasks within build to reduce flakes and improve logging 2020-02-17 20:19:07 -08:00
Jarek Kowalski
7f79c77d73 Makefile: refactored tools to be installable on Windows with only minimal deps (make/curl/unzip)
This allows full kopia and kopia-ui to be built on Windows along with
running lint and integration tests.
2020-02-17 18:45:08 -08:00
Jarek Kowalski
930927547c makefile: fixed support for PATH that includes directories with spaces
Verified with:

make website PATH="/tmp/With Space:$PATH"
2020-02-17 11:23:38 -08:00
Jarek Kowalski
29db31d008 blob: fixed GCS post-submit test 2020-02-17 08:58:32 -08:00
Jarek Kowalski
47ba37f9d0 blob: fixed GCS post-submit test 2020-02-17 08:45:33 -08:00
Jarek Kowalski
022d223e1d blob: fixed GCS post-submit test 2020-02-17 08:31:39 -08:00
Prasad Ghangal
a3a55f4fa3 Add retries when creating S3 Storage obj in test
It is observed that travis CI fails sometimes due
to access key validation issue in TestS3StorageWithSessionToken.
Assuming this issue is due to eventual consistency,
we have added retries while creating S3 Storage obj

Signed-off-by: Prasad Ghangal <prasad.ghangal@gmail.com>
2020-02-17 08:16:24 -08:00
Jarek Kowalski
03dad366e1 htmlui: added first version of UI policy editor 2020-02-16 23:04:17 -08:00
Jarek Kowalski
c42b5cd89f server: API server for CRUD on individual Policies 2020-02-16 23:04:17 -08:00
Jarek Kowalski
9a96a8a770 snapshot: fixed casing of 'errorHandling' in JSON 2020-02-16 23:04:17 -08:00
Jarek Kowalski
515748a6ca htmlui: prevent flicker when refreshing snapshot sources 2020-02-16 22:43:36 -08:00
Jarek Kowalski
cc5597ed6d server: set default policy after repo creation 2020-02-16 22:43:36 -08:00
Jarek Kowalski
a7a3cd3282 htmlui: new UI flow for connecting to and creating repository 2020-02-16 22:43:36 -08:00
Jarek Kowalski
a21da7b960 cli: fixed double-close of repository during 'server start' 2020-02-16 22:43:36 -08:00
Jarek Kowalski
4cb898927c server: new APIs and error codes to support UI flow for connecting to repository 2020-02-16 22:43:36 -08:00
Jarek Kowalski
cf4f79a4d1 repo: introduced well-known error codes for connecting to repository
also disconnect from repository after connection is unsuccessful,
to prevent stale config files
2020-02-16 22:43:36 -08:00
Jarek Kowalski
0163a2da97 blob: check that GCS/S3 bucket is present when the storage is opened 2020-02-16 22:43:36 -08:00
Julio López
a9670762fd Generate shorter file names, and thus paths, in E2E tests (#229)
- Reduces name lengths by ~ 1/2
- Generate file names up to maxNameLength

Co-Authored-By: Nick <nick@kasten.io>
2020-02-14 22:25:50 -08:00
Nick
3a5d3179e7 Add WalkCrossDevice option to walk policy
Add the walk policy flag WalkCrossDevice to the fswalker Walk calls. This will avoid potential issues when running in a docker container where a FS tree is made of many overlays. Without the flag set, the Walk operation skips over files on devices that do not match the device at the base path.
2020-02-14 21:18:41 -08:00
Jarek Kowalski
8bdd5caf7e server: added retry loop when launching server 2020-02-13 17:23:50 -08:00
Jarek Kowalski
4c35ed82b9 linter fixes 2020-02-13 17:23:50 -08:00
Jarek Kowalski
0f79279f5e server: added support for new verbs in the API
/api/v1/repo/create
/api/v1/repo/connect
/api/v1/repo/disconnect

Refactored server code and fixed a number of outstanding robustness
issues. Tweaked the API responses a bit to make more sense when consumed
by the UI.
2020-02-13 17:23:50 -08:00
Jarek Kowalski
69d1ccbedf upload: Added CountingUploadProgress and new methods to UploadProgress 2020-02-13 17:23:50 -08:00
Nick
3cb7e37fc1 Add comparer interface and fswalker implementation (#226)
Add comparer interface which gathers data on a path and
compares that data to a new path, returning error if the path
differs in any way from the input data. The details of what
constitutes a difference is left to the implementation.

FSWalker implementation uses Walk and Report to do the data
gathering and comparison. Filters are applied to sort out any
differences that might be expected (e.g. ctime, atime, mtime,
rename of root directory after restore).
2020-02-13 17:07:18 -08:00
Prasad Ghangal
28ab5e0e5f Add test for session token support
Signed-off-by: Prasad Ghangal <prasad.ghangal@gmail.com>
2020-02-12 08:19:24 -08:00
Prasad Ghangal
1c3858a906 Add AWS Session Token support to Kopia
Signed-off-by: Prasad Ghangal <prasad.ghangal@gmail.com>
2020-02-12 08:19:24 -08:00
Jarek Kowalski
a8503a007c server: allow starting server on randomly-allocated port by specifing port 0 (#224)
allow starting server on randomly-allocated port by specifing port 0
2020-02-11 17:08:50 -08:00
Jarek Kowalski
862fc69bff cli: marked --ignore-{file,dir}-errors as enums, so that CLI parser enforces correct values 2020-02-11 06:41:20 -08:00
Nick
162db3e861 [minor] Fix error handling policy print (#221)
Fixes print for error handling policy. Previously was printing
pointer address, now dereference pointer to print boolean itself.
Nil check in case the caller passes a policy with nil. In that
case print "false" which is the behavior in uploader for nil
pointer.
2020-02-10 20:22:55 -08:00
Jarek Kowalski
f8720eda62 travis: re-enabled integration tests on Windows after disabling GPG 2020-02-10 19:13:43 -08:00
Jarek Kowalski
4736e9037e revamped progress output and cleaned up logging
See https://asciinema.org/a/ykx6uzEhKY3451fWEnX9nm9uo
2020-02-10 19:08:35 -08:00
Jarek Kowalski
8d9a042a44 travis: don't run GPG on Windows 2020-02-10 18:57:58 -08:00
Jarek Kowalski
24c425ab2f travis: disable integration tests on windows to see if that fixes builds hanging 2020-02-10 18:42:17 -08:00
Jarek Kowalski
0d9f1dc043 temporary: print task list after running tests on windows, some left-over process may be causing travis builds to fail 2020-02-10 17:52:08 -08:00