Commit Graph

1138 Commits

Author SHA1 Message Date
Jarek Kowalski
3e58911cf3 tests: de-parallelized server tests 2020-02-22 19:27:10 -08:00
Jarek Kowalski
9b50a6e891 test: increased e2e test timeout
Added linear retry support when waiting for snapshots
2020-02-22 19:27:10 -08:00
Jarek Kowalski
fde2f2e0e6 server: additional status code from CreateSnapshotSource, more tests 2020-02-22 19:27:10 -08:00
Jarek Kowalski
ab2c906f2c server: implemented remaining server API methods
CreateSnapshotSource API for ensuring source exists
Upload - starts upload on a given source or matching sources
Cancel - cancels upload on a given source or matching sources
2020-02-22 19:27:10 -08:00
Jarek Kowalski
ee88cfd229 server: switched from manual routing to github.com/gorilla/mux 2020-02-22 19:27:10 -08:00
Jarek Kowalski
7efe83cbe8 travis: mac notarization setup 2020-02-22 19:09:17 -08:00
Jarek Kowalski
8c28d8e139 travis: mac notarization setup 2020-02-22 19:09:17 -08:00
Jarek Kowalski
22a00452b0 travis: added macOS app notarization 2020-02-22 18:34:34 -08:00
Julio López
e8b68e7829 Cleanup Travis config (#262)
Travis YAML cleanup

Removes warnings in Travis v2 config validation:

 root: duplicate key: addons
 deploy: deprecated key skip_cleanup (not supported in dpl v2, use cleanup)
 deploy: deprecated key skip_cleanup (not supported in dpl v2, use cleanup)
 addons.snaps: unknown key confinement (classic)
 deploy: key github_token is an alias for token, using token
 deploy: key api_key is an alias for token, using token

Changes:

- remove duplicate 'addons' key
- replace 'github_token' with 'token' in deploy.provider:"pages"
- replace 'api_key' with 'token' in deploy.provider:"release"
- replace 'skip_cleanup:true' with 'cleanup:false' in deploy.provider.*
- replace 'confinement:classic' with 'classic:true' in addons.snaps[0]

Ref:
- https://docs.travis-ci.com/user/deployment-v2/providers/pages/
- https://docs.travis-ci.com/user/deployment-v2/providers/releases/
- https://config.travis-ci.com/ref/job/addons/snaps
2020-02-20 23:40:06 -08:00
Jarek Kowalski
1e3100a88b Misc Kopia UI changes:
- disabled MacOS dock icon
- cleaned up MacOS menu bar
- added retry when opening main window, which is unavailable shortly
  after starting up server
- open main window on first run
- retry checking for updates every 24h
- fixed bug preventing Repository tab from finishing loading
- updated to latest package versions
2020-02-20 22:53:34 -08:00
Jarek Kowalski
dd788ce087 kopia-ui: publish snap to github 2020-02-20 00:28:22 -08:00
Jarek Kowalski
28aab656fc kopia-ui: more version number tweaks, enable snapcraft on travis 2020-02-19 23:59:03 -08:00
Jarek Kowalski
ffb31b62d1 kopia-ui: adjusted build version format 2020-02-19 23:36:28 -08:00
Jarek Kowalski
ff5abd5639 kopia-ui: don't package linux app yet, fix version numbering 2020-02-19 23:27:19 -08:00
Jarek Kowalski
98f1b26f39 kopia-ui: support for auto-update and publishing prerelease binaries from Travis to kopia/kopia-ui-release 2020-02-19 23:08:12 -08:00
Julio López
995b1cef40 Minor README edits (#250)
Co-authored-by: Niraj Tolia <ntolia@kasten.io>
2020-02-19 20:02:21 -08:00
Jarek Kowalski
11d6eb1c6c Added unit tests for HTML UI to make it a bit harder to regress.
Covered are:

- connect and create flow
- parameter pages for all providers
- connect using token
2020-02-19 18:22:45 -08:00
Jarek Kowalski
b9cfcfa166 Replace personal email with PMC mailing list address (#253) 2020-02-19 18:16:22 -08:00
Jarek Kowalski
8e812b76c0 blob: added retries to Filesystem provider, fixes #249 (#251)
Wrote a test first which failed 100% on Windows. After adding retries it passed 20 times in a row, execution time is ~10s.

Fixes #249
2020-02-19 13:17:47 -08:00
Niraj Tolia
7a8a660f1a Update CoC to reflect PMC mailing list 2020-02-18 20:59:50 -08:00
Niraj Tolia
dbfc4a2772 Add Asciicinema recording to the website 2020-02-18 19:50:35 -08:00
Jarek Kowalski
f8006f8ce0 cli: removed flags for configuring global policy on repository creation 2020-02-18 12:21:11 -08:00
Jarek Kowalski
c48f03fa78 readme: added build architecture doc
The slide was generated using Google Slides and the source is public at:

https://docs.google.com/presentation/d/1VhsANHnV5vs4vCmjVTFlMpDgDUBNtyU9Ex04EX0wNRI/edit?usp=sharing

If you need to modify it, please request permissions.
2020-02-18 12:18:33 -08:00
Jarek Kowalski
f9db94ca77 travis: disable windows signing by setting CSC_LINK and CSC_KEY_PASSWORD to empty, attempt 2 2020-02-18 06:50:35 -08:00
Jarek Kowalski
795b4f14e6 travis: disable windows signing by setting CSC_LINK and CSC_KEY_PASSWORD to empty 2020-02-17 23:29:45 -08:00
Jarek Kowalski
8208990321 travis: fix --skip-sign logic 2020-02-17 21:01:26 -08:00
Jarek Kowalski
98e877f437 travis: disable signing on windows 2020-02-17 20:19:07 -08:00
Jarek Kowalski
35a7bb6038 travis: deparallelize tasks within build to reduce flakes and improve logging 2020-02-17 20:19:07 -08:00
Jarek Kowalski
7f79c77d73 Makefile: refactored tools to be installable on Windows with only minimal deps (make/curl/unzip)
This allows full kopia and kopia-ui to be built on Windows along with
running lint and integration tests.
2020-02-17 18:45:08 -08:00
Jarek Kowalski
930927547c makefile: fixed support for PATH that includes directories with spaces
Verified with:

make website PATH="/tmp/With Space:$PATH"
2020-02-17 11:23:38 -08:00
Jarek Kowalski
29db31d008 blob: fixed GCS post-submit test 2020-02-17 08:58:32 -08:00
Jarek Kowalski
47ba37f9d0 blob: fixed GCS post-submit test 2020-02-17 08:45:33 -08:00
Jarek Kowalski
022d223e1d blob: fixed GCS post-submit test 2020-02-17 08:31:39 -08:00
Prasad Ghangal
a3a55f4fa3 Add retries when creating S3 Storage obj in test
It is observed that travis CI fails sometimes due
to access key validation issue in TestS3StorageWithSessionToken.
Assuming this issue is due to eventual consistency,
we have added retries while creating S3 Storage obj

Signed-off-by: Prasad Ghangal <prasad.ghangal@gmail.com>
2020-02-17 08:16:24 -08:00
Jarek Kowalski
03dad366e1 htmlui: added first version of UI policy editor 2020-02-16 23:04:17 -08:00
Jarek Kowalski
c42b5cd89f server: API server for CRUD on individual Policies 2020-02-16 23:04:17 -08:00
Jarek Kowalski
9a96a8a770 snapshot: fixed casing of 'errorHandling' in JSON 2020-02-16 23:04:17 -08:00
Jarek Kowalski
515748a6ca htmlui: prevent flicker when refreshing snapshot sources 2020-02-16 22:43:36 -08:00
Jarek Kowalski
cc5597ed6d server: set default policy after repo creation 2020-02-16 22:43:36 -08:00
Jarek Kowalski
a7a3cd3282 htmlui: new UI flow for connecting to and creating repository 2020-02-16 22:43:36 -08:00
Jarek Kowalski
a21da7b960 cli: fixed double-close of repository during 'server start' 2020-02-16 22:43:36 -08:00
Jarek Kowalski
4cb898927c server: new APIs and error codes to support UI flow for connecting to repository 2020-02-16 22:43:36 -08:00
Jarek Kowalski
cf4f79a4d1 repo: introduced well-known error codes for connecting to repository
also disconnect from repository after connection is unsuccessful,
to prevent stale config files
2020-02-16 22:43:36 -08:00
Jarek Kowalski
0163a2da97 blob: check that GCS/S3 bucket is present when the storage is opened 2020-02-16 22:43:36 -08:00
Julio López
a9670762fd Generate shorter file names, and thus paths, in E2E tests (#229)
- Reduces name lengths by ~ 1/2
- Generate file names up to maxNameLength

Co-Authored-By: Nick <nick@kasten.io>
2020-02-14 22:25:50 -08:00
Nick
3a5d3179e7 Add WalkCrossDevice option to walk policy
Add the walk policy flag WalkCrossDevice to the fswalker Walk calls. This will avoid potential issues when running in a docker container where a FS tree is made of many overlays. Without the flag set, the Walk operation skips over files on devices that do not match the device at the base path.
2020-02-14 21:18:41 -08:00
Jarek Kowalski
8bdd5caf7e server: added retry loop when launching server 2020-02-13 17:23:50 -08:00
Jarek Kowalski
4c35ed82b9 linter fixes 2020-02-13 17:23:50 -08:00
Jarek Kowalski
0f79279f5e server: added support for new verbs in the API
/api/v1/repo/create
/api/v1/repo/connect
/api/v1/repo/disconnect

Refactored server code and fixed a number of outstanding robustness
issues. Tweaked the API responses a bit to make more sense when consumed
by the UI.
2020-02-13 17:23:50 -08:00
Jarek Kowalski
69d1ccbedf upload: Added CountingUploadProgress and new methods to UploadProgress 2020-02-13 17:23:50 -08:00