Commit Graph

44 Commits

Author SHA1 Message Date
Jarek Kowalski
e8847b65cc mounting webdav works, changed how FS directory caching is implemented to be based solely on ObjectIDs 2017-09-02 08:29:59 -07:00
Jarek Kowalski
b5973aa998 added support for Ctrl-C unmounting of fuse filesystem 2017-09-02 07:37:51 -07:00
Jarek Kowalski
4b1547fec9 periodically refresh the metadata manager cache when mounting 2017-08-29 21:46:51 -07:00
Jarek Kowalski
998ed1ddac simplified MetadataManager API for listing, added caching of metadata items (unbounded for now)
disabled go <1.9 since we're now using t.Helper(), which is awesome
2017-08-29 21:46:51 -07:00
Jarek Kowalski
4cb1339236 fixed windows build 2017-08-27 18:25:37 -07:00
Jarek Kowalski
7b766a7681 fixed liter warnings not detected by old linter 2017-08-27 15:16:27 -07:00
Jarek Kowalski
d613d99f7e beginnings of WebDAV mounting support, not really working yet, need to do have better caching 2017-08-27 15:02:56 -07:00
Jarek Kowalski
c3064f56b0 added experimental support for WebDAV backends (use http:// or https://) 2017-08-21 22:17:04 -07:00
Jarek Kowalski
72174c4200 added 'snapshot estimate' command which counts files to snapshot while applying the current policy and estimates the time to upload 2017-08-20 13:54:28 -07:00
Jarek Kowalski
6f06e04c9a moved genpasswd to another tool 2017-08-20 08:08:19 -07:00
Jarek Kowalski
70c9d49232 reorganized more top-level CLI commands into subcommands 2017-08-20 08:00:01 -07:00
Jarek Kowalski
f606ab4347 reorganized more top-level CLI commands into subcommands 2017-08-20 07:51:24 -07:00
Jarek Kowalski
13e328014b moved 'expire' to 'snapshot expire' 2017-08-20 07:42:49 -07:00
Jarek Kowalski
81f060a2c3 CLI: renamed 'backup' to 'snapshot create' and 'backups' to 'snapshot list' 2017-08-19 23:44:51 -07:00
Jarek Kowalski
d2105aea40 added files policy include/exclude configuration and checking during Upload 2017-08-19 23:36:49 -07:00
Jarek Kowalski
61cc2b46be tweaks to upload behavior: default to ignoring errors, do not hashcache recently changed files 2017-08-19 21:08:36 -07:00
Jarek Kowalski
ff487d1e85 added ability to mount special object 'all' that exposes the whole set of snapshots grouped by user@host, path and time 2017-08-19 19:49:18 -07:00
Jarek Kowalski
f0fcc60374 now that packing is transparent, inline object IDs are not needed, removed support for them and simplified ObjectWriter.Result() to no longer require a parameter 2017-08-19 14:23:09 -07:00
Jarek Kowalski
15e0d59c33 added backup --force-hashing-percentage=0..100 which can be used to re-hash all or part of source files when uploading 2017-08-18 21:13:47 -07:00
Jarek Kowalski
0c597de0fe added --trace-object-manager flag for debugging repository operation. 2017-08-18 20:40:57 -07:00
Jarek Kowalski
5fead928e0 fixed backups and expire command output 2017-08-16 20:26:06 -07:00
Jarek Kowalski
9634a798a8 additional detail output for 'backups' command 2017-08-13 15:59:45 -07:00
Jarek Kowalski
097cf2d0b3 added option to ignore file read errors for backup and migration 2017-08-12 23:10:29 -07:00
Jarek Kowalski
60654e125b added 'migrate' command that can move all snapshot data between repositories. It's meant to be used in a cloud VM to (relatively) quickly re-create the contents of all snapshots using new repository format. Copying is done using snapshot.Uploader on top of a virtual filesystem from the source repository. 2017-08-12 15:23:51 -07:00
Jarek Kowalski
634302701f changed default pack file size to 20MB and pack item to 4MB 2017-08-10 22:31:13 -07:00
Jarek Kowalski
ce4d59d8bb added support for cancelling upload with Ctrl-C which marks the snapshot as incomplete
added --include-incomplete to 'backups' command
improved upload API, added support for better cancellation and upload limits
changed hashcache Reader and Writer to use interfaces
2017-08-10 20:27:31 -07:00
Jarek Kowalski
a0b8a75133 changed kopia metadata show to pretty-print JSON by default since all data in the vault is JSON 2017-08-10 18:12:53 -07:00
Jarek Kowalski
036ce15a88 move throttling to GCS storage options and create/connect flags 2017-08-10 17:29:45 -07:00
Jarek Kowalski
9ba224854e fixed throttling in GCS provider 2017-08-09 19:47:14 -07:00
Jarek Kowalski
19339345e9 cleaned up connect/create CLI options 2017-08-09 16:59:53 -07:00
Jarek Kowalski
f9a0a5dfaf fix for create incorrectly handling store errors 2017-08-09 08:14:10 -07:00
Jarek Kowalski
dbeabbb1ef deprecated inline object IDs, which cause significant slowdowns to the backup process, will be much more efficient with pack files 2017-08-07 15:11:01 +02:00
Jarek Kowalski
6821b8def4 Initial support for creating pack objects, which are identified by
P<pack-id>.<block-id> and store smaller files in big objects.

For each pack there is a corresponding metadata object that ObjectID to (offset,length) within a pack object.
2017-08-07 14:18:00 +02:00
Jarek Kowalski
df83cbea27 added status subcommand 2017-08-01 17:47:27 +02:00
Jarek Kowalski
cfbef13aff Major refactoring to how repository connections are established and managed to simplify programmatic API usage and CLI.
Removed unnecessary and confusing options, improved the API.
2017-08-01 08:35:14 +02:00
Jarek Kowalski
095fc4aba4 removed 'client' package and merged with 'repo', names still not final 2017-08-01 08:29:42 +02:00
Jarek Kowalski
4dcdb69dcc replaced use of Vault with Repository 2017-08-01 08:29:41 +02:00
Jarek Kowalski
50c2cd86a3 refactored credentials to separate package 2017-08-01 08:29:41 +02:00
Jarek Kowalski
d8b2ba4c24 moved most methods from Repository to casManager 2017-08-01 08:29:41 +02:00
Jarek Kowalski
c3f0d5ddc4 moved all Vault types to 'repo' package 2017-08-01 08:29:41 +02:00
Jarek Kowalski
cab2723443 removed vault object ID storage, which was really only there to make convergent encryption UI not suck as much 2017-08-01 08:29:41 +02:00
Jarek Kowalski
989bb27f06 renamed vault.Format to vault.VaultFormat in preparation for merging with repo 2017-08-01 08:29:41 +02:00
Jarek Kowalski
dd7f78468d removed support for non-colocated repository 2017-08-01 08:29:40 +02:00
Jarek Kowalski
4a878738a0 moved main executable package to kopia/kopia, moved cli support to kopia/kopia/cli 2017-07-17 15:20:32 +02:00