Commit Graph

53 Commits

Author SHA1 Message Date
Jarek Kowalski
bb64238eba added support for pack index compaction (not the pack file compaction, which is not implemented yet). it is combining multiple pack index objects P* into one large P which loads more quickly 2017-09-09 11:07:59 -07:00
Jarek Kowalski
6ef7005396 wait for Ctrl-C when mounting 2017-09-07 20:05:58 -07:00
Jarek
fa80f40185 added support for mounting snapshots as drive letters and opening them in explorer on Windows. 2017-09-05 19:01:51 -07:00
Jarek Kowalski
82657f957d extracted timeFormat constant for printing dates in CLI 2017-09-05 18:21:17 -07:00
Jarek Kowalski
76b712c2fb moved creation of repofs entries to snapshot.Manager 2017-09-04 20:47:51 -07:00
Jarek Kowalski
371fc15694 merged 'repofs' into 'snapshot' package 2017-09-04 20:26:25 -07:00
Jarek Kowalski
2b032b1748 refactored FS caching flags 2017-09-04 17:49:36 -07:00
Jarek Kowalski
b08a35e92b refactored FS cache into reusable wrapper that can be applied on top of any filesystem abstraction 2017-09-04 17:42:50 -07:00
Jarek Kowalski
8435ed4c80 beginnings of end-to-end test, cleaned up stdout vs stderr output in a few cases 2017-09-04 17:42:50 -07:00
Jarek Kowalski
e8847b65cc mounting webdav works, changed how FS directory caching is implemented to be based solely on ObjectIDs 2017-09-02 08:29:59 -07:00
Jarek Kowalski
b5973aa998 added support for Ctrl-C unmounting of fuse filesystem 2017-09-02 07:37:51 -07:00
Jarek Kowalski
4b1547fec9 periodically refresh the metadata manager cache when mounting 2017-08-29 21:46:51 -07:00
Jarek Kowalski
998ed1ddac simplified MetadataManager API for listing, added caching of metadata items (unbounded for now)
disabled go <1.9 since we're now using t.Helper(), which is awesome
2017-08-29 21:46:51 -07:00
Jarek Kowalski
4cb1339236 fixed windows build 2017-08-27 18:25:37 -07:00
Jarek Kowalski
7b766a7681 fixed liter warnings not detected by old linter 2017-08-27 15:16:27 -07:00
Jarek Kowalski
d613d99f7e beginnings of WebDAV mounting support, not really working yet, need to do have better caching 2017-08-27 15:02:56 -07:00
Jarek Kowalski
c3064f56b0 added experimental support for WebDAV backends (use http:// or https://) 2017-08-21 22:17:04 -07:00
Jarek Kowalski
72174c4200 added 'snapshot estimate' command which counts files to snapshot while applying the current policy and estimates the time to upload 2017-08-20 13:54:28 -07:00
Jarek Kowalski
6f06e04c9a moved genpasswd to another tool 2017-08-20 08:08:19 -07:00
Jarek Kowalski
70c9d49232 reorganized more top-level CLI commands into subcommands 2017-08-20 08:00:01 -07:00
Jarek Kowalski
f606ab4347 reorganized more top-level CLI commands into subcommands 2017-08-20 07:51:24 -07:00
Jarek Kowalski
13e328014b moved 'expire' to 'snapshot expire' 2017-08-20 07:42:49 -07:00
Jarek Kowalski
81f060a2c3 CLI: renamed 'backup' to 'snapshot create' and 'backups' to 'snapshot list' 2017-08-19 23:44:51 -07:00
Jarek Kowalski
d2105aea40 added files policy include/exclude configuration and checking during Upload 2017-08-19 23:36:49 -07:00
Jarek Kowalski
61cc2b46be tweaks to upload behavior: default to ignoring errors, do not hashcache recently changed files 2017-08-19 21:08:36 -07:00
Jarek Kowalski
ff487d1e85 added ability to mount special object 'all' that exposes the whole set of snapshots grouped by user@host, path and time 2017-08-19 19:49:18 -07:00
Jarek Kowalski
f0fcc60374 now that packing is transparent, inline object IDs are not needed, removed support for them and simplified ObjectWriter.Result() to no longer require a parameter 2017-08-19 14:23:09 -07:00
Jarek Kowalski
15e0d59c33 added backup --force-hashing-percentage=0..100 which can be used to re-hash all or part of source files when uploading 2017-08-18 21:13:47 -07:00
Jarek Kowalski
0c597de0fe added --trace-object-manager flag for debugging repository operation. 2017-08-18 20:40:57 -07:00
Jarek Kowalski
5fead928e0 fixed backups and expire command output 2017-08-16 20:26:06 -07:00
Jarek Kowalski
9634a798a8 additional detail output for 'backups' command 2017-08-13 15:59:45 -07:00
Jarek Kowalski
097cf2d0b3 added option to ignore file read errors for backup and migration 2017-08-12 23:10:29 -07:00
Jarek Kowalski
60654e125b added 'migrate' command that can move all snapshot data between repositories. It's meant to be used in a cloud VM to (relatively) quickly re-create the contents of all snapshots using new repository format. Copying is done using snapshot.Uploader on top of a virtual filesystem from the source repository. 2017-08-12 15:23:51 -07:00
Jarek Kowalski
634302701f changed default pack file size to 20MB and pack item to 4MB 2017-08-10 22:31:13 -07:00
Jarek Kowalski
ce4d59d8bb added support for cancelling upload with Ctrl-C which marks the snapshot as incomplete
added --include-incomplete to 'backups' command
improved upload API, added support for better cancellation and upload limits
changed hashcache Reader and Writer to use interfaces
2017-08-10 20:27:31 -07:00
Jarek Kowalski
a0b8a75133 changed kopia metadata show to pretty-print JSON by default since all data in the vault is JSON 2017-08-10 18:12:53 -07:00
Jarek Kowalski
036ce15a88 move throttling to GCS storage options and create/connect flags 2017-08-10 17:29:45 -07:00
Jarek Kowalski
9ba224854e fixed throttling in GCS provider 2017-08-09 19:47:14 -07:00
Jarek Kowalski
19339345e9 cleaned up connect/create CLI options 2017-08-09 16:59:53 -07:00
Jarek Kowalski
f9a0a5dfaf fix for create incorrectly handling store errors 2017-08-09 08:14:10 -07:00
Jarek Kowalski
dbeabbb1ef deprecated inline object IDs, which cause significant slowdowns to the backup process, will be much more efficient with pack files 2017-08-07 15:11:01 +02:00
Jarek Kowalski
6821b8def4 Initial support for creating pack objects, which are identified by
P<pack-id>.<block-id> and store smaller files in big objects.

For each pack there is a corresponding metadata object that ObjectID to (offset,length) within a pack object.
2017-08-07 14:18:00 +02:00
Jarek Kowalski
df83cbea27 added status subcommand 2017-08-01 17:47:27 +02:00
Jarek Kowalski
cfbef13aff Major refactoring to how repository connections are established and managed to simplify programmatic API usage and CLI.
Removed unnecessary and confusing options, improved the API.
2017-08-01 08:35:14 +02:00
Jarek Kowalski
095fc4aba4 removed 'client' package and merged with 'repo', names still not final 2017-08-01 08:29:42 +02:00
Jarek Kowalski
4dcdb69dcc replaced use of Vault with Repository 2017-08-01 08:29:41 +02:00
Jarek Kowalski
50c2cd86a3 refactored credentials to separate package 2017-08-01 08:29:41 +02:00
Jarek Kowalski
d8b2ba4c24 moved most methods from Repository to casManager 2017-08-01 08:29:41 +02:00
Jarek Kowalski
c3f0d5ddc4 moved all Vault types to 'repo' package 2017-08-01 08:29:41 +02:00
Jarek Kowalski
cab2723443 removed vault object ID storage, which was really only there to make convergent encryption UI not suck as much 2017-08-01 08:29:41 +02:00