Jarek Kowalski
89ddf98564
added 'object verify' subcommand to verify that the given object (file or directory) has all required blocks present
...
removed GetStorageBlock(), replaced with Verify() that also returns storage blocks
added blockSizeCache.put() so that object writer can update the cache
2017-09-16 16:52:25 -07:00
Jarek Kowalski
32c603362c
removed support for inline object IDs now that packs are supported everywhere
2017-09-16 09:27:32 -07:00
Jarek Kowalski
b5a7d05adf
refactored Repository API
2017-09-15 18:35:27 -07:00
Jarek Kowalski
91e43b6842
changed how pack files get split by using the same splitter mechanism (static or dynamic) in use for regular objects
2017-09-14 19:17:19 -07:00
Jarek Kowalski
4cfa1d5706
added transparent gunzip to 'obj show'
2017-09-10 12:01:58 -07:00
Jarek Kowalski
bb64238eba
added support for pack index compaction (not the pack file compaction, which is not implemented yet). it is combining multiple pack index objects P* into one large P which loads more quickly
2017-09-09 11:07:59 -07:00
Jarek Kowalski
6ef7005396
wait for Ctrl-C when mounting
2017-09-07 20:05:58 -07:00
Jarek
fa80f40185
added support for mounting snapshots as drive letters and opening them in explorer on Windows.
2017-09-05 19:01:51 -07:00
Jarek Kowalski
82657f957d
extracted timeFormat constant for printing dates in CLI
2017-09-05 18:21:17 -07:00
Jarek Kowalski
76b712c2fb
moved creation of repofs entries to snapshot.Manager
2017-09-04 20:47:51 -07:00
Jarek Kowalski
371fc15694
merged 'repofs' into 'snapshot' package
2017-09-04 20:26:25 -07:00
Jarek Kowalski
2b032b1748
refactored FS caching flags
2017-09-04 17:49:36 -07:00
Jarek Kowalski
b08a35e92b
refactored FS cache into reusable wrapper that can be applied on top of any filesystem abstraction
2017-09-04 17:42:50 -07:00
Jarek Kowalski
8435ed4c80
beginnings of end-to-end test, cleaned up stdout vs stderr output in a few cases
2017-09-04 17:42:50 -07:00
Jarek Kowalski
e8847b65cc
mounting webdav works, changed how FS directory caching is implemented to be based solely on ObjectIDs
2017-09-02 08:29:59 -07:00
Jarek Kowalski
b5973aa998
added support for Ctrl-C unmounting of fuse filesystem
2017-09-02 07:37:51 -07:00
Jarek Kowalski
4b1547fec9
periodically refresh the metadata manager cache when mounting
2017-08-29 21:46:51 -07:00
Jarek Kowalski
998ed1ddac
simplified MetadataManager API for listing, added caching of metadata items (unbounded for now)
...
disabled go <1.9 since we're now using t.Helper(), which is awesome
2017-08-29 21:46:51 -07:00
Jarek Kowalski
4cb1339236
fixed windows build
2017-08-27 18:25:37 -07:00
Jarek Kowalski
7b766a7681
fixed liter warnings not detected by old linter
2017-08-27 15:16:27 -07:00
Jarek Kowalski
d613d99f7e
beginnings of WebDAV mounting support, not really working yet, need to do have better caching
2017-08-27 15:02:56 -07:00
Jarek Kowalski
c3064f56b0
added experimental support for WebDAV backends (use http:// or https://)
2017-08-21 22:17:04 -07:00
Jarek Kowalski
72174c4200
added 'snapshot estimate' command which counts files to snapshot while applying the current policy and estimates the time to upload
2017-08-20 13:54:28 -07:00
Jarek Kowalski
6f06e04c9a
moved genpasswd to another tool
2017-08-20 08:08:19 -07:00
Jarek Kowalski
70c9d49232
reorganized more top-level CLI commands into subcommands
2017-08-20 08:00:01 -07:00
Jarek Kowalski
f606ab4347
reorganized more top-level CLI commands into subcommands
2017-08-20 07:51:24 -07:00
Jarek Kowalski
13e328014b
moved 'expire' to 'snapshot expire'
2017-08-20 07:42:49 -07:00
Jarek Kowalski
81f060a2c3
CLI: renamed 'backup' to 'snapshot create' and 'backups' to 'snapshot list'
2017-08-19 23:44:51 -07:00
Jarek Kowalski
d2105aea40
added files policy include/exclude configuration and checking during Upload
2017-08-19 23:36:49 -07:00
Jarek Kowalski
61cc2b46be
tweaks to upload behavior: default to ignoring errors, do not hashcache recently changed files
2017-08-19 21:08:36 -07:00
Jarek Kowalski
ff487d1e85
added ability to mount special object 'all' that exposes the whole set of snapshots grouped by user@host, path and time
2017-08-19 19:49:18 -07:00
Jarek Kowalski
f0fcc60374
now that packing is transparent, inline object IDs are not needed, removed support for them and simplified ObjectWriter.Result() to no longer require a parameter
2017-08-19 14:23:09 -07:00
Jarek Kowalski
15e0d59c33
added backup --force-hashing-percentage=0..100 which can be used to re-hash all or part of source files when uploading
2017-08-18 21:13:47 -07:00
Jarek Kowalski
0c597de0fe
added --trace-object-manager flag for debugging repository operation.
2017-08-18 20:40:57 -07:00
Jarek Kowalski
5fead928e0
fixed backups and expire command output
2017-08-16 20:26:06 -07:00
Jarek Kowalski
9634a798a8
additional detail output for 'backups' command
2017-08-13 15:59:45 -07:00
Jarek Kowalski
097cf2d0b3
added option to ignore file read errors for backup and migration
2017-08-12 23:10:29 -07:00
Jarek Kowalski
60654e125b
added 'migrate' command that can move all snapshot data between repositories. It's meant to be used in a cloud VM to (relatively) quickly re-create the contents of all snapshots using new repository format. Copying is done using snapshot.Uploader on top of a virtual filesystem from the source repository.
2017-08-12 15:23:51 -07:00
Jarek Kowalski
634302701f
changed default pack file size to 20MB and pack item to 4MB
2017-08-10 22:31:13 -07:00
Jarek Kowalski
ce4d59d8bb
added support for cancelling upload with Ctrl-C which marks the snapshot as incomplete
...
added --include-incomplete to 'backups' command
improved upload API, added support for better cancellation and upload limits
changed hashcache Reader and Writer to use interfaces
2017-08-10 20:27:31 -07:00
Jarek Kowalski
a0b8a75133
changed kopia metadata show to pretty-print JSON by default since all data in the vault is JSON
2017-08-10 18:12:53 -07:00
Jarek Kowalski
036ce15a88
move throttling to GCS storage options and create/connect flags
2017-08-10 17:29:45 -07:00
Jarek Kowalski
9ba224854e
fixed throttling in GCS provider
2017-08-09 19:47:14 -07:00
Jarek Kowalski
19339345e9
cleaned up connect/create CLI options
2017-08-09 16:59:53 -07:00
Jarek Kowalski
f9a0a5dfaf
fix for create incorrectly handling store errors
2017-08-09 08:14:10 -07:00
Jarek Kowalski
dbeabbb1ef
deprecated inline object IDs, which cause significant slowdowns to the backup process, will be much more efficient with pack files
2017-08-07 15:11:01 +02:00
Jarek Kowalski
6821b8def4
Initial support for creating pack objects, which are identified by
...
P<pack-id>.<block-id> and store smaller files in big objects.
For each pack there is a corresponding metadata object that ObjectID to (offset,length) within a pack object.
2017-08-07 14:18:00 +02:00
Jarek Kowalski
df83cbea27
added status subcommand
2017-08-01 17:47:27 +02:00
Jarek Kowalski
cfbef13aff
Major refactoring to how repository connections are established and managed to simplify programmatic API usage and CLI.
...
Removed unnecessary and confusing options, improved the API.
2017-08-01 08:35:14 +02:00
Jarek Kowalski
095fc4aba4
removed 'client' package and merged with 'repo', names still not final
2017-08-01 08:29:42 +02:00
Jarek Kowalski