Jarek Kowalski
a6a37b709a
added pack info output to 'block list'
2017-10-08 20:49:25 -07:00
Jarek Kowalski
ce5d9b2247
output pack group when listing blocks
2017-10-08 17:40:37 -07:00
Jarek Kowalski
444b6306ca
refactored object manager to use block manager, exposed on repository
...
added CLI commands to manipulate blocks
2017-10-08 12:44:53 -07:00
Jarek Kowalski
10b9b4b451
fixed repo optimize to remove unused logical blocks
2017-10-02 22:28:00 -07:00
Jarek Kowalski
a412e45f1f
cleanup: bump worker count to 32
2017-10-01 19:15:32 -07:00
Jarek Kowalski
f96dfe471e
support for array pack indexes instead of maps
2017-10-01 16:07:55 -07:00
Jarek Kowalski
b2d9e07b75
fix 'object list' output.
2017-09-24 12:38:21 -07:00
Jarek Kowalski
1366f967f4
pack manager:
...
don't register the pack object itself with the pack
added protection from accidental deletion of the block that was just compacted
2017-09-24 12:35:12 -07:00
Jarek Kowalski
1e0ef911fa
added 'object list' subcommand
2017-09-23 11:49:04 -07:00
Jarek Kowalski
89ddf98564
added 'object verify' subcommand to verify that the given object (file or directory) has all required blocks present
...
removed GetStorageBlock(), replaced with Verify() that also returns storage blocks
added blockSizeCache.put() so that object writer can update the cache
2017-09-16 16:52:25 -07:00
Jarek Kowalski
32c603362c
removed support for inline object IDs now that packs are supported everywhere
2017-09-16 09:27:32 -07:00
Jarek Kowalski
b5a7d05adf
refactored Repository API
2017-09-15 18:35:27 -07:00
Jarek Kowalski
91e43b6842
changed how pack files get split by using the same splitter mechanism (static or dynamic) in use for regular objects
2017-09-14 19:17:19 -07:00
Jarek Kowalski
4cfa1d5706
added transparent gunzip to 'obj show'
2017-09-10 12:01:58 -07:00
Jarek Kowalski
bb64238eba
added support for pack index compaction (not the pack file compaction, which is not implemented yet). it is combining multiple pack index objects P* into one large P which loads more quickly
2017-09-09 11:07:59 -07:00
Jarek Kowalski
6ef7005396
wait for Ctrl-C when mounting
2017-09-07 20:05:58 -07:00
Jarek
fa80f40185
added support for mounting snapshots as drive letters and opening them in explorer on Windows.
2017-09-05 19:01:51 -07:00
Jarek Kowalski
82657f957d
extracted timeFormat constant for printing dates in CLI
2017-09-05 18:21:17 -07:00
Jarek Kowalski
76b712c2fb
moved creation of repofs entries to snapshot.Manager
2017-09-04 20:47:51 -07:00
Jarek Kowalski
371fc15694
merged 'repofs' into 'snapshot' package
2017-09-04 20:26:25 -07:00
Jarek Kowalski
2b032b1748
refactored FS caching flags
2017-09-04 17:49:36 -07:00
Jarek Kowalski
b08a35e92b
refactored FS cache into reusable wrapper that can be applied on top of any filesystem abstraction
2017-09-04 17:42:50 -07:00
Jarek Kowalski
8435ed4c80
beginnings of end-to-end test, cleaned up stdout vs stderr output in a few cases
2017-09-04 17:42:50 -07:00
Jarek Kowalski
e8847b65cc
mounting webdav works, changed how FS directory caching is implemented to be based solely on ObjectIDs
2017-09-02 08:29:59 -07:00
Jarek Kowalski
b5973aa998
added support for Ctrl-C unmounting of fuse filesystem
2017-09-02 07:37:51 -07:00
Jarek Kowalski
4b1547fec9
periodically refresh the metadata manager cache when mounting
2017-08-29 21:46:51 -07:00
Jarek Kowalski
998ed1ddac
simplified MetadataManager API for listing, added caching of metadata items (unbounded for now)
...
disabled go <1.9 since we're now using t.Helper(), which is awesome
2017-08-29 21:46:51 -07:00
Jarek Kowalski
4cb1339236
fixed windows build
2017-08-27 18:25:37 -07:00
Jarek Kowalski
7b766a7681
fixed liter warnings not detected by old linter
2017-08-27 15:16:27 -07:00
Jarek Kowalski
d613d99f7e
beginnings of WebDAV mounting support, not really working yet, need to do have better caching
2017-08-27 15:02:56 -07:00
Jarek Kowalski
c3064f56b0
added experimental support for WebDAV backends (use http:// or https://)
2017-08-21 22:17:04 -07:00
Jarek Kowalski
72174c4200
added 'snapshot estimate' command which counts files to snapshot while applying the current policy and estimates the time to upload
2017-08-20 13:54:28 -07:00
Jarek Kowalski
6f06e04c9a
moved genpasswd to another tool
2017-08-20 08:08:19 -07:00
Jarek Kowalski
70c9d49232
reorganized more top-level CLI commands into subcommands
2017-08-20 08:00:01 -07:00
Jarek Kowalski
f606ab4347
reorganized more top-level CLI commands into subcommands
2017-08-20 07:51:24 -07:00
Jarek Kowalski
13e328014b
moved 'expire' to 'snapshot expire'
2017-08-20 07:42:49 -07:00
Jarek Kowalski
81f060a2c3
CLI: renamed 'backup' to 'snapshot create' and 'backups' to 'snapshot list'
2017-08-19 23:44:51 -07:00
Jarek Kowalski
d2105aea40
added files policy include/exclude configuration and checking during Upload
2017-08-19 23:36:49 -07:00
Jarek Kowalski
61cc2b46be
tweaks to upload behavior: default to ignoring errors, do not hashcache recently changed files
2017-08-19 21:08:36 -07:00
Jarek Kowalski
ff487d1e85
added ability to mount special object 'all' that exposes the whole set of snapshots grouped by user@host, path and time
2017-08-19 19:49:18 -07:00
Jarek Kowalski
f0fcc60374
now that packing is transparent, inline object IDs are not needed, removed support for them and simplified ObjectWriter.Result() to no longer require a parameter
2017-08-19 14:23:09 -07:00
Jarek Kowalski
15e0d59c33
added backup --force-hashing-percentage=0..100 which can be used to re-hash all or part of source files when uploading
2017-08-18 21:13:47 -07:00
Jarek Kowalski
0c597de0fe
added --trace-object-manager flag for debugging repository operation.
2017-08-18 20:40:57 -07:00
Jarek Kowalski
5fead928e0
fixed backups and expire command output
2017-08-16 20:26:06 -07:00
Jarek Kowalski
9634a798a8
additional detail output for 'backups' command
2017-08-13 15:59:45 -07:00
Jarek Kowalski
097cf2d0b3
added option to ignore file read errors for backup and migration
2017-08-12 23:10:29 -07:00
Jarek Kowalski
60654e125b
added 'migrate' command that can move all snapshot data between repositories. It's meant to be used in a cloud VM to (relatively) quickly re-create the contents of all snapshots using new repository format. Copying is done using snapshot.Uploader on top of a virtual filesystem from the source repository.
2017-08-12 15:23:51 -07:00
Jarek Kowalski
634302701f
changed default pack file size to 20MB and pack item to 4MB
2017-08-10 22:31:13 -07:00
Jarek Kowalski
ce4d59d8bb
added support for cancelling upload with Ctrl-C which marks the snapshot as incomplete
...
added --include-incomplete to 'backups' command
improved upload API, added support for better cancellation and upload limits
changed hashcache Reader and Writer to use interfaces
2017-08-10 20:27:31 -07:00
Jarek Kowalski
a0b8a75133
changed kopia metadata show to pretty-print JSON by default since all data in the vault is JSON
2017-08-10 18:12:53 -07:00
