Commit Graph

89 Commits

Author SHA1 Message Date
Jarek Kowalski
a644f2caa6 added 'manifest show' subcommand 2017-11-27 18:49:46 -08:00
Jarek Kowalski
30c11dc926 refactored block manager to support on-disk caching 2017-11-27 18:07:16 -08:00
Jarek Kowalski
a700508048 changed API for manifest manager, added filtering, sorting and better output to 'manifest ls' 2017-11-27 18:06:28 -08:00
Jarek Kowalski
eebb04c0cb added 'manifest ls' subcommand 2017-11-27 18:05:44 -08:00
Jarek Kowalski
6e83ad0b9b moved policies to separate package
refactored policy management into policy.Manager that uses manifest.Manager internally
2017-11-27 18:05:32 -08:00
Jarek Kowalski
d3b854ef8e optimized format for pack index, added compacted block with suffix -zTIMESTAMP where TIMESTAMP is base16-encoded unix nanoseconds of all blocks that this block supersedes, this allows much more efficient loading of blocks without having to delete anything 2017-11-23 15:55:56 -08:00
Jarek Kowalski
40a367f79e added 'block rm' subcommand 2017-11-12 22:43:21 -08:00
Jarek Kowalski
0f6c569435 refactored repository status 2017-10-29 10:35:06 -07:00
Jarek Kowalski
b6575a97ba moved metadata manager to 'metadata' package and refactored initialization sequence 2017-10-29 10:29:22 -07:00
Jarek Kowalski
3498f78d91 dead code cleanup 2017-10-28 22:50:11 -07:00
Jarek Kowalski
e76f1f8a72 refactored various show command into one 2017-10-24 21:59:40 -07:00
Jarek Kowalski
a48d54f00b added 'block show' similar to 'object show', but operating on virtual blocks 2017-10-24 21:15:22 -07:00
Jarek Kowalski
b4e6a70e09 renamed 'repo optimize' to 'block reindex', added repacking method and unit tests 2017-10-24 21:05:59 -07:00
Jarek Kowalski
2aa44eb454 added listing group blocks and summary to 'block list' 2017-10-17 19:24:16 -07:00
Jarek Kowalski
a45f557c4b changed object.ManagerOptions into a struct 2017-10-14 16:38:27 -07:00
Jarek Kowalski
a715522c34 improved block stats output 2017-10-14 16:38:27 -07:00
Jarek Kowalski
b5d0f2d120 more renames 2017-10-14 16:38:27 -07:00
Jarek Kowalski
0e48800f1a removed ObjectIDSection support, no longer needed because of packs 2017-10-14 16:38:22 -07:00
Jarek Kowalski
c3f31d744f removed stuttering 2017-10-14 16:38:22 -07:00
Jarek Kowalski
31e5bce1cb moved object management to kopia/kopia/object 2017-10-14 16:38:22 -07:00
Jarek Kowalski
f33ae14573 renamed 'blob.Storage' to 'storage.Storage' 2017-10-14 16:38:09 -07:00
Jarek Kowalski
cc3e590136 moved block manager and formatter to a separate package 2017-10-09 06:42:30 -07:00
Jarek Kowalski
a6a37b709a added pack info output to 'block list' 2017-10-08 20:49:25 -07:00
Jarek Kowalski
ce5d9b2247 output pack group when listing blocks 2017-10-08 17:40:37 -07:00
Jarek Kowalski
444b6306ca refactored object manager to use block manager, exposed on repository
added CLI commands to manipulate blocks
2017-10-08 12:44:53 -07:00
Jarek Kowalski
10b9b4b451 fixed repo optimize to remove unused logical blocks 2017-10-02 22:28:00 -07:00
Jarek Kowalski
a412e45f1f cleanup: bump worker count to 32 2017-10-01 19:15:32 -07:00
Jarek Kowalski
f96dfe471e support for array pack indexes instead of maps 2017-10-01 16:07:55 -07:00
Jarek Kowalski
b2d9e07b75 fix 'object list' output. 2017-09-24 12:38:21 -07:00
Jarek Kowalski
1366f967f4 pack manager:
don't register the pack object itself with the pack
added protection from accidental deletion of the block that was just compacted
2017-09-24 12:35:12 -07:00
Jarek Kowalski
1e0ef911fa added 'object list' subcommand 2017-09-23 11:49:04 -07:00
Jarek Kowalski
89ddf98564 added 'object verify' subcommand to verify that the given object (file or directory) has all required blocks present
removed GetStorageBlock(), replaced with Verify() that also returns storage blocks
added blockSizeCache.put() so that object writer can update the cache
2017-09-16 16:52:25 -07:00
Jarek Kowalski
32c603362c removed support for inline object IDs now that packs are supported everywhere 2017-09-16 09:27:32 -07:00
Jarek Kowalski
b5a7d05adf refactored Repository API 2017-09-15 18:35:27 -07:00
Jarek Kowalski
91e43b6842 changed how pack files get split by using the same splitter mechanism (static or dynamic) in use for regular objects 2017-09-14 19:17:19 -07:00
Jarek Kowalski
4cfa1d5706 added transparent gunzip to 'obj show' 2017-09-10 12:01:58 -07:00
Jarek Kowalski
bb64238eba added support for pack index compaction (not the pack file compaction, which is not implemented yet). it is combining multiple pack index objects P* into one large P which loads more quickly 2017-09-09 11:07:59 -07:00
Jarek Kowalski
6ef7005396 wait for Ctrl-C when mounting 2017-09-07 20:05:58 -07:00
Jarek
fa80f40185 added support for mounting snapshots as drive letters and opening them in explorer on Windows. 2017-09-05 19:01:51 -07:00
Jarek Kowalski
82657f957d extracted timeFormat constant for printing dates in CLI 2017-09-05 18:21:17 -07:00
Jarek Kowalski
76b712c2fb moved creation of repofs entries to snapshot.Manager 2017-09-04 20:47:51 -07:00
Jarek Kowalski
371fc15694 merged 'repofs' into 'snapshot' package 2017-09-04 20:26:25 -07:00
Jarek Kowalski
2b032b1748 refactored FS caching flags 2017-09-04 17:49:36 -07:00
Jarek Kowalski
b08a35e92b refactored FS cache into reusable wrapper that can be applied on top of any filesystem abstraction 2017-09-04 17:42:50 -07:00
Jarek Kowalski
8435ed4c80 beginnings of end-to-end test, cleaned up stdout vs stderr output in a few cases 2017-09-04 17:42:50 -07:00
Jarek Kowalski
e8847b65cc mounting webdav works, changed how FS directory caching is implemented to be based solely on ObjectIDs 2017-09-02 08:29:59 -07:00
Jarek Kowalski
b5973aa998 added support for Ctrl-C unmounting of fuse filesystem 2017-09-02 07:37:51 -07:00
Jarek Kowalski
4b1547fec9 periodically refresh the metadata manager cache when mounting 2017-08-29 21:46:51 -07:00
Jarek Kowalski
998ed1ddac simplified MetadataManager API for listing, added caching of metadata items (unbounded for now)
disabled go <1.9 since we're now using t.Helper(), which is awesome
2017-08-29 21:46:51 -07:00
Jarek Kowalski
4cb1339236 fixed windows build 2017-08-27 18:25:37 -07:00