Commit Graph

290 Commits

Author SHA1 Message Date
Jarek Kowalski
cbb492ea09 removed buffer manager 2017-08-08 07:56:39 +02:00
Jarek Kowalski
65d188ec59 removed unnecessary optimization to avoid hashing directories, this is now unnecessary since they end up being packed most of the time so they don't incur the cost of a round-trip
disabled bundling of entries, since support for bundles will be removed soon
2017-08-08 07:56:28 +02:00
Jarek Kowalski
22fe31044c enable packing when uploading 2017-08-07 15:12:01 +02:00
Jarek Kowalski
dbeabbb1ef deprecated inline object IDs, which cause significant slowdowns to the backup process, will be much more efficient with pack files 2017-08-07 15:11:01 +02:00
Jarek Kowalski
8d714b48da parsing of pack IDs 2017-08-07 14:31:28 +02:00
Jarek Kowalski
6821b8def4 Initial support for creating pack objects, which are identified by
P<pack-id>.<block-id> and store smaller files in big objects.

For each pack there is a corresponding metadata object that ObjectID to (offset,length) within a pack object.
2017-08-07 14:18:00 +02:00
Jarek Kowalski
2dfcd23ea9 added hashcache database, based on BoltDB which caches results of computing ObjectID for any given os.FileInfo. 2017-08-04 13:19:28 +02:00
Jarek Kowalski
21a1cbd0bb renamed auth.Options to auth.SecurityOptions 2017-08-01 17:47:28 +02:00
Jarek Kowalski
df83cbea27 added status subcommand 2017-08-01 17:47:27 +02:00
Jarek Kowalski
cfbef13aff Major refactoring to how repository connections are established and managed to simplify programmatic API usage and CLI.
Removed unnecessary and confusing options, improved the API.
2017-08-01 08:35:14 +02:00
Jarek Kowalski
095fc4aba4 removed 'client' package and merged with 'repo', names still not final 2017-08-01 08:29:42 +02:00
Jarek Kowalski
4dcdb69dcc replaced use of Vault with Repository 2017-08-01 08:29:41 +02:00
Jarek Kowalski
50c2cd86a3 refactored credentials to separate package 2017-08-01 08:29:41 +02:00
Jarek Kowalski
d8b2ba4c24 moved most methods from Repository to casManager 2017-08-01 08:29:41 +02:00
Jarek Kowalski
5721ba8140 renamed repository.go to cas_manager.go in preparation for name flip 2017-08-01 08:29:41 +02:00
Jarek Kowalski
ef71993cde stale comment 2017-08-01 08:29:41 +02:00
Jarek Kowalski
cda3086dea cleanup: moved writeback to separate file 2017-08-01 08:29:41 +02:00
Jarek Kowalski
c3f0d5ddc4 moved all Vault types to 'repo' package 2017-08-01 08:29:41 +02:00
Jarek Kowalski
cab2723443 removed vault object ID storage, which was really only there to make convergent encryption UI not suck as much 2017-08-01 08:29:41 +02:00
Jarek Kowalski
989bb27f06 renamed vault.Format to vault.VaultFormat in preparation for merging with repo 2017-08-01 08:29:41 +02:00
Jarek Kowalski
dd7f78468d removed support for non-colocated repository 2017-08-01 08:29:40 +02:00
Jarek Kowalski
af62a902a9 gitignore 2017-08-01 08:29:40 +02:00
Jarek Kowalski
570dc0a897 removed support for per-objectID encryption 2017-07-18 09:23:48 +02:00
Jarek Kowalski
4a878738a0 moved main executable package to kopia/kopia, moved cli support to kopia/kopia/cli 2017-07-17 15:20:32 +02:00
Jarek Kowalski
700a4a8c92 moved Connection and ConnectionOptions to its own package 2017-07-17 14:23:15 +02:00
Jarek Kowalski
5b9f87068f switched GCS API to cloud.google.com/go which performs automatic retries and has additional auth options 2017-07-17 11:14:33 +02:00
Jarek Kowalski
90a6f9c032 added CLI to specify splitter and parameters 2017-07-17 11:13:32 +02:00
Jarek Kowalski
70c7af092c added configurable splitters to repo.Format 2017-07-14 11:54:30 +02:00
Jarek Kowalski
e411b5cfb4 updated objectWriter to use objectSplitter in preparation for adding rolling hash support 2017-07-14 11:16:01 +02:00
Jarek Kowalski
be7736d51d updated rolling hash splitter to use approximate block size instead of number of bits 2017-07-14 11:04:39 +02:00
Jarek Kowalski
e574844cd0 added objectSplitter abstraction 2017-07-13 10:17:47 +02:00
Jarek Kowalski
3624a21bec added -r and -o options to 'kopia ls' 2017-07-03 14:35:56 -07:00
Jarek Kowalski
2d1cd9b2c3 removed objectWriter.WriteGather() and simplified objectWriter.Write() 2017-07-03 10:00:04 -07:00
Jarek Kowalski
efeae91574 fixed GetStorageBlocks to handle multi-level indirections, added test 2017-07-01 22:59:43 -07:00
Jarek Kowalski
9c73b30570 stats output for 'kopia cleanup' 2017-07-01 22:18:47 -07:00
Jarek Kowalski
bea4ff047f improved logging for GCS 2017-07-01 22:18:21 -07:00
Jarek Kowalski
6e28a8688c changed blob.Storage.ListBlock() to return cancellation function 2017-07-01 12:03:42 -07:00
Jarek Kowalski
c3e1a7890d moved docs to wiki 2017-07-01 08:53:23 -07:00
Jarek Kowalski
10ca998de4 hide vault manipulation commands 2017-06-30 21:17:53 -07:00
Jarek Kowalski
6ffde87bab changed vault snapshot prefix to S from B 2017-06-18 12:56:57 -07:00
Jarek Kowalski
db4349a46d changed HMAC secret used for policy ID items in vault 2017-06-18 12:29:31 -07:00
Jarek Kowalski
a81ade291a updated 'expire' command to obey policies 2017-06-17 22:19:23 -07:00
Jarek Kowalski
2c6295af4a added ability to get/set/list/remove policies on directories, user@host or --global, not used yet 2017-06-17 21:44:29 -07:00
Jarek Kowalski
d38a3afa92 git ignore for vscode 2017-06-17 15:59:21 -07:00
Jarek Kowalski
470e44d9c0 filter out unsuccessful policies and snapshots 2017-06-17 12:46:16 -07:00
Jarek Kowalski
adc84c4858 vault breaking change - changed how vault item IDs are generated for sources to prevent confirmation of directory names via item names 2017-06-17 12:06:14 -07:00
Jarek Kowalski
8bab3eb3f1 policies work in progress 2017-02-20 17:50:20 -08:00
Jarek Kowalski
28e1a01df0 removed kopia.Connection.SnapshotManager 2017-02-04 21:50:59 -08:00
Jarek Kowalski
5e501ab1f3 readability fix 2017-02-04 10:49:46 -08:00
Jarek Kowalski
eee838f5fd snapshot manager API tweak 2017-01-30 20:52:33 -08:00