5 Commits

Author	SHA1	Message	Date
Jarek Kowalski	c57531b751	switched Go logging library to github.com/op/go-logging which lets us override log levels per module	2018-07-09 21:28:12 -07:00
Jarek Kowalski	d6477377f9	changed how index compaction works: ... instead of having time-based naming, block manager will perform occasional compaction at startup time and delete unwanted blocks The protocol is safe from concurrency standpoint and provides eventual consistency. We only delete blocks after creating compacted blocks. We retry loading index until (any) consistent index is fetched (possibly from cache) and all underlying blocks are also available, not necessarily the latest ones. TODO - we need to periodically snapshot block index contents, so that if we have a bug somewhere in compaction code, we have a way of restoring working indexes.	2018-05-15 20:10:50 -07:00
Jarek Kowalski	6f7b3b8a80	fixed stress test failures due to expiration of a context	2018-05-09 22:22:37 -07:00
Jarek Kowalski	3a02ef24e0	retire block.ContentID and replace with string	2018-05-05 16:16:48 -07:00
Jarek Kowalski	be3c4e725e	added stress test	2018-05-05 16:14:31 -07:00