Michał Matczuk 399cf18013 s3: use single memory pool
Previously we had a map of pools for different chunk sizes.
In practice the mapping is not very useful and requires a lock.
Pools of size other that ChunkSize can only happen when we have a huge file (over 10k * ChunkSize).
We need to have a bunch of identically sized huge files.
In such case most likely ChunkSize should be increased.

The mapping and its lock is replaced with a single initialised pool for ChunkSize, in other cases pool is allocated and freed on per file basis.
2020-04-11 16:34:05 +01:00
2020-04-11 16:34:05 +01:00
2020-04-03 10:36:24 +01:00
2019-09-17 10:12:32 +01:00
2020-03-16 15:50:04 +00:00
2020-03-16 15:50:04 +00:00
2020-01-17 11:47:40 +00:00
2020-02-01 10:40:01 +00:00
2020-02-01 10:40:01 +00:00
2020-02-01 10:40:01 +00:00
2020-02-01 10:40:01 +00:00
2019-09-29 11:05:10 +01:00
2020-02-01 12:32:21 +00:00
2020-02-01 10:40:01 +00:00

rclone logo

Website | Documentation | Download | Contributing | Changelog | Installation | Forum

Build Status Go Report Card GoDoc Docker Pulls

Rclone

Rclone ("rsync for cloud storage") is a command line program to sync files and directories to and from different cloud storage providers.

Storage providers

Please see the full list of all storage providers and their features

Features

  • MD5/SHA-1 hashes checked at all times for file integrity
  • Timestamps preserved on files
  • Partial syncs supported on a whole file basis
  • Copy mode to just copy new/changed files
  • Sync (one way) mode to make a directory identical
  • Check mode to check for file hash equality
  • Can sync to and from network, e.g. two different cloud accounts
  • Optional large file chunking (Chunker)
  • Optional encryption (Crypt)
  • Optional cache (Cache)
  • Optional FUSE mount (rclone mount)
  • Multi-threaded downloads to local disk
  • Can serve local or remote files over HTTP/WebDav/FTP/SFTP/dlna

Installation & documentation

Please see the rclone website for:

Downloads

License

This is free software under the terms of MIT the license (check the COPYING file included in this package).

Description
No description provided
Readme 799 MiB
Languages
Go 98.4%
Shell 0.5%
Python 0.4%
HTML 0.3%
JavaScript 0.2%
Other 0.1%