Andrey Prygunkov
24fd4e8c15
#26 , #60 , #64 , #70 : corrected file permissions
2015-08-11 22:31:59 +02:00
Andrey Prygunkov
5b460b7512
#64 : improved progress calculation during extra par-scan
2015-08-10 19:52:27 +02:00
Andrey Prygunkov
2a9f9f8e98
#64 : implemented dupe matcher
...
Before scanning of dupe directories the directories are quickly checked
by dupe matcher. It determines if they contain or may contain the same
content. If the dupe checker detects a dupe containing different
content as the download being currently processed by par-checker, such
extra dupe is skipped to save time during dupe par scan.
2015-08-07 18:38:51 +02:00
Andrey Prygunkov
a11d22d3e0
#64 : small adjustments in debug logging
2015-08-02 16:59:49 +02:00
Andrey Prygunkov
d07b9af366
#64 : process more pars again, after dupe par-check
2015-08-02 16:59:25 +02:00
Andrey Prygunkov
941c2efb52
#64 : first use par2-files, then scan dupes
2015-08-02 01:32:59 +02:00
Andrey Prygunkov
820260cb6c
#64 : in option "ParScan" renamed mode "auto" to "extended"
...
Now having four modes: limited, extended, full and dupe.
2015-08-02 00:38:39 +02:00
Andrey Prygunkov
c674405b44
#64 : renamed value "Beyond" to "Dupe"
...
in option ParScan. The new value name suits better.
2015-08-01 01:23:34 +02:00
Andrey Prygunkov
1a206457a2
#64 : new par-scan mode "beyond"
...
- new value for option “ParScan” - “Beyond”;
- in this mode the files from other downloads (duplicates) are scanned
as well;
- this helps if both downloads contain the same file inside archive,
even if the archives were created with different split-settings and
different par-sets.
2015-07-31 21:26:14 +02:00
Andrey Prygunkov
c93c0e9dce
#41 : removed spinlocks support
2015-07-17 23:43:53 +02:00
Andrey Prygunkov
4daf01e683
fixed few compiler warnings in Windows
2015-07-13 21:13:26 +02:00
Andrey Prygunkov
734dbfc98b
refactor: changed one parameter in par2-module from "double" to "int"
2015-06-05 10:55:11 +00:00
Andrey Prygunkov
5d24697b0c
refactor: reworked declaration of global objects (singletones)
2015-05-22 20:28:05 +00:00
Andrey Prygunkov
27fd8989d8
fixed: par-verification of repaired files were sometimes not skipped in quick verification mode (option "ParQuick=yes")
2015-05-21 14:41:14 +00:00
Andrey Prygunkov
a641bd8bd1
refactor: reducing module dependencies for easier testing: extracted par file name parsing code from module "ParCoordinator" into new module "ParParser", which can be instantiated separately
2015-05-21 14:33:16 +00:00
Andrey Prygunkov
240ccdc65e
fixed: par-check in full verification mode (not in quick mode) could not detected damaged files if they were completely empty (0 bytes), which is possible when option "DirectWrite" was not active and all articles of the file were missing
2015-03-10 22:13:06 +00:00
Andrey Prygunkov
bad4c7ed34
renamed option "CreateBrokenLog" to "BrokenLog"; the old option name is recognized and automatically converted when the configuration is saved in web-interface
2015-02-27 18:43:15 +00:00
Andrey Prygunkov
7e6f8f19eb
each nzb now has its own individual log, where messages printed during download or post-processing are saved; the messages can be retrieved later at any time; new button "Log" in the history details dialog; button "Log" in the download details dialog is now active during download too (not only during post-processing); the log contains all nzb-related messages except detail-messages and errors printed during retrieving of articles (they would produce way too many messages and are not that useful anyway); new option "NzbLog" to deactivate per-nzb logging if necessary; per-nzb logs are saved in the queue-directory (option "QueueDir"); new RPC-method "loadlog" returns the previously saved messages for a given nzb-file; new field "MessageCount" is returned by RPC-methods "listgroups" and "history" and indicates if there are any messages saved for the item; parameter "NumberOfLogEntries" of RPC-method "listgroups" and the field "Log" returned by the method are now deprecated, use method "loadlag" instead; field "PostInfoText" returned by RPC-method "listgroups" is now automatically filled with the latest message printed by a pp-script eliminating the need to access deprecated field "Log"
2015-02-26 20:57:38 +00:00
Andrey Prygunkov
11bfb57809
added support for password list file; new option "UnpackPassFile" to set the location of the file; during unpack the passwords are tried from the file until unpack succeeds or all passwords were tried; implemented different strategies for rar4 and rar5-archives taking into account the features of formats; for rar5-archives a wrong password is reported by unrar unambiguously and the program can immediately try other passwords from the password list; for rar4-archives and for 7z-archives it is not possible to differentiate between damaged archive and wrong password; for those archives if the first unpack attempt (without password) fails the program executes par-check (preferably quick par-check if enabled via option "ParQuick) before trying the passwords from the list; another optimization is that the password list is tried only when the first unpack attempt (without password) reports a password error or decryption errors; this saves unnecessary unpack attempts for damaged unencrypted archives
2015-01-22 20:57:39 +00:00
Andrey Prygunkov
634247676a
fixed: quick par-check could hang on certain nzb-files containing multiple par-sets (occured only in 64 bit mode)
2014-11-14 19:38:41 +00:00
Andrey Prygunkov
9269f69a38
improvement in quick par-verification: if unpack fails (excluding invalid password errors) and quick par-check does not find any errors or quick par-check was already performed the full par-check is performed; this helps in rare situations when files were correctly downloaded (and therefore assumed correct by quick par-check) but incorrectly written into disk due to abnormal program termination (caused by bugs or hardware crashes)
2014-10-09 21:11:42 +00:00
Andrey Prygunkov
6f7af5aef4
option "ParThreads" can now be set to "0" (which is a default setting now) to let the program automatically determine the number of CPU cores; this works on major modern platforms)
2014-10-04 19:34:03 +00:00
Andrey Prygunkov
d0754e022f
addition to r1121: now fixed on windows too: inner files (files listed in nzb) bigger than 2GB could not be downloaded
2014-09-08 19:35:11 +00:00
Andrey Prygunkov
96e8cbd3c1
small improvement in multithreading par-repair: the number of repair threads is now automatically reduced to the amount of bad blocks if there are too few of them; if there is only one bad block the multithreading par-repair is switched off to avoid overhead of thread synchronisation (which does not make sense for one working thread)
2014-09-03 17:34:36 +00:00
Andrey Prygunkov
658d41f0fd
refactor: moved nzbget specific code from libpar2 into nzbget units in order to make updates of libpar2 easier in the future
2014-09-03 17:28:29 +00:00
Andrey Prygunkov
9dab8fd7dc
added multithreading par-repair: does not depend on other libraries and works on all platforms and all CPUs (with multiple cores); new option "ParThreads" to set the number of threads for repairing; new option "ParBuffer" to define the memory limit to use during par-repair
2014-09-02 23:07:32 +00:00
Andrey Prygunkov
44907aa700
when quick par verification is active the repaired files are not verified to save time; the only reason for incorrect files after repair can be hardware errors (memory, disk) but this is not something NZBGet should care about
2014-08-22 17:24:34 +00:00
Andrey Prygunkov
54303d464b
fixed: one log-message was printed only to global log but not to nzb-item pp-log
2014-08-22 17:05:30 +00:00
Andrey Prygunkov
008768cea1
better error reporting during par-check
2014-08-20 18:51:13 +00:00
Andrey Prygunkov
c64ef201ff
addition to r1079: fixed: par-check could not be cancelled.
2014-08-10 16:42:23 +00:00
Andrey Prygunkov
910dab98f1
fixed memory error which could lead to segfault (bug introduced in r1074)
2014-08-09 21:50:50 +00:00
Andrey Prygunkov
b9c59ffad4
fixed few compiler warnings
2014-08-09 15:50:09 +00:00
Andrey Prygunkov
2e0ba0e3d1
integrated par2-module (libpar2) into NZBGet’s source code tree; the par2-module is now built automatically during building of NZBGet; this eliminates dependency from external libpar2 and libsigc++ making it much easier for users to compile NZBGet with newest recommended patches for libpar2
2014-08-08 22:37:30 +00:00
Andrey Prygunkov
c482820746
addition to r1074: changed few info messages to debug as they supposed to be
2014-08-06 19:43:39 +00:00
Andrey Prygunkov
d8108f998b
disabled block-by-block scan during par verification because: 1) it could cause incorrect verification results for certain kinds of damaged files; 1) after implementing of quick scan for damaged files the block-by-block scan was not necessary anymore; block-by-block scan was also removed from the libpar2-patch
2014-08-06 15:24:25 +00:00
Andrey Prygunkov
40de60dd8b
added quick par verification for damaged (partially downloaded) files
2014-08-06 00:11:07 +00:00
Andrey Prygunkov
0078e9e225
options "ParIgnoreExt" and "ExtCleanupDisk" are now respected by par-check (in addition to being respected by par-rename): if all damaged or missing files are covered by these options then no par-repair is performed and the download assumed successful
2014-07-30 22:10:50 +00:00
Andrey Prygunkov
a62966227a
added quick file verification during par-check/repair; if par-repair is required for download the files downloaded without errors are verified quickly by comparing their checksums against the checksums stored in the par2-file; this makes the verification of undamaged files almost instant; damaged files are verified as usual; new option "ParQuick" (active by default); added support for block-by-block scan of files during verification, which improves scan speed of damaged files; the quick par-verification requires a patch for libpar2 (see http://nzbget.net/libpar2 for details)
2014-07-27 21:59:00 +00:00
Andrey Prygunkov
8c36a4d4c6
fixed: renaming or deleting of temporary files could fail, especially when options "UnpackPauseQueue" and "ScriptPauseQueue" were not active (windows only)
2014-05-22 16:58:16 +00:00
Andrey Prygunkov
7a11e8eb19
splitted files are now joined automatically (again)
2014-04-17 16:33:20 +00:00
Andrey Prygunkov
0c17e21b85
fixed: par-check could hang on renamed and splitted files
2014-04-16 17:49:41 +00:00
Andrey Prygunkov
0acb6ac548
fixed: cancelling of active par-job sometimes didn't work
2014-04-16 17:48:44 +00:00
Andrey Prygunkov
bf66500aac
reworking queue (continued): merged url queue into main download queue: urls added to queue are now immediately shown in web-interface; urls can be reordered and deleted; when urls are fetched the downloaded nzb-files are put into queue at the positions of their urls; this solves the problem with fetched nzb-files ordered differently than the urls if the fetching of upper (position wise) urls were completed after of the lower urls; removed options "ReloadUrlQueue" and "ReloadPostQueue" since there are no separate url- and post-queues anymore; nzb-files added via urls have new field "URL" which can be accessed via RPC-methods "listgroups" and "history"; new env. var. "NZBNP_URL", "NZBNA_URL" and "NZBPP_URL" passed to NzbProcess, NzbAddedProcess and PostProcess-scripts; removed remote command "--list U", urls are now shown as groups by command "--list G"; RPC-method "urlqueue" is still supported for compatibility but should not be used since the urls are now returned by method "listgroups", the entries have new field "Kind" which can be "NZB" or "URL"
2014-03-18 22:35:58 +00:00
Andrey Prygunkov
30e6131cd7
improved par-check for damaged collections with multiple par-sets and having missing files: only orphaned files (not belonging to any par-set) are scanned when looking for missing files; this greatly decrease the par-check time for big collections
2014-03-05 23:46:29 +00:00
Andrey Prygunkov
8168804f05
reorganized source code directory structure: created directory 'daemon' with several subdirectories and put all source code files there
2014-02-24 22:11:14 +00:00
