27 Commits

Author	SHA1	Message	Date
Andrey Prygunkov	a8aa110f43	added missing new line character at the end of the help screen printed by "nzbget -h"	2014-10-05 15:13:30 +00:00
Andrey Prygunkov	e184e5b7c5	fixed: relative destination paths (options "DestDir" and "CategoryX.DestDir") caused failures during unrar	2014-09-21 15:37:10 +00:00
Andrey Prygunkov	90fac39a26	added commands "PausePostProcess" and "UnpausePostProcess" to scheduler	2014-09-15 16:28:55 +00:00
Andrey Prygunkov	d0754e022f	addition to r1121: now fixed on windows too: inner files (files listed in nzb) bigger than 2GB could not be downloaded	2014-09-08 19:35:11 +00:00
Andrey Prygunkov	2b44618858	added validation check for option "ParBuffer" when compiled in 32-bit	2014-09-06 19:50:23 +00:00
Andrey Prygunkov	9dab8fd7dc	added multithreading par-repair: does not depend on other libraries and works on all platforms and all CPUs (with multiple cores); new option "ParThreads" to set the number of threads for repairing; new option "ParBuffer" to define the memory limit to use during par-repair	2014-09-02 23:07:32 +00:00
Andrey Prygunkov	0d630d9ea3	when connecting in remote mode using command line parameter "--connect/-C" the option "ControlIP" is now interpreted as "127.0.0.1" if it is set to "0.0.0.0" (instead of failing with an error message)	2014-08-28 20:22:20 +00:00
Andrey Prygunkov	7de78cd088	added new option "UrlTimeout" to set timeout for URL fetching and RSS feed fetching; renamed option "ConnectionTimeout" to "ArticleTimeout"	2014-08-28 19:31:31 +00:00
Andrey Prygunkov	d5b99732d1	fixed: no warning were printed for invalid values of option "ArticleCache" (max value 1900 when compiled in 32 bit mode)	2014-08-25 20:04:09 +00:00
Andrey Prygunkov	b10b48f5e9	the list of scripts (pp-scripts, queue-scripts, etc.) is now read once on program start instead of reading everytime a script is executed; that eliminates the unnecessary disk access; the list of post-processing parameters shown on page "Postprocess" of download details dialog is now built using the preloaded list of scripts instead of reading the script config sections on every load of web-interface; the settings page of web-interface loads available scripts every time the page is shown; this allows to configure newly added scripts without restarting the program first (just like it was before); a restart is still required to apply the settings (just like it was before); RPC-method "configtemplates" has new parameter "loadFromDisk"	2014-08-19 19:56:09 +00:00
Andrey Prygunkov	74a1f6301a	added option "EventInterval" allowing to reduce the number of calls of queue-scripts, which can be useful on slow systems	2014-08-19 19:45:30 +00:00
Andrey Prygunkov	dd22ec68fc	improvement in support for detection of bad downloads (fakes, etc.): scripts supporting two modes (post-processing-mode and queue-mode) are now executed if selected in post-processing parameters: either in options "PostScript" and "CategoryX.PostScript" or manually on page "Postprocess" of download details dialog in web-interface; it is not necessary to select dual-mode scripts in option "QueueScript"; that provides more flexibility: the scripts can be selected per-category or activated/deactivated for each nzb individually	2014-08-17 23:07:48 +00:00
Andrey Prygunkov	a62966227a	added quick file verification during par-check/repair; if par-repair is required for download the files downloaded without errors are verified quickly by comparing their checksums against the checksums stored in the par2-file; this makes the verification of undamaged files almost instant; damaged files are verified as usual; new option "ParQuick" (active by default); added support for block-by-block scan of files during verification, which improves scan speed of damaged files; the quick par-verification requires a patch for libpar2 (see http://nzbget.net/libpar2 for details)	2014-07-27 21:59:00 +00:00
Andrey Prygunkov	a42c323343	refactor: removed an old commented code	2014-07-18 23:19:46 +00:00
Andrey Prygunkov	39d9fe2794	added log file rotation; options "CreateLog" and "ResetLog" replaced with new option "WriteLog (none, append, reset, rotate)"; new option "RotateLog" defines rotation period; when compiled in debug mode new field "process id" is printed to the file log for each row (it is easier to identify processes than threads)	2014-07-18 23:17:16 +00:00
Andrey Prygunkov	7993e2971c	renamed option "WriteBufferSize" into "WriteBuffer"; changed the dimension - now option is set in kilobytes instead of bytes; old name and value are automatically converted; if the size of article is below the value defined by the option, the buffer is allocated with the articles size (to not waste memory); therefore the special value "-1" is not required anymore; during conversion "-1" is replaced with "1024" (1 megabyte) but it can be of course manually changed to any other value later	2014-07-18 23:06:45 +00:00
Andrey Prygunkov	ba9efe43be	added article cache: new option "ArticleCache" defines memory limit to use for cache; when cache is active the articles are written into cache first and then all flushed to disk into the destination file; article cache reduces disk IO and may reduce file fragmentation improving post-processing speed (unpack); it works with both writing modes (direct write on and off); when option "DirectWrite" is disabled the cache should be big enough (for best performance) to accommodate all articles of one file (sometimes up to 500 MB) in order to avoid writing articles into temporary files, otherwise temporary files are used for articles which do not fill into cache; when used in combination with DirectWrite there is no such limitation and even a small cache (100 MB or even less) can be used effectively; when the cache becomes full it is flushed automatically (directly into destination file) providing room for new articles; new row in the "statistics and status dialog" in web-interface indicates the amount of memory used for cache; new fields "ArticleCacheLo", "ArticleCacheHi" and "ArticleCacheMB" returned by RPC-method "status"; refactor: parts of unit "ArticleDownloader" responsible for writing into disk were moved into new unit "ArticleWriter"	2014-07-18 22:48:35 +00:00
Andrey Prygunkov	d26d04d92b	when changing category in web-interface the post-processing parameters are now automatically updated according to new category settings; only parameters which are different in old and new category are changed; parameters which present in both or in neither categories are not changed; that ensures that only the relevant parameters are updated and parameters which were manually changed by user remain they settings when it make sense; in the "download details dialog" the new parameters are updated on the postprocess-tab directly after changing of category and can be controlled before saving; in the "edit multiple downloads dialog" the parameters are updated individually for each download on saving; new action "CP" of remote command "--edit/-E" for groups to set category and apply parameters; new action "GroupApplyCategory of RPC-method "editqueue" for the same purpose	2014-06-13 21:53:27 +00:00
Andrey Prygunkov	7240147418	added option "ParIgnoreExt" which lists files which do not trigger par-repair if they are missing	2014-06-03 20:47:28 +00:00
Andrey Prygunkov	0923f2bb5c	added new choice "Always" for option "ParCheck"; it forces the par-check for every (even undamaged) download but in contrast to choice "Force" only one par2-file is downloaded first; additional files are downloaded if needed	2014-06-02 20:43:37 +00:00
Andrey Prygunkov	1d3d875f3d	refactor: created new class "Tokenizer" and replaced all usages of function "strtok_r" with new class; also created new function "MatchFileExt" for the similar code used in two places	2014-05-29 21:38:27 +00:00
Andrey Prygunkov	8c36a4d4c6	fixed: renaming or deleting of temporary files could fail, especially when options "UnpackPauseQueue" and "ScriptPauseQueue" were not active (windows only)	2014-05-22 16:58:16 +00:00
Andrey Prygunkov	169c56f105	implemented general scripts concept which is an extension of the post-processing scripts concept initially introduced in v11; the general scripts concept applies to all scripts used in the program: scan-script, queue-script and scheduler-script (in addition to post-processing scripts); option "NzbProcess" renamed to "ScanScript"; option "NzbAddedProcess" renamed to "QueueScript"; option "DefScript" and "CategoryX.DefScript" renamed to "PostScript" and "CategoryX.PostScript" (options with old names are recognized and automatically converted on first settings saving); new option "TaskX.Script"; old option "TaskX.Process" kept for scheduling of external programs not related to nzbget (to avoid writing of intermediate proxy scripts); scan-script, queue-script and scheduler-script now work similar to post-processing scripts: -scripts must be put into scripts-directory; -scripts can be configured via web-interface and can have options; -multiple scripts can be chosen for each scripts-option, all chosen scripts are executed; -program and script options are passed to the script as env. variables;; renamed default directory with scripts from "ppscripts" to "scripts"; script signature indicates the type of script (post-processing, scan, queue or scheduler); one script can have mixed signature allowing it to be used for multiple purposes (for example a notification script can send a notification on both events: after adding to queue and after post-processing); result of RPC-method "configtemplates" has new fields "PostScript", "ScanScript", "QueueScript", "SchedulerScript" to indicate the purpose of the script; queue-script (formerly NzbAddedProcess) has new parameter "NZBNA_EVENT" indicating the reason of calling the script; currently the script is called only after adding of files to download queue and therefore the parameter is always set to "NZB_ADDED" but the queue-script can be called on other events in the future too	2014-05-06 15:36:15 +00:00
Andrey Prygunkov	d89036f9f3	1) the current time zone is now determined once on program start and if a clock adjustment is detected using system function "localtime"; the function "localtime" is no longer constantly used by the scheduler; this should solve the hibernation problem on synology NAS, even when task scheduler is used; 2) fixed: RSS feed preview dialog displayed slightly incorrect post ages because of the wrong time zone conversion	2014-03-21 21:35:32 +00:00
Andrey Prygunkov	bf66500aac	reworking queue (continued): merged url queue into main download queue: urls added to queue are now immediately shown in web-interface; urls can be reordered and deleted; when urls are fetched the downloaded nzb-files are put into queue at the positions of their urls; this solves the problem with fetched nzb-files ordered differently than the urls if the fetching of upper (position wise) urls were completed after of the lower urls; removed options "ReloadUrlQueue" and "ReloadPostQueue" since there are no separate url- and post-queues anymore; nzb-files added via urls have new field "URL" which can be accessed via RPC-methods "listgroups" and "history"; new env. var. "NZBNP_URL", "NZBNA_URL" and "NZBPP_URL" passed to NzbProcess, NzbAddedProcess and PostProcess-scripts; removed remote command "--list U", urls are now shown as groups by command "--list G"; RPC-method "urlqueue" is still supported for compatibility but should not be used since the urls are now returned by method "listgroups", the entries have new field "Kind" which can be "NZB" or "URL"	2014-03-18 22:35:58 +00:00
Andrey Prygunkov	e28da0d7fd	added new option "PropagationDelay", which sets the minimum post age to download; newer posts are kept on hold in download queue until they get older than the defined delay, after that they are downloaded	2014-03-11 22:05:27 +00:00
Andrey Prygunkov	8168804f05	reorganized source code directory structure: created directory 'daemon' with several subdirectories and put all source code files there	2014-02-24 22:11:14 +00:00