Commit Graph

48 Commits

Author SHA1 Message Date
gjr80
b6416cd9fb minor output format changes, removed unused variable, fixed couple of pycharm complaints 2019-11-26 19:00:31 +10:00
gjr80
75c3721e8f Revised calc-missing functionality should now be working. Think most corner cases have been picked up. 2019-11-25 19:06:08 +10:00
gjr80
311825048a Fixed a few wee_database usage instructions changes missed on previous commit 2019-10-30 10:48:41 +10:00
gjr80
3324c5d7b8 Fixed issue where first record was never processed if now --date or --to or --from was provided 2019-10-27 10:10:40 +10:00
gjr80
a02488122f - change calcmissing tranche size from 50 to 20 days
- fixed bug that caused the last day of the tranche to be skipped when calc missing
- aligned progress reporting with rebuild daily reporting (ie every 1000 records)
2019-10-24 13:23:18 +10:00
gjr80
aac27406b9 Fix couple of typos 2019-10-20 10:04:43 +10:00
gjr80
9cd529f88b Added ability to specify times in --from and --to to allow better control of new --calc-missing action
Also fixed a few console output and variable naming inconsistencies within the rebuild code
2019-10-20 09:52:49 +10:00
gjr80
84145cdcd1 - added --calc-missing action to wee_database to calculate and store missing derived fields over a given timespan
- fix a couple of typos
2019-10-03 13:33:33 +10:00
Tom Keffer
4838e615fe Ported most of the utilities to use the Python logging module. 2019-08-17 14:49:34 -07:00
Tom Keffer
0728b54c6b Use native 'range', instead of compatibility shim. 2019-02-24 06:01:25 -08:00
Tom Keffer
4f85b13d5a Ported executables using python-modernize 2019-02-12 18:46:47 -08:00
Tom Keffer
e9aa33d6b5 Ported wee_database to Python 3 2019-02-10 16:57:23 -08:00
Tom Keffer
1e9b0a0c1c chmod +x 2019-01-22 17:01:18 -08:00
tkeffer@gmail.com
16fc7fb5d3 Use WeeWX consistently (instead of weeWX). 2018-12-20 15:50:51 -08:00
gjr80
5c59a31a24 Fix unexplained change to shebang 2018-08-15 08:48:25 +10:00
gjr80
98f96c71a2 Made wee_database dropDaily() console output and manager.drop_daily() log output more consistent when an exception is encountered. Issue #335 2018-08-13 10:23:32 +10:00
vinceskahan
701f094a59 2to3 -f except -w (#315) 2018-04-09 05:55:16 -07:00
Matthew Wall
db6bcc3cad keep PEP happy 2017-02-13 00:13:06 -05:00
Matthew Wall
0693654ed6 fixed typo 2017-02-12 22:26:55 -05:00
Matthew Wall
81341eb839 fixed typo 2017-02-12 22:25:53 -05:00
Matthew Wall
5a858a2e7b simplify 2017-02-12 21:52:03 -05:00
Tom Keffer
1df9b2002d Moved start time to just before applying the patch 2017-02-09 08:26:58 -08:00
gjr80
10369c0f6a windSpeed fix now gracefully handles no windSpeed summary table, tweaked --update output/logging 2017-02-06 11:45:25 +10:00
gjr80
b98f5c54cb Reworked check_strings() output (#213)
Reworked check_strings() screen and syslog output:
- now gives progress ala --rebuild-daily
- syslog is silent for --check-strings and --fix-strings with --dry-run
- left 'Preparing' (rather than 'Starting') but added 'this may take a
while' as there is a significant delay in dbmanager.genBatchRows()
initialising at line 619 (well there was for 400k records)
2017-02-05 04:22:55 -08:00
Tom Keffer
d7a7913cc8 More clear msg when encountering an ImportError 2017-02-01 16:05:38 -08:00
Tom Keffer
639c3518aa Changed to execute in user environment 2017-01-30 09:52:02 -08:00
Tom Keffer
da3daff82a Clarified option strings 2017-01-28 06:20:45 -08:00
gjr80
bc9e1ee729 Restructure usage string, hard code transaction days 2017-01-28 00:44:42 +10:00
Tom Keffer
80a92fb98a wee_database now uses new version of backfill_day_summary 2017-01-19 13:17:56 -08:00
gjr80
fcf90e4cb0 Removed the p word, patch.py is now database.py, rejigged wee_database as per skype and followup emails
- progress function for fixes included as a method in base class that
can be overridden
- much changing of logging to give consistent results/output
- believe I retained Tom's recent changes to patch.py (commit 4acf752)
2017-01-19 22:31:06 +10:00
Tom Keffer
f645c70604 Checks daily summary version except when patching 2017-01-10 17:38:57 -08:00
gjr80
447d5a2512 Renamed --create-archive to --create-database 2017-01-10 15:20:20 +10:00
gjr80
d39230cc94 Finished implementing times for most actions, various rewording/reformatting
- removed a lot of old v2 wording that referrred to the 'archive
database'
2017-01-09 00:24:18 +10:00
gjr80
f0e7e26496 Rework wee_database as per issue 61 comments/discussion
- removed required weewx version code
- --string-check/--fix changed to --check-string/--fix-strings
- implement --check-weighting/--fix-weighting to replace
--apply-weight-patch
- rejig some old 2.x.y text that refers to archive database
- all reference to backfill has been removed and only rebuild is used
- 1st cut implementation of time taken report for selected actions (some
still to be tested)
- removed all reference to 'patch' except for patch.py in weecfg - need
to see how far we want to take this!

patch.py
- removed weewx version checking as per wee_database
- rejigging of some names to remove the 'patch' word from wee_database
2017-01-08 14:28:07 +10:00
gjr80
ab5c7d3f79 Implement wee_database --rebuild-daily, add user confirmation when applying weight patch via wee_database 2017-01-08 00:33:45 +10:00
gjr80
10f6ec0606 Fix various errors. Now runs without error.
- fixed issue with 'Version' metadata processing
- fix circular import issue in weecfg.__init__()
- fix --dry-run default issue in wee_database
2016-12-23 08:55:07 +10:00
gjr80
3fb9c49f95 See description
- now uses 'Version' metadata field
- apply_patches() now accepts a patch config dict
- day summaries are now set at Version 2.0 on creation
- 1st cut addition of --apply-weight-patch to wee_database
2016-12-22 10:50:25 +10:00
Tom Keffer
a2d80501e6 s/Command/Action in the utilities themselves. 2016-09-23 18:05:03 -07:00
Tom Keffer
a8f01f7bed Suppressed lots of eclipse "Unused variable" warnings. 2016-03-11 12:02:26 -08:00
gjr80
a40b1f2d24 Added a TRANS-DAYS command line parameter to wee_database
wee_database previously did daily summary backfills in one datbase
transaction. This resulted in errors for large archives being processed
on machines with relatively small amounts of memory. The TRANS-DAYS
command line parameter allows the backfill to be completed in a series
of database transactions using no more than TRANS-DAYS data at a time.
To provide a consistent approach to logging some minor changes were made
to the logging in DaySummaryManager.backfill_day_summary(),
DaySummaryManager.drop_daily() and StdArchive.setup_database().
2016-02-14 19:31:26 +10:00
gjr80
0d1ad690f7 Fix unassigned variable error if --dry-run used 2015-08-27 15:55:39 +10:00
gjr80
7869638dbf wee_database now only accepts 1 'verb' at a time
Refer #64. Not as clean as I would like due to optparse limitations but
seems to do the job.
2015-08-25 13:30:49 +10:00
gjr80
2d5b098507 Add capability to transfer a weewx 'archive' to another database of any type supported by weewx
Added --transfer option with mandatory --dest-binding parameter.
Included --dry-run parameter to do everything except the actual
transfer. Also reformatted usage display along functional lines as in
wee_extension.
2015-08-24 16:26:58 +10:00
Tom Keffer
88326d6acc Fixed error in logging message. 2015-07-09 06:21:21 -07:00
Tom Keffer
1a16cc48f4 Fixed error in posting to the log after creating main database.
Changed from using DBManager.get_manager_dict() to
DBManager.get_manager_dict_from_config()
2015-07-08 11:26:53 -07:00
Tom Keffer
847bbec426 Document the name change for
wee_device
  wee_database
2015-04-28 16:26:02 -07:00
Matthew Wall
9dc279c0c4 use renamed wee_X utilities in rpm and deb configs 2015-04-25 21:29:21 -04:00
Matthew Wall
32ac3898d7 rename wee_X utilities again 2015-04-25 21:19:57 -04:00