mirror/weewx
1
0
Fork 0
mirror of https://github.com/weewx/weewx.git synced 2026-04-20 09:37:02 -04:00
Code Issues Packages Projects Releases Wiki Activity
5,306 Commits 3 Branches 117 Tags
6e052d1dd09f41d8fdc07102d190f0be779bfe2f
Commit Graph

70 Commits

Author SHA1 Message Date
gjr80
dc8e3d6392 - allow units used in .cat file to be specified 
- add weathercat example import config to wee_import commenys
- update weathercat example config file
 2020-05-12 15:31:53 +10:00
gjr80
06dc0b52ad Update weathercat module to work with current wee_import code. Now works under 4/3. 2020-05-12 10:47:23 +10:00
gjr80
3159e132c8 1st cut adding (re-adding) WeatherCat support to wee_import 2020-05-06 22:52:21 +10:00
gjr80
3ea517d180 Added support for a user defined field delimiter for CSV imports 2020-04-14 06:47:11 +10:00
gjr80
3b8932d864 CSV imports now support cardinal, intercardinal and secondary intercardinal directions when importing a 'direction' based field i.e., field uses units degree_compass 2020-03-25 17:19:43 +10:00
gjr80
fa081d0282 Cumulus and WD imports now better handle source data file encoding 2020-03-24 23:01:13 +10:00
gjr80
4eda5711d2 better handle encoded csv source files (#518) 2020-03-24 04:57:57 -07:00
gjr80
b2262da04f Fix issue where an import fails if a nonsense rain value is encountered despite ignore_invalid_data being set. 2020-02-22 13:00:41 +10:00
gjr80
5355bfbb3b Fix OverflowError when a WU import encounters an abnormally high epoch timestamp (perhaps in milliseconds) 2020-02-22 12:58:50 +10:00
gjr80
d693b700cb wee_import will now skip (rather than exiting) periods for which it cannot obtain source data 
Added notes to the wee_import section of the Utilities Guide explaining that periods may be skipped
 2020-02-02 15:18:50 +10:00
gjr80
177bd19a80 Fixed incorrect exception raised if a WU import receives a 204 response, revised 204 response error message and revised WeeImportIOError headline error message 2020-02-02 13:20:40 +10:00
tkeffer@gmail.com
8431fb6714 More code changes reflecting new schema 2020-01-13 15:55:02 -08:00
gjr80
46873169fe Sort of fixes issue #473 2020-01-04 07:55:00 +10:00
gjr80
b3a6d96fc4 Fixed a few pieces of code that were not python3 compatible 2019-12-16 19:16:36 +10:00
gjr80
79a6d7c3c8 Fix a unicode/string conflict 2019-12-16 17:04:31 +10:00
gjr80
8b97381882 Change wee_import to use tranches of 1 day when calculating missing derived obs 2019-12-16 16:07:08 +10:00
gjr80
98d850edd9 Fix a unicode/string conflict 2019-12-14 07:54:05 +10:00
gjr80
de67c09186 Fix lastUpdate metadata issue 2019-12-07 07:53:28 +10:00
gjr80
8739ec207b Added a little more commentary to explain the various record processing messages 
Minor output consistency fixes
 2019-12-06 15:16:42 +10:00
gjr80
75bac7482b Need to adjust start timestamp for a calc_missing arising from an import 2019-11-30 08:23:41 +10:00
gjr80
a287dc08bb Reworked wee_import to divorce calculation of missing derived fields from the record import process. Missing derived fields are now calculated separately once all records have been imported. 
Addresses issue #443.
 2019-10-03 13:39:24 +10:00
Tom Keffer
0be384a137 Renamed weeutil.weeutil._get_object() to get_object(). 2019-09-18 05:42:17 -07:00
gjr80
5fe2b76889 Added obfuscated API key entry to verbose WU import output 2019-09-18 09:40:37 +10:00
gjr80
33918ce09e First cut implementation of WU API as the source for WU imports. 
Works but there is still an issue with the apparent caching of WU API results that can affect the availability of records to import for the current day.
 2019-09-15 12:12:07 +10:00
gjr80
c566d7abe5 First cut of python logging in wee_import (#441) 
* First cut of python logging in wee_import
Utilities Guide updates to be done separately

* Refactored logging.
Removed class WeeImportLog.
All logging now done directly to module level logger.
Console output now done directly from the module concerned using print function.

* Replaced log method calls with info/debug/error method calls
 2019-09-07 16:22:40 -07:00
gjr80
3b944297ec Fix wdimport filter error 2019-03-12 13:04:42 +10:00
gjr80
444e0e48fc Fix incomplete syslog openlog call 2019-03-12 11:53:31 +10:00
Tom Keffer
ac93649e95 Catch up merge of branch 'development' into branch 'python3'. 
This includes wdimport stuff.

# Conflicts:
#	bin/weeimport/weeimport.py
#	bin/weeimport/wuimport.py
 2019-03-11 09:26:49 -07:00
gjr80
869b898261 - fixed a lot of pycharm complaints 
- added missing comments to recent code changes
- missing socket import
 2019-03-11 20:19:20 +10:00
gjr80
f3ec9d8dfc Changed first_period and last_period properties to be @property decorated properties 2019-03-11 17:27:30 +10:00
Tom Keffer
c23a866b83 Reformatted. Removed a lot of unneeded intermediate messages. 2019-02-28 10:01:35 -08:00
Tom Keffer
3d1fbec109 Test WU importer. 2019-02-28 09:45:08 -08:00
Tom Keffer
8859e6a33a Started porting wee_import to Python 3. Untested. 2019-02-28 09:31:33 -08:00
gjr80
230697babf - 1st steps in reworking the counting of records and progress reporting to cater for WD which seems to have an inordnate number of duplicate or missing log entries 
- changes --suppress to --suppress-warnings
- further work to suppress warnings for WD imports
 2019-02-24 23:17:38 +10:00
gjr80
1bbbafeeda - fixed incorrect logic in dealing with extra rows (eg 1st row from next month) included in a log file 
- reworked some console output
- introduced 'suppress' config option to suppress some text to console only 9still goes to log)
 2019-02-14 12:28:12 +10:00
gjr80
38c02d0254 Fixed unresolved reference to _field 2019-02-13 18:05:51 +10:00
gjr80
e325b80930 Merge branches 'development' and 'wdimport' of https://github.com/weewx/weewx into wdimport 
# Conflicts:
#	bin/wee_import
 2019-02-12 16:06:32 +10:00
gjr80
57a7f9e9a1 Fix negligent commit, plus fixed a couple of spelling mistakes 2019-02-12 14:19:18 +10:00
gjr80
23419e7d87 Merge branch 'development' into development 2019-02-12 13:50:21 +10:00
gjr80
1f44d587f3 replace weewx/weeWX with WeeWX 2019-01-20 16:31:54 +10:00
gjr80
38da81b55a - added support for duplicate records encountered per period 
- reformatted some long lines
- fixed a few pycharm complaints
 2019-01-20 16:06:18 +10:00
gjr80
12b72a5f3c - removed unused import 
- now displays onm console details of duplicate records encountered per period
- reformatted some long lines
- tightened up a few catch-all except: statements
- fixed a few pycharm complaints
 2019-01-20 16:04:49 +10:00
gjr80
b9aac5fc6f First cut inclusion of support for importing Weather Display log file data 2019-01-18 22:25:28 +10:00
tkeffer@gmail.com
16fc7fb5d3 Use WeeWX consistently (instead of weeWX). 2018-12-20 15:50:51 -08:00
gjr80
3e1aa765df Added --ignore-invalid-data import config option 2018-04-19 14:26:32 +10:00
vinceskahan
701f094a59 2to3 -f except -w (#315) 2018-04-09 05:55:16 -07:00
gjr80
1587c36ddb First cut adding WeatherCat support to wee_import 2017-04-23 23:48:47 +10:00
gjr80
287f5b2945 Fixed Cumulus import rain field issue 
wee_import will try to use field 26(AA) - midnight reset daily rainfall
but if not available due it will revert to field 9(J) or 11(L)
 2017-02-03 12:02:44 +10:00
gjr80
2df1aa121a Changed config option names but never changed the code! 2017-02-03 08:39:43 +10:00
gjr80
9a64309e3f Can now specify date field separator for Cumulus imports, weewx -> weeWX 2017-01-28 16:49:12 +10:00