mirror/weewx
1
0
Fork 0
mirror of https://github.com/weewx/weewx.git synced 2026-04-20 09:37:02 -04:00
Code Issues Packages Projects Releases Wiki Activity
5,786 Commits 3 Branches 117 Tags
97ead1761870481f2671dbedbb3e5dfd736e4517
Commit Graph

83 Commits

Author SHA1 Message Date
gjr80
402db1f446 rework comments to clarify inclusivity/exclusivity of import --from and --to date-times 2021-02-25 13:11:54 +10:00
Tom Keffer
ea31b56db2 Merge branch 'master' into development 2020-12-30 04:26:55 -08:00
gjr80
35be6eafa0 fix error in weathercat processing of raw data 2020-12-30 12:39:34 +10:00
gjr80
e5174152f8 implement --no-prompt command line option 2020-11-18 16:42:09 +10:00
gjr80
7d077feecf fix some pycharm complaints 2020-09-28 16:11:50 +10:00
gjr80
9fbd0a8c8c remove null bytes from input source file data before import 2020-09-28 16:09:18 +10:00
gjr80
7e8da92345 fix some pycharm complaints 2020-09-28 16:06:29 +10:00
gjr80
b10ffbb128 remove null bytes from Cumulus monthly log source data before import 2020-09-28 16:00:37 +10:00
gjr80
bb903d89a7 fixed a few pycharm complaints 2020-09-28 15:55:59 +10:00
gjr80
b85160e8c6 remove null bytes from Weathercat source data before import 2020-09-28 15:53:01 +10:00
gjr80
1e86c92455 result of a fixed pycharm complaint 2020-09-28 15:42:48 +10:00
gjr80
01f0297e1b fixed a few formatting issues and pycharm complaints 2020-09-28 15:40:17 +10:00
gjr80
87c5861e75 now ignores null bytes in WD import source files 2020-09-28 15:31:24 +10:00
gjr80
dc8e3d6392 - allow units used in .cat file to be specified 
- add weathercat example import config to wee_import commenys
- update weathercat example config file
 2020-05-12 15:31:53 +10:00
gjr80
06dc0b52ad Update weathercat module to work with current wee_import code. Now works under 4/3. 2020-05-12 10:47:23 +10:00
gjr80
3159e132c8 1st cut adding (re-adding) WeatherCat support to wee_import 2020-05-06 22:52:21 +10:00
gjr80
3ea517d180 Added support for a user defined field delimiter for CSV imports 2020-04-14 06:47:11 +10:00
gjr80
3b8932d864 CSV imports now support cardinal, intercardinal and secondary intercardinal directions when importing a 'direction' based field i.e., field uses units degree_compass 2020-03-25 17:19:43 +10:00
gjr80
fa081d0282 Cumulus and WD imports now better handle source data file encoding 2020-03-24 23:01:13 +10:00
gjr80
4eda5711d2 better handle encoded csv source files (#518) 2020-03-24 04:57:57 -07:00
gjr80
b2262da04f Fix issue where an import fails if a nonsense rain value is encountered despite ignore_invalid_data being set. 2020-02-22 13:00:41 +10:00
gjr80
5355bfbb3b Fix OverflowError when a WU import encounters an abnormally high epoch timestamp (perhaps in milliseconds) 2020-02-22 12:58:50 +10:00
gjr80
d693b700cb wee_import will now skip (rather than exiting) periods for which it cannot obtain source data 
Added notes to the wee_import section of the Utilities Guide explaining that periods may be skipped
 2020-02-02 15:18:50 +10:00
gjr80
177bd19a80 Fixed incorrect exception raised if a WU import receives a 204 response, revised 204 response error message and revised WeeImportIOError headline error message 2020-02-02 13:20:40 +10:00
tkeffer@gmail.com
8431fb6714 More code changes reflecting new schema 2020-01-13 15:55:02 -08:00
gjr80
46873169fe Sort of fixes issue #473 2020-01-04 07:55:00 +10:00
gjr80
b3a6d96fc4 Fixed a few pieces of code that were not python3 compatible 2019-12-16 19:16:36 +10:00
gjr80
79a6d7c3c8 Fix a unicode/string conflict 2019-12-16 17:04:31 +10:00
gjr80
8b97381882 Change wee_import to use tranches of 1 day when calculating missing derived obs 2019-12-16 16:07:08 +10:00
gjr80
98d850edd9 Fix a unicode/string conflict 2019-12-14 07:54:05 +10:00
gjr80
de67c09186 Fix lastUpdate metadata issue 2019-12-07 07:53:28 +10:00
gjr80
8739ec207b Added a little more commentary to explain the various record processing messages 
Minor output consistency fixes
 2019-12-06 15:16:42 +10:00
gjr80
75bac7482b Need to adjust start timestamp for a calc_missing arising from an import 2019-11-30 08:23:41 +10:00
gjr80
a287dc08bb Reworked wee_import to divorce calculation of missing derived fields from the record import process. Missing derived fields are now calculated separately once all records have been imported. 
Addresses issue #443.
 2019-10-03 13:39:24 +10:00
Tom Keffer
0be384a137 Renamed weeutil.weeutil._get_object() to get_object(). 2019-09-18 05:42:17 -07:00
gjr80
5fe2b76889 Added obfuscated API key entry to verbose WU import output 2019-09-18 09:40:37 +10:00
gjr80
33918ce09e First cut implementation of WU API as the source for WU imports. 
Works but there is still an issue with the apparent caching of WU API results that can affect the availability of records to import for the current day.
 2019-09-15 12:12:07 +10:00
gjr80
c566d7abe5 First cut of python logging in wee_import (#441) 
* First cut of python logging in wee_import
Utilities Guide updates to be done separately

* Refactored logging.
Removed class WeeImportLog.
All logging now done directly to module level logger.
Console output now done directly from the module concerned using print function.

* Replaced log method calls with info/debug/error method calls
 2019-09-07 16:22:40 -07:00
gjr80
3b944297ec Fix wdimport filter error 2019-03-12 13:04:42 +10:00
gjr80
444e0e48fc Fix incomplete syslog openlog call 2019-03-12 11:53:31 +10:00
Tom Keffer
ac93649e95 Catch up merge of branch 'development' into branch 'python3'. 
This includes wdimport stuff.

# Conflicts:
#	bin/weeimport/weeimport.py
#	bin/weeimport/wuimport.py
 2019-03-11 09:26:49 -07:00
gjr80
869b898261 - fixed a lot of pycharm complaints 
- added missing comments to recent code changes
- missing socket import
 2019-03-11 20:19:20 +10:00
gjr80
f3ec9d8dfc Changed first_period and last_period properties to be @property decorated properties 2019-03-11 17:27:30 +10:00
Tom Keffer
c23a866b83 Reformatted. Removed a lot of unneeded intermediate messages. 2019-02-28 10:01:35 -08:00
Tom Keffer
3d1fbec109 Test WU importer. 2019-02-28 09:45:08 -08:00
Tom Keffer
8859e6a33a Started porting wee_import to Python 3. Untested. 2019-02-28 09:31:33 -08:00
gjr80
230697babf - 1st steps in reworking the counting of records and progress reporting to cater for WD which seems to have an inordnate number of duplicate or missing log entries 
- changes --suppress to --suppress-warnings
- further work to suppress warnings for WD imports
 2019-02-24 23:17:38 +10:00
gjr80
1bbbafeeda - fixed incorrect logic in dealing with extra rows (eg 1st row from next month) included in a log file 
- reworked some console output
- introduced 'suppress' config option to suppress some text to console only 9still goes to log)
 2019-02-14 12:28:12 +10:00
gjr80
38c02d0254 Fixed unresolved reference to _field 2019-02-13 18:05:51 +10:00
gjr80
e325b80930 Merge branches 'development' and 'wdimport' of https://github.com/weewx/weewx into wdimport 
# Conflicts:
#	bin/wee_import
 2019-02-12 16:06:32 +10:00