Commit Graph

1110 Commits

Author SHA1 Message Date
Bill Richter
93436a927c once again try to update my fork (#2)
* Got test suites working again.

* Updated TODO

* indicate specific firmware for cc3000

* clarify rainwise firmware

* Further refinement

- max and maxtime now updated
- reworked the progress function, now a method in the class

Have left __main__ code in that has been used for testing windSpeed
recalculation fix

* indicate when calibrations are ignored

* Now emits the barometer trend in LOOP packets as field 'trendIcon'

Vantage only.

* Updated TODO guide, reflecting this morning's phone call.

* Presses on, despite database error

* Simplified patching by moving metadata code to DaySummaryManager

* Got rid of _getVersion()

Can now get it from _read_metadata

* Remove interval weighting fix from weewx startup

Refer TODO.txt

* Update TODO.txt

* added write timeout to ultimeter driver

* better logging when cc3000 loses contact with sensors

* document some of the channel, sensor, and logger specifics for the wmr100/wmr200 hardware

* Removed the p word, patch.py is now database.py, rejigged wee_database as per skype and followup emails

- progress function for fixes included as a method in base class that
can be overridden
- much changing of logging to give consistent results/output
- believe I retained Tom's recent changes to patch.py (commit 4acf752)

* Picks daily summary weights on the basis of database version

* Rewrote the backfill routine (again)

* wee_database now uses new version of backfill_day_summary

* Fixed problem that prevented cold startup

* Revised to reflect latest wee_database incantation

* Modified weighting fix

Should not mess with lessUpdate
Delete lastWeightPatch after successful patch

* Check to make sure the daily summaries have not been partially updated.

* Revised to reflect latest wee_database incantation

* Revised wee_database and interval weighting paras, added windSpeed recalc para

* Removed vacuum

* Updated what has been done and committed

* Better diagnostics with partial update of the daily summaries.

* MySQL now uses transaction isolation level READ COMMITTED

* Add .config (#204)

* Changed semantics of "$last_xxx" tags.

* Template test updates including fixing issue #201 (#205)

* Add .config

* Standardise test skin for index.html.tml to remove "%x %X" locale dependent formatting. Note: Used 24 hour time as AM/PM can also be locale dependent.

Also include fixes for line formatting in some other test files and expected results.

* sysctlbyname is not available on every platform, so catch AttributeError too, otherwise cheetah fails with a name error

* Got rid of tabs

* update usb mode info for acurite models

* Removed intervalgenRoundTS and archiveDaysAgoSpan.

* Simplified tags. Got template test working again.

* Somehow, style "indent" got lost

* Documented new "$ago" tags.

* Documented $ago options, as well as .start and .end

* Update changes doc

* Stupid typo

* use markdown instead of html for README

* indenting seems to confuse markdown's handling of urls

* Left over $last_day in $spans example (#206)

* Add .config

* Standardise test skin for index.html.tml to remove "%x %X" locale dependent formatting. Note: Used 24 hour time as AM/PM can also be locale dependent.

Also include fixes for line formatting in some other test files and expected results.

* Left over $last_day in $spans example.

* a user-specified sensor_map will update, not replace, the default sensor_map

* Updated the upgrade guide.

* ensure that weewx-multi works on deb and rpm as well as setup.py

* document the sensor mapping changes

* Added comprehensive example to customizing guide.

* Updated TODO

* Got the weighting update to work on MySQL

* added crude caching of pressure in wmr300

* Fixed typo

* Fixed little errors. Consistently use "tag", instead of "dot code."

* no altimeter, just pressure and barometer

* Fixed little HTML problems.

* Reformatted, in anticipation of a refactoring of some sections.

* Fixed location of 'Version'

So it works with automatic replacement of 'Version'

* initial experiment with different fonts

* override jquery-ui hijacking of toc font family

* bring header highlighting to h2 to correlate with toc.  reduce post-header margins.

* fix some table header cruft.  prevent indent sections from overflowing right margin.  let the table cells breath.

* fix broken tty formatting

* Checkpoint

Work in progress.

* Refined examples of creating new units and groups

* Polishing. Or, maybe fiddling?

* minor css fixes.  rearrange troubleshooting sections about pressure.

* minor cleanup to readme

* Fixed test suites

Add MySQL back to template tests.

* Reworked the iteration examples.

* Corrected and clarified the units used in the "electricity" example.

* remove write_timeout since naming is inconsistent between pyserial versions and there is no backward compatibility

* remove write_timeout from ultimeter

* Minor changes to users guide

* increase body size to 100%.  background for code.  weeWX in titles.  true bold for monospace.  prep for direct font comparisons.

* Clarified the role of encoding

* update utilities guide with suggested wee_database descriptions and args

* more compaction

* increase margins on html examples.  use droid serif for html examples.

* Clarified a few things

* decode weewx into weeWX

* include transaction limit defaults

* eliminate transaction-limit

* weeWX fixes in install pages.  more fixes to utilities.

* missed a few code spans

* fix version label alignment

* use only major.minor for docs

* Fix error where import fields that are None can cause Source.mapRawData() to crash in some cases

* Updated TODO and NEW_FEATURES

* There will be no daykeys if the daily summaries have been dropped.

* Restructure usage string, hard code transaction days

* dry-run goes with fix-strings, not check-strings

* Log daily summary version

* No need to check for weewx.debug

* include examples in manifest

* added examples and extensions to data_files

* do not install sample extensions

* Can now specify date field separator for Cumulus imports, weewx -> weeWX

* Clarified option strings

* Rudimentary test of selective daily summary rebuild

* No longer allows selective rebuild of the daily summaries

if the summaries are not complete

* Hardwired UTF-8 encoding, but with a warning comment.

* Hardwired UTF-8 encoding, but with a warning comment.

* Documented Cumulus import separator config option

* Added comments about Tools.

* Changed to execute in user environment

* Ported to PyMySQL as an alternative to python-mysqldb

See https://github.com/PyMySQL/PyMySQL for a description of PyMySQL

* Recognize additional MySQL "Can't connect" error

* Fixed error in test suites

Subsequent tests depended on ordering of a dictionary.

* pymysql seems to have problems connecting via file socket

unless it is told explicitly about it.

* Workaround for pypy compiler

* Defaults now support MySQLdb over pymysql

* Fixed bug in record augmentation.

The augmentation was happening without giving StdConvert a chance to do
its thing.

* More clear msg when encountering an ImportError

* Clarified the relationship between archive period and report_timing option, aded note regarding primacy of the report cycle

* Reverted back to MySQLdb only version.

* Changed config option names but never changed the code!

* One transaction for updating daily high/lows and archive record

Formerly, these were done in two transactions.

* v3.7.0a2

* Adjustable value for how long to wait after a bad uploader login.

Option retry_login. Fixes issue #212.

* Fixed Cumulus import rain field issue

wee_import will try to use field 26(AA) - midnight reset daily rainfall
but if not available due it will revert to field 9(J) or 11(L)

* Switched back to __str__ when extracting string out of template.

.respond() doesn't seem to encode Unicode characters properly

* Fix errors in wee_import WU step-by-step, remove Cumulus version caveat on rain

* Now uses dedicated test users 'weewx1' and 'weewx2'

* Formal check of the various MySQLdb exceptions.

* Added sqlite3 exceptions.

* Reworked check_strings() output (#213)

Reworked check_strings() screen and syslog output:
- now gives progress ala --rebuild-daily
- syslog is silent for --check-strings and --fix-strings with --dry-run
- left 'Preparing' (rather than 'Starting') but added 'this may take a
while' as there is a significant delay in dbmanager.genBatchRows()
initialising at line 619 (well there was for 400k records)

* reduce debug log spewage in wmr300 driver

* Finished formal test of errors

* First cut at V3.7 exception hierarchy

* Ported the weedb sqlite driver to the new exception hierarchy.

* Ported MySQLdb to the new database exception hierarchy.

* windSpeed fix now gracefully handles no windSpeed summary table, tweaked --update output/logging

* Now picks up absence of windSpeed daily summary

* The weedb Connection object can now be used in a "with" clause.

* The weedb Cursor object can now be used in a "with" clause.

* V3.7.0a3

* more code removal

* code formatting only

* use apt instructions for debian installs

* Reworked --wee-database section of Utilities Guide to reflect current wee-database operation

- revised usage
- reword --rebuild-daily
- reword --check
- reword --update

* More details on upgrading

* Moved start time to just before applying the patch

* Accumulator is now initialized with override values from weewx.conf

* Added sentences about wee_import/interval and weight patching multiple dbs

* remove extensions from rpm and deb packages

* v3.7.0b1

* Cleaned up some HTML warnings.

* must do a try loop at the read level so we can skip the no data 'errors' and return empty buffer so that a subsequent write will get the station to talk again

* Slightly more robust mechanism for decoding last time a file was FTP'd.

* adjust wording of weighting description

* added examples

* simplify

* fixed typo

* fixed typo

* read /etc/default before bailing out

* make init script work properly with /etc/default/weewx

* make output consistent

* more simplification

* keep PEP happy

* avoid resource consumption from slow reports by extending the StdReport.max_wait.  provide log messages when it happens.

* new features have move to the roadmap

* no more todo items left

* do not emit default sensor_map to the config

* aborted attempt to get additional battery status

* bump to 3.7.0b2

* do recipe using wget instead of curl

* forgot the O option to wget

* do not warn when calibrations are ignored - the implementation resulted in too many log entries

* get rid of tabs

* added notes about wmr300 rain counter and logger

* added norwegian 'no data available' as 'Ingen data er tilgjengelige'

* simplify.  eliminate more passive voice and gerunds.

* avoid run-on

* provide better feedback for operational errors.  make manager logging more consistent.

* fix typo in wmr300 ConfEditor

* decode heatindex and windchill from wmr300 sensor outputs

* fixed bad extract_signed invocation

* fixed wmr* partial packets note

* added mysqldb install instructions to userguide

* minor html fixes

* added link to wee_extension

* clarify acurite sensor transmission periods.

* added battery status for all wmr100 remote t/h sensors

* added battery status for all wmr100 remote t sensors

* document changes to wmr100, wmr200, wmr9x8 drivers.  fix 'Calculatios' typo.

* fixed inverted wmr200 battery status

* rename fault_out to out_fault to match pattern of other faults

* make battery status labels consistent across all wmr drivers

* wmr300 driver moves from rc to 0.18

* bump to 3.7.0b3

* css fixes: neutralize the glaring yellow; brighten the note green to more closely match the tone of warning red; @media tweaks to match font changes.

* fix column title

* distinguish selection color from code color

* fixed shift bug in weewx-multi

* Fixed (I think) issue #219

* update logwatch script to properly handle revised generator log messages

refer commit
03c3e4ef57 (diff-3cefdd7265f340e9683b0a2d0417b70f)

* normalize the quick-start

* Merge branch 'development', remote branch 'origin'

* fix layout table width on installation pages

* v3.7.0b4

* use released_versions instead of previous_versions

* Merge branch 'development', remote branch 'origin'

* parameterize release rule.  make release rule idempotent.

* replace cheetahtemplate.org with pythonhosted.org

* wee_database --help output was slightly different to reality

* Removed BOM at beginning of customizing.htm

* wee_database --help output was slightly different to reality

* Reworded comment on whether to --update daily summaries.

* cater for change in manager log output

* remove misleading windGustDir info

* bump to 3.7.0

* Added date to change log

* escape the dollars in release target

* fixed log syntax

* adjust log level for wmr100 bad usb report

* emit rapidfire cache info only when debug >= 3

* enable post_interval overrides for WOW uploader

* Fixes issue #230, exception when using Rapidfire with metric units

* Added StdRESTbase back in.

It seems that some uploaders still depend on it.

* Fixed problem that prevented a MySQL port from being specified.

* Added antialias GIF to list of files to be installed.

* Make sure GIF files get uploaded

* distribute examples in a single directory

* distinguish docs/examples vs examples

* Fixed bug that prevented a port from being specified for MySQL installations.

* Removed redundant change log entry

* Add MySQL Error 2003 to exceptions (#234)

* Added PR #234 to change log

* Documented change in location of the examples

* update examples paths in remaining guides.  explicitly list all path changes for examples.

* By default, autocommit is now enabled for the MySQL driver. Fixes issue #237.

Included regression test.
2017-03-20 00:41:34 -07:00
matthewwall
7139033e92 eliminate experimental directory, move examples directory. addresses issue #183 2016-12-06 13:11:18 -05:00
Tom Keffer
f3966d1d81 Added flag record_augmentation.
When doing hardware record generation, the engine now augments the
record with any additional observation types it can extract out of the
accumulators. Fixes issue #15.
2016-12-01 18:53:32 -08:00
Tom Keffer
18fcdb6a56 Can now do SummaryByDay (as well as SummaryByMonth and SummaryByYear).
NB: This can generate *lots* of files --- one for every day in your database! Leaving this undocumented for now. Fixes issue #185.
2016-11-28 08:49:21 -08:00
Tom Keffer
2b723cdf24 Documented the anti-alias feature. Fixes issue #6. 2016-11-27 14:53:19 -08:00
Tom Keffer
98035cac09 It's now possible to iterate over every record within a timespan.
Includes tests.
Fixes issue #182.
2016-11-26 08:20:59 -08:00
Tom Keffer
1a3fe255db Included sample log that illustrates corrupt Vantage memory. 2016-11-26 05:35:45 -08:00
Tom Keffer
e11c9d252a Added reference to issue #13 2016-11-24 16:53:12 -08:00
Tom Keffer
c4ca8b65b6 $current now searches the record from event NEW_ARCHIVE_RECORD.
$current first searches the record from event NEW_ARCHIVE_RECORD for an
observation type. If it cannot find it there, it searches the database.
2016-11-24 16:50:10 -08:00
Tom Keffer
7bcb47fdcd Bug fix on wee_report for arbitrary time.
Fixed bug that was introduced in v3.6.0, which prevented wee_report from
working for anything other than the current time.
2016-11-24 16:29:53 -08:00
Tom Keffer
a9e02957fa Merge branch 'master' of https://github.com/weewx/weewx.git 2016-11-22 12:23:53 -08:00
Tom Keffer
21f55b4de4 Changed algorithm for calculating ET
Former algorithm assumed daily values. This one assumes hourly values.
Fixes issue #160.
2016-11-22 12:21:16 -08:00
matthewwall
56e4cb8ede fixed index.html.tmpl reference in xstats example 2016-11-21 14:54:43 -05:00
Tom Keffer
cab12d31c1 The Standard skin now includes plots of outside humidity.
Fixes issue #181.
2016-11-15 09:07:51 -08:00
Tom Keffer
5abd3e66cb Removed the site-specific "Pond" extensions from the Standard skin.
They've outlived their usefulness
2016-11-15 08:52:37 -08:00
Tom Keffer
7ba496f0c6 Added HTML links for clearing the Vantage logger memory 2016-11-11 05:15:41 -08:00
matthewwall
06703f1393 added two more acurite models 2016-11-10 09:44:40 -05:00
matthewwall
7cf9dc1926 fixed a few typos in utilities guide 2016-11-09 19:39:00 -05:00
Tom Keffer
d193af458b Added v3.6.2 change notes to changes.txt 2016-11-08 08:50:04 -08:00
Tom Keffer
97dd8597e9 The engine now logs locale. Additional information if a TERM signal is
received.
2016-11-08 08:15:42 -08:00
matthewwall
b8c1b2e536 misc hardware edits 2016-11-07 09:43:08 -05:00
matthewwall
112edddfe5 update docs to reflect sensor_map changes 2016-11-06 23:38:49 -05:00
matthewwall
ec0d65b8c7 fix and document initialization issues for wmr300 driver 2016-11-02 10:59:12 -04:00
matthewwall
dd6cbd0afe minor html edits 2016-11-01 17:49:08 -04:00
matthewwall
27857de3fd Merge branch 'master' of github.com:weewx/weewx 2016-11-01 12:01:26 -04:00
matthewwall
28370b8dbb provide example for ftp and rsync in userguide 2016-11-01 12:00:57 -04:00
Matthew Wall
3b8d6eaaad use database_field = hardware_name pattern in te923 driver. emit firmware version for cc3000 for better diagnostics. 2016-10-31 23:15:57 -04:00
Matthew Wall
93dd84be2f use schema_name = hardware_name for sensor map in cc3000 driver 2016-10-31 22:19:17 -04:00
matthewwall
10e0f8b74e fixed broken td 2016-10-31 15:10:35 -04:00
matthewwall
2371d9f070 document the fine offset data_format option 2016-10-19 16:33:00 -04:00
matthewwall
ec9e43deec document the data_format parameter for fousb 2016-10-18 10:09:39 -04:00
matthewwall
93fe938ac7 added yet another fine offset clone 2016-10-18 10:00:36 -04:00
Tom Keffer
297005c485 Fixed bug that crashed Cheetah if the weewx.conf configuration file
included a BOM. Fixes issue #172.
2016-10-16 11:23:24 -07:00
matthewwall
f8da3ea695 make readme.htm match the docs.html of the web site 2016-10-14 08:39:13 -04:00
matthewwall
afb5d7c1d0 minor doc adjustments for linking to apt instructions 2016-10-13 19:10:11 -04:00
Tom Keffer
8d4a842e9f V3.6.1 2016-10-13 15:16:49 -07:00
matthewwall
317c145e83 links to web server and troubleshooting 2016-10-13 10:54:24 -04:00
matthewwall
4fc7718197 eliminate near-empty importing section from customization guide 2016-10-12 18:58:21 -04:00
Tom Keffer
92dc89d5de v3.6.1rc2 2016-10-12 07:10:36 -07:00
gjr80
ca3d1c9f05 Merge remote-tracking branch 'upstream/master' into wee_import 2016-10-12 14:22:59 +10:00
gjr80
a296a2e283 Updated wunderfixer documentation to use posix date format and equal signs in options
I noticed that none of the single letter options used equal signs
whereas of the 'word' options --config did but no others. All word
options now have equal signs but left single letter options as is,
putting the equal sign in just looked odd.

The 'usage of this utility is at YOUR RISK' notice was removed from the
usage text on 24 Sep by Matthew. Even though it remains in the utility I
have removed it from the wunderfixer usage text in this commit and will
remove it from wunderfixer as well. Not sure if some sort of standard
note or warning should be included instead.
2016-10-12 13:59:55 +10:00
Tom Keffer
45e7c8db89 Bumped version to v3.6.1rc1 2016-10-11 15:47:31 -07:00
Tom Keffer
30200537f6 Adopted format YYYY-MM-DDThh:mm for specifying the start time of the
simulator.
2016-10-11 15:45:46 -07:00
gjr80
fd627f2b7b Merge remote-tracking branch 'upstream/master' into wee_import 2016-10-12 06:15:44 +10:00
gjr80
13881de934 Updated wee_import instructions with revised date formats
Now takes into account revised --dat and new --from and --to command
line options.
- updated usage text
- revised --date option instructions
- added --from and --to option instructions
2016-10-12 06:14:28 +10:00
matthewwall
fc97406fad re-map sensor id for wmr200 extra sensors 2016-10-11 15:28:13 -04:00
matthewwall
16028d0f11 use existing gpg keys for publishing on apt repo 2016-10-11 15:09:56 -04:00
matthewwall
da1d0a574c fix html headers in all of the htm pages 2016-10-11 11:32:03 -04:00
matthewwall
3eb6a81906 Merge branch 'master' of github.com:weewx/weewx 2016-10-11 10:47:35 -04:00
matthewwall
68100080a9 remove rc1 status from wmr300 driver 2016-10-11 10:46:33 -04:00