Cumulusmx.db (preserving history): Difference between revisions

From Cumulus Wiki
Jump to navigationJump to search
Line 34: Line 34:
Whenever I have viewed this table (with phpLiteAdmin), there has been zero rows within the table.
Whenever I have viewed this table (with phpLiteAdmin), there has been zero rows within the table.


Unless anyone else knows differently, I believe this table was created by Steve Loft because he was unsure whether to use text files or database files in Cumulus 2 and 3. Someone suggested he used SQLite3 database tables, and I believe this table represents Steve Loft's attempt to replace the [[Standard log files|Standard log text files]] with a database equivalent.


I also assume that when Mark Crossley took over MX development, he found this database table in the package Steve Loft left, and not then understanding how the code worked, he kept this table and kept the code (one reference is in module [[Cs_Code_Modules#Cumulus.cs|Cumulus.cs]]) that created the database and this table.
It is not documented anywhere I have seen what option you have to turn on in MX to start this database being updated. The file is created when you run MX, it is not included in the release distribution to ensure any data you have in the database table is kept when you install a new MX version.

<big>Could anyone who knows what option in MX updates this file, and in what context use is made of this database table, please explain it by amending this section</big>


=Release 3.12.0 onwards=
=Release 3.12.0 onwards=

Revision as of 21:28, 31 July 2021


As the name suggests, this file /CumulusMX/data/cumulusmx.db (note case for Linux environments) is only applicable for MX.

Database type

This file holds a SQLite3 database.


Releases 3.0.0 to 3.11.4 inclusive

The database only contains one table StandardData.

Here is the relevant create table instruction, so this tells you the 17 fields in the file: CREATE TABLE "StandardData"( "Timestamp" datetime primary key not null , "Interval" integer , "OutTemp" float , "LoOutTemp" float , "HiOutTemp" float , "DewPoint" float , "LoDewPoint" float , "HiDewPoint" float , "WindChill" float , "LoWindChill" float , "HiWindChill" float , "InTemp" float , "LoInTemp" float , "HiInTemp" float , "Pressure" float , "LoPressure" float , "HiPressure" float )

Whenever I have viewed this table (with phpLiteAdmin), there has been zero rows within the table.

Unless anyone else knows differently, I believe this table was created by Steve Loft because he was unsure whether to use text files or database files in Cumulus 2 and 3. Someone suggested he used SQLite3 database tables, and I believe this table represents Steve Loft's attempt to replace the Standard log text files with a database equivalent.

I also assume that when Mark Crossley took over MX development, he found this database table in the package Steve Loft left, and not then understanding how the code worked, he kept this table and kept the code (one reference is in module Cumulus.cs) that created the database and this table.

Release 3.12.0 onwards

Release 3.12.0 introduces a second table RecentData into the same database. This is documented in the update.txt for CumulusMX at release 3.12.0 (beta build 3134) as "Change: Cumulus MX now uses a persistent database to store the recent 1 minute data - This means that charts, recent webtags, and internal calculations for trends and periodic values will be more accurate after a restart - If Cumulus MX is offline for a prolonged period, data for that offline period will obviously still be at the station logging interval resolution".

This second table has the following columns:

Column number # Column name Column type Properties Description Example column value
0 Timestamp datetime Primary Key, can never be NULL, No Default Value, Dates and times for the last 7 days, at whatever interval available (at logging interval for historic archive data, at one minute intervals while MX is running) 2021-07-31 19:44:00
1 WindSpeed float Not NULL, No Default Value The average wind speed (see Wind_measurement#Weather_Stations_and_Cumulus for links) calculated at the stated time, if necessary converted to units requested 2.2593056529
2 WindGust float Not NULL, No Default Value The spot gust speed recorded at the stated time, if necessary converted to units requested 6.99691241605804
3 WindLatest float Not NULL, No Default Value The spot latest wind speed recorded at the stated time, if necessary converted to units requested 3.15989597323001
4 WindDir integer Not NULL, No Default Value The wind bearing (0 =calm), (1 to 360 = number of degrees) 315
5 WindAvgDir integer Not NULL, No Default Value The average wind bearing over the defined period 270
6 OutsideTemp float Not NULL, No Default Value The measured outside air temperature, if necessary converted to units requested 17.0
7 WindChill float Not NULL, No Default Value The wind chill, either calculated by MX, or supplied by weather station. (Note: strictly only valid for low temperatures and significant wind speeds) (In the example used here, temperature in previous column was too high for wind chill, so the value was set to agree with 'OutsideTemp' column instead)
8 DewPoint float Not NULL, No Default Value The dew point, either calculated by MX, or supplied by weather station, for the stated time. 11.9134549845367
9 HeatIndex float Not NULL, No Default Value The USA Heat index as calculated by Cumulus for the stated time (if the temperature is high enough) (In the example used here, temperature in 'OutsideTemp' column was too low for heat index, so the value was set to agree with 'OutsideTemp' column instead)
10 Humidity float (1 decimal place) Not NULL, No Default Value The Relative Humidity reported by the station at the stated time 72.0
11 Pressure float Not NULL, No Default Value The sea level pressure at the stated time, either as reported by the station or calculated by Cumulus from the absolute pressure reported by the station, if necessary converted to units requested 996.400024414062
12 RainToday float Not NULL, No Default Value The rainfall for today so far, calculated by Cumulus from the rain counter (column 15) now minus the rain counter at start of day, if necessary converted to units requested 4.5
13 SolarRad integer Not NULL, No Default Value Solar radiation value reported by station at stated time 200
14 UV float Not NULL, No Default Value The Ultra Violet Index reported by station at stated time 3.0
15 raincounter float Not NULL, No Default Value The rain counter is used by Cumulus for all rainfall outputs, this is its value at stated time 550.4
16 FeelsLike float Not NULL, No Default Value The Feels Like temperature calculated by MX at stated time 17.0782773978147
17 Humidex float Not NULL, No Default Value The Canadian Humidity Index, calculated by Cumulus at the stated time 19.1775362738161
18 AppTemp float Not NULL, No Default Value The Apparent temperature, calculated by MX at the stated time 16.8864476063546
19 IndoorTemp float Not NULL, No Default Value The indoor temperature directly as reported by station at stated time 120.89999961853
20 IndoorHumidity integer (0 decimal places, contrast with column 10) Not NULL, No Default Value The indoor relative humidity directly as reported by station at stated time 61
21 SolarMax integer Not NULL, No Default Value The calculated maximum value for solar radiation at stated time 1026
22 Pm2p5 float Not NULL, No Default Value Air Quality expressed in terms of particulate matter of 2.5 μm, or less, (?? Rolling 24 hours average ??) 1.5
23 Pm10 float Not NULL, No Default Value Air Quality expressed in terms of particulate matter of 10 μm, or less, (?? Rolling 24 hours average ??) 1.7
24 RainRate float Not NULL, No Default Value The rainfall rate calculated for the stated time 303.2