Category:Cumulus MX: Difference between revisions
Line 69: | Line 69: | ||
The text that was here has been moved to a separate article, that makes it more accessible, please see [[What to do when I have a problem with MX|What to do when I have a problem with MX article]] |
The text that was here has been moved to a separate article, that makes it more accessible, please see [[What to do when I have a problem with MX|What to do when I have a problem with MX article]] |
||
== |
== Cross reference to comparing Cumulus 1 and MX == |
||
This has also been moved to a separate article, so those not interested don't need to read [[Comparing Cumulus 1 and MX]]. |
This has also been moved to a separate article, so those not interested don't need to read [[Comparing Cumulus 1 and MX]]. |
Revision as of 10:38, 21 June 2020
If you have any suggestions for improving this article, either edit this page yourself, or put your suggestion in the correct Support Sub-Forum. Thank you.
Introduction
What does Cumulus MX do?
That is covered elsewhere, in the article that introduces Cumulus first, that that will explain what Cumulus software can do for you, then you will be linked back to this page.
This article
This Wiki article was originally exactly what Steve Loft said in the MX early builds support forum when he first started experimenting with Cumulus MX and access was restricted to those willing to experiment with his tests.
In this rewrite, I am adding more as I explore more of the functionality of MX; and as I learn more from posts in the forum.
If you can correct anything I write, add anything I have not yet covered, or know something that I might not know, then please remember, anyone can update this article, I don't have any special access in the Wiki and any page I edit can be edited/corrected by anyone else.
During a period of my time in employment I was responsible for approving documentation on a large computerisation project, and later for supplying updated information for a public faced web site, and in both cases there were house style, and I probably continue to use that style.
You might be afraid to add your contribution because my style is not the same as your natural one. Don't worry; as long as you use short paragraphs or bullet points, with lots of headings, then your contribution can blend in.
Cumulus MX
- When this article was first created, Cumulus 1 was still recommended for most users.
- It had extensive help screens built into the package, it had an installation package, and produced a main screen when it was running that summarised the weather and gave access to all the settings and editors.
- At that stage Cumulus 3 also known as MX was experimental and it had limited functionality, much less that was available in Cumulus 1.
- Consequently, at that time, most Cumulus users were using Cumulus 1, and just those wishing to take part in beta testing used MX.
- Steve Loft who wrote and developed Cumulus 1 and MX, no longer offers any support.
- The source code for Cumulus 1 is not available, and it was developed using a coding environment that is no longer available.
- Consequently, Cumulus 1 functionality can not be changed, and without knowledge of how it was written, there is no ongoing support, just the experience of those who have used it, or are still using it.
- Cumulus 1 was designed to work with weather stations that were available when it was written, the technology used by stations, and models available, have changed since then.
- The ongoing development is adding lots more functionality into MX, it can do a lot more with the the numbers it reads from weather stations, and it can be updated when weather station features change.
- Therefore, the advice to newcomers is to use Cumulus 3, normally called MX. Similarly, the advice to established Cumulus 1 users is you are now missing out on features unless to move to MX.
- Consequently, this is the Cumulus flavour that most users will select to install and run.
- However, there are no instructions built into the MX package, so it is hoped that the update of this article will help people to understand MX sufficiently to use it both more easily and to maximum capability.
- Currently, Mark Crossley who has been responsible for all recent MX releases is able to answer questions in the support forum for recent MX releases, but this article will hopefully allow him to spend less time answering questions and more time improving MX (and more time for everything else in his life)
It would be wrong not to say here - MX is still not bug free, there is a lot more to correct as well as all the enhancements to cope with new weather station hardware There is a page created in October 2018 listing MX Issues to be resolved, but I suspect it is out of date.
Restrictions on who can use MX
MX makes extensive use of library packages like bootstrap (cascade styling), datatables (display and manipulation of tables), JQuery (JavaScript package that provides code supports for multiple browsers and other libraries to work together), high stock (for drawing charts), datepicker (a JavaScript based routine for making date selection possible using a calendar type interface as not all browsers directly support that), handlebars (templates for generating HTML), alapaca (JavaScript from Gitana Software that generates interactive HTML5 forms), Steelseries (provides the gauges used), dataTables (displaying the log files), altEditor (for editing the log files) and a few more. Most of these are open software and free for personal use, but some have restrictions on commercial use requiring a licence. Consequently, MX does have to declare it is not for use on a commercial web site.
Message from Steve Loft about who can use MX
Note: The graphs used in Cumulus MX are drawn using Highcharts and they are free for non-commercial use only, i.e. you may not use them on a company web site, see http://shop.highsoft.com/faq/non-commercial for clarification. For this reason, and others, use of Cumulus MX in a commercial environment is expressly forbidden.
Please include a link to the Highstock web site (as the supplied web page does) if you use the charts under the terms of the non-commercial licence.
Documentation for MX
Message from Steve Loft about documentation
There's quite a lot to read before you start - please do read all of this page and all the references it mentions, most of it is very important.
Note that most of the Cumulus 1 documentation also applies to Cumulus MX. MX specific documentation is currently in very early stages and some settings may not be obvious. Looking at the Frequently Asked Questions for Cumulus 1, Frequently asked questions for MX, and articles elsewhere in this wiki will help, as will looking at the Cumulus 1 help file, it is available on the Software Resources page. If you already use Cumulus 1, the help is part of the standard installation.
If MX is your first encounter with Cumulus, you will be at a disadvantage regarding documentation of many of the features, while those who have previously been familiar with Cumulus 1 will find most aspects of MX easier to pick up.
Message about this update to documentation
The update made to this page draws on what has been said spread over lots of posts on the support forum and attempts to make it more accessible by repeating it on this page. Consequently, you don't now need to search in the way that Steve Loft's original text above implies.
In writing this update, I have drawn on my own experience of moving from Cumulus 1 to MX, and thus my knowledge of Cumulus is from over a decade of experience with this software and a detailed study to check MX could do all I used to do with Cumulus 1 and much more. Before I add items to this article I play around with MX experimenting with what works and what does not work, but I have saved you the pain of where I went wrong, just telling you what is correct. I do need to add, that I don't have a separate testing environment, and therefore I am not willing to attempt anything that might muck up my collecting of weather information, plus currently I only have a second-hand (ex-NHS) PC and a simple smart phone, so my technology, as well as being from a generation who did not have computers, places restrictions on what I can say and do.
If this page, and those other Wiki pages it links to (e.g. Cumulus MX FAQ), do not answer all your questions then see the support forum for current Cumulus MX as that will let you see what other people have asked about, any posts I have not yet incorporated into this page, and there you get the opportunity to post your own query.
Cross-reference to What to do if you have a problem
The text that was here has been moved to a separate article, that makes it more accessible, please see What to do when I have a problem with MX article
Cross reference to comparing Cumulus 1 and MX
This has also been moved to a separate article, so those not interested don't need to read Comparing Cumulus 1 and MX.
Installing and Running Cumulus MX
Installing
There is no automatic installer (this may change). Cumulus MX is supplied as a zipped package on a link from download page.
When running Cumulus MX, you either have a package that runs it for you, or in your command type interface you type CumulusMX.exe or sudo mono CumulusMX.exe depending on device, (or click a shortcut).
There is a second exe file in the package. ExportMySql.exe daily or sudo mono ExportMySql.exe daily depending on device will populate a newly created database table to hold daily summary values with past rows. Replace "dayfile" with "monthly" in the run instruction for this exe to update all rows in a newly created table to hold values from all the monthly log files.
Completely new MX installation
Create a new directory (recommended name CumulusMX) and unzip the contents of the download package into it. See notes below for extras required in various operating systems.
The package contains everything else you need to read from your weather station (if it is a supported model), to load up the user interface (for settings and some simple web pages to see on a device connected to your home network). You might want to read topics on the MX support forum to discover about other people's experiences.
Running Cumulus MX
- Make sure your weather station (and any extra sensors) is connected to the device on which you have installed Cumulus MX, before you try to run Cumulus MX.
- Start Cumulus MX engine (command to do this varies between operating systems, so see sub-heading for your device below
- Start Admin Interface, it runs in a browser, by default on port 8998, see section below.
If you are running MX for the first time, without a configuration file (none is included in download package), see here for screen shots and instructions.
The software currently (this is early 2020) called .NET was originally for all operating systems, but Microsoft then decided to restrict it to just Windows, mostly to encourage greater dominance by Microsoft software and hardware. Mono was then born based on .NET to work with all operating systems, Mono subsequently changed independently from .NET. More recently Microsoft launched an alternative called .NET Core that took out of .NET the parts that were Windows specific. Perhaps confusingly, in November 2020, there will be change around of names, and the multi-operating system .NET Core product will take over the .NET name. I don't pretend to understand the technical details, but the impression I get is that the new .NET in November will be similar to Mono, so apps designed for that will still work, but apps using .NET to make code designed for windows will stop working
Requirements for running on Windows
To run MX on Windows, you need .Net version of at least 4.5.2 installed. This is only available for Vista SP2, Windows 7 SP1, Windows 8, Windows 8.1.
For Windows 10 you need version 4.8 or later, this should already be installed by your windows update feature. The .Net download for version 4.8 should be here https://dotnet.microsoft.com/download/dotnet-framework/net48.
Cumulus MX initiates a web server, to do this it may need administrative access, consequently to avoid having to run MX as an administrator you can issue a command that allows all users to bind to port 8998 which is the web server it initiates (this is used for the Cumulus MX user interface). Note that if you plan to change the interface port by using the port parameter in your launch of MX, you should change the 8998 to whatever port you are planning on using. To enter the command, first open a command window as administrator. One way to do this is to right click the windows symbol at the start of the windows task bar. The option to choose there (on windows 10) is Windows PowerShell (admin), but an option called Command Prompt (Administrator) will also work. Once that opens a new window type:
netsh http add urlacl url=http://*:8998/ user=\users
You only need to do that once. After than you can initiate MX from any user, you don't need to run as administrator.
Talking about command windows, if you want to check that the port is open for listening (when MX is running, the port is used for the administrative interface) type netstat -an | findstr 8998 into the command window.
After you have done this you can run CumulusMX.exe normally without Administrator rights and therefore you can create a short-cut to run MX when your PC starts (put your user name where I have put ...), the shortcut should point to T:\CumulusMX\CumulusMX.exe (where T is used here only to denote the drive on which you have installed MX as it does not need to be the same as where your operating system is):
C:\Users\...\AppData\Roaming\Microsoft\Windows\Start Menu\Programs\Startup\CumulusMX.exe
With this you might want to right click on that shortcut, select properties, then you can set the starting position for the command window, the colours and font it will use, and even choose to start minimised, amongst many other selections.
Look at your hub or router (this should have come with instructions on how to do this in your browser) and on one screen it should show what devices are connected to your LAN and wifi. Look for the IPv4 address (w.x.y.z) of the device you have installed MX on, for example 192.168.1.64. Then give your Computer a fixed address for MX user interface by finding the network card via Network and Sharing Centre (Control Panel), click on Change Adapter Settings, then Right click on Ethernet or WiFi Adapter, select Properties and in the window that opens right click on Internet Protocol Version 4 (TCP/IP 4), and select properties and on that pop up screen tell the computer to "use the following IP address and fill it out with a subnet mask of 255.255.255.0 and gateway address between 192.168.1.1 and 192.168.1.254 (depending on the address of your hub/router).
Setting up for either manual or automatic running
There are 3 ways on Windows to create a way to run MX, you can't just click on the executable in file manager, because Windows needs to be told the path for loading all the related .dll files.
- Create a shortcut on your desktop (and/or the taskbar) for the CumulusMX.exe executable cmd.exe /C start CumulusMX C:\CumulusMX\CumulusMX.exe -debug, the "-debug" is optional, it starts the logging in debugging mode so the log created in MXDiags folder has more information. There are other optional parameters all listed later.
- In that shortcut define the path where the executable is located as the path to start in.
- Remember, if you have not done the netsh http add urlacl url=http://*:8998/ user=\users command mentioned above, you must run as administrator.
- Add any of the parameters that can be used with the executable, as listed later, such as specifying a different port for the admin interface , or starting with debugging.
- Choose whether to start as minimised or as a command window
- You can also choose text colour (foreground) and background colour, you can choose where the window appears (so if you have two monitors you can choose which one it appears on), and how big that window is. There is a forum post by water01 about this.
- Now you can click the shortcut to start the engine
- OR place the shortcut as defined above in the start up folder for the user account so MX automatically starts when you connect/log in (see a later section for how to find that start up folder).
- OR declare a task in the scheduler to start MX; in the Actions tab fill in fields as follows (the other tabs should be obvious):
- Action Start a program from drop-down
- Program/script cmd.exe (this is standard Windows environment to run something)
- Add arguments /C start Start_MX \CumulusMX\CumulusMX.exe -debug -port=nnnn (the "/C" means this task will close once it has started the task, the "Start_MX" is how the task will be labelled as it is running, the next argument "\CumulusMX\CumulusMX.exe" actually starts the executable and it does not need a drive prefix as that is in next box.
- Note in this example I have included next two optional parameters that can be used after the .exe call in that same box, here -debug (only include if you want full debugging logging) and -port=nnnn where nnnn is the port to be used for admin interface (only include if want to change from default 8998),
- all optional parameters are listed later
- Start in \CumulusMX (include a drive specifier if necessary)
Each time you want to run Cumulus MX on Windows:
- First start the engine in one of the 3 ways from last sub-section
- Next start the admin interface, it does not need to run all the time, but only when you need it (when you first use MX you will need it to access the settings where you tell MX what type of station you have and what units you want to use, and set various timing options), it normally runs on port 8998 (to vary that there is a -port parameter that is followed by required port and that port parameter has to be entered every time you start MX if you are not using the default port).
Try start /min C:\Cumulus\CumulusMX.exe to run MX as a minimised package (although in Windows you can change the properties of the shortcut you use to start minimised).
Stopping Cumulus MX on Windows pc
The recommended way is to click into the command window in which MX is running, hold down Control key and press C. It is normal for there to be a short wait, then a message "Cumulus Terminating" and then after another short wait, it will say "Cumulus Stopped" and immediately after that the command window will close.
Some people, click in the task bar and select close, or click the X button on top right of command window. Although these are not official advice, they do seem to work.
There are packages that can be programmed to send a control C to a running task, and to not continue until the task window has closed. Remember to also program in a subsequent delay in that package, to make sure the package waits for MX to close, or do a check that MX has released all the files it might need to update.
You should not issue a TASKKILL instruction, as that will prevent MX correctly writing out to all the files it should update on exit. Consequently, it will not restart correctly and may actually lose settings and data.
Requirements for running on Linux and OS X
You will need to install the Mono-complete runtime (the latest version of Mono should work with all functionality of latest MX in all locales). Mark Crossley says "There shouldn't be any outstanding issues with Mono, afaik they are all resolved - except for the Moon image rotation in the southern hemisphere which does not work with Mono 6.0 thru to the latest 6.8.0, only version 5.x works correctly atm for System Drawing."
- For OS X, you can download this here - http://www.mono-project.com/download/.
- How you install on Linux depends on the flavour of Linux you are running. There are download links for Linux at the same URL, but it is often easier to use a package manager, which will download and install it automatically.
- For example, in 'Raspbian' on the Raspberry Pi, you can install mono with these commands:
sudo apt-get update sudo apt-get install mono-complete
or
sudo apt update && sudo apt upgrade sudo apt install mono-complete
Make sure that you have the mono-complete package installed.
The "sudo" prefix gives the command 'root' privileges, that allows administrative commands like update and install to run.
To actually run MX
Open a terminal window, change to the Cumulus MX directory, and then type:
sudo mono CumulusMX.exe
There are some optional parameters you might need to use, as they also apply to windows they are covered later.
Next start the administrative interface, basically same as described for Windows above. More information on admin interface later.
Other issues
There are lots of topics in the MX sub-forum about a multitude of issues about commands to use to install and check mono, how to stop MX and differences between different devices (including Mac) and different Linux versions. At the moment, there seems to be some uncertainty, and consequently, I have not attempted to include/summarise all the material I have found.
APPEAL - Please could any readers who have experience of running MX in a Linux or Mac environment please consider writing advice into this article. I want it to be a comprehensive accurate article.
Notes by ExperiMentor (in Switzerland)
These comprehensive notes describe how to install Cumulus MX on a Pi Zero, using a PC to do some of the work:
Buy equipment
- Raspberry Pi Zero W
- A faster Pi is NOT needed for running Cumulus. Pi Zero W has WiFi and one USB port which is all that is needed for headless running.
- Using a faster Pi might speed parts of the installation process, but are overkill for actual ‘production’ running. A faster Pi will work fine though if you have one going spare and don't mind the extra power use.
- Case if desired
- Micro SD card eg 16 GB, decent quality. Adapter if needed to put Micro SD card in PC
- OTG cable (micro USB plug to standard USB socket) to connect a USB weather station to Raspberry Pi [you may have got one free with a mobile phone or tablet] if it's a USB weather station. Not needed if you have a WiFi or ethernet weather station. An Ethernet weather station will need connected to your router, not the Pi.
- Suitable Micro USB power supply (it does not need to be a high power 2.5A version for Pi Zero W with only the weather station attached; it will be powered on 24/7, so a low power consumption ‘switched mode’ type is preferred – ie one that does not become warm when plugged in with nothing attached. You may have a suitable one from a mobile phone.
Download useful PC software and install on your PC These instructions are for a Windows PC. Steps would be similar on a Mac, but programs and details would differ. Should also be possible with an Android tablet.
- SD Formatter (the Windows Format facility will NOT do)
- balenaEtcher (for unzipping and burning images to SD cards) [Previously named 'Etcher'] https://etcher.io/
- Win32DiskImager (for backup & restore of SD card images) https://sourceforge.net/projects/win32diskimager/
- PuTTY (an SSH client for Windows) https://www.putty.org/
- FileZilla (an FTP file transfer program for Windows) https://filezilla-project.org/download.php
Download Raspbian Pi Operating System
- Save it on your PC, from https://www.raspberrypi.org/downloads/raspbian/
- "RaspBIAN Buster Lite" is probably OK, but other than small file size it offers no advantage over installing the full version of RaspBIAN Buster. These instructions are being tested using "Raspbian Buster with desktop and recommended software", the largest of all, which could allow you to do other things more easily.
- Just click on “Download Zip” (torrent might be faster if you have the ability, but not worth installing just for this)
- Do not unzip it
- These instructions have been tested with kernel version 4.14, released 18 April 2018 and with kernel version 4.14, released 13 November 2018 [March 2019] and kernel version 4.19 released 10 July 2019
Install Pi Operating System onto Micro SD card
Format the SD card
- Put Micro SD card in PC (use adapter if needed)
- If re-using a previous Pi SD card, click ‘Cancel’ on the warning about needing to format the card
- Run SD Card Formatter (click Yes to ‘Allow to make changes to your device’).
- Need to use this program rather than the Format tool in File Explorer, because Pi SD cards end up with a very small ‘Windows accessible’ partition and a large partition containing Linux. SD Card Formatter allows reclaim of the large partition.
- Your SD card should automatically populate in the ‘Drive’ box. In case you have another SD card in your PC, ensure the correct card is selected!
- Click ‘Format’ and check and accept the Warning messages
Copy the Pi Raspbian Operating System onto the card
- Run balenaEtcher on your PC
- Click ‘Select Image’ and choose the ‘Raspbian Buster’ operating system zip file that was downloaded earlier
- SD card should be automatically populated. In case you have another SD card in your PC, ensure the correct card is selected!
- Click ‘Flash!’. The operating system will be copied to the card. This takes about 10 minutes, followed by another 8 minutes to ‘Verify’
- Cancel any messages about needing to Format the card - they are just indicating that Etcher has installed the partition that cannot be read by Windows
- On completion, the card is ‘ejected’ from the PC. Physically remove it and then straight away reinsert it so that the content can be viewed in File Explorer
- TWO drives will now be visible for the SD card. You will likely see a warning that one of the drives needs to be formatted before it can be used. ‘Cancel’ that warning and ignore that drive.
- View the other drive, which is named ‘boot’ in File Explorer
- On the View tab, ensure the ‘File Name extensions’ is ticked
- Right click and select ‘New’, ‘Text document’. Change its name to SSH (deleting the .txt extension; you need to make an empty file called SSH not SSH.txt). Click ‘Yes’ to ‘Are you sure you want to change the extension?’
- Right click and select ‘New’, ‘Text document’. Change its name to wpa_supplicant.conf (deleting the .txt extension; you need to make a file called wpa_supplicant.conf not wpa_supplicant.conf.txt). Click ‘Yes’ to ‘Are you sure you want to change the extension?’
- Right click on this new file and select ‘Open with Notepad’ or ‘Open with …’ then select Notepad. Enter the following content exactly as below (copy and paste) then edit your country code (if needed), WiFi network’s SSID and password: NOTE: Change GB as needed to be the code for your country. The quote marks should appear in the file, that is ssid="YourNetwork" not ssid=YourNetwork . Same for psk.
ctrl_interface=DIR=/var/run/wpa_supplicant GROUP=netdev update_config=1 country=GB network={ ssid="YourNetwork" psk="YourNetworkPassword" key_mgmt=WPA-PSK }
- Not essential, but I like to keep copies of both those files for future use. They can be on the SD card with different names eg ‘SSH - Copy’ and ‘wpa_supplicant.conf - Copy’ as well as on your PC
- The function of these 2 files is to connect your Raspberry Pi to your network as soon as it boots, and allows you to connect to and control it from your PC by SSH using PuTTY. This avoids needing to connect a keyboard, mouse and monitor to the Raspberry Pi. It is particularly useful for Pi Zero W (or Pi Zero) which hasn’t got enough USB connections and no Ethernet (wired network) connection. This is called ‘Headless operation’.
- Right click on the ‘boot’ SD card in left pane of File Explorer and ‘Eject’ it safely.
Setting up the Raspberry Pi
- With nothing plugged into the Raspberry Pi, take the Micro SD card from your PC and put it in the Pi.
- In a later step, you will need to find out the Raspberry Pi’s IP address by looking at your network router’s web interface. I can’t help you with doing that. If you don’t know how to, an alternative is to connect a keyboard, mouse and monitor to the Raspberry Pi at this stage
- Plug the power supply into the Raspberry Pi. It will boot up (note flashing red and/or green LEDs depending on model).
- On your PC, log into your network router’s web interface and identify the Pi’s IP address, which will be in the form xxx.xxx.xxx.xxx, for example 192.168.1.123
- NOTE: If you will be switching from a faster “build” Raspberry Pi to a “production” Raspberry Pi Zero W, the IP address will change, so you’ll need to repeat this step later
- While in your network router for the ‘production’ Pi you will be using, set up some port forwarding that will be needed later.
- Forward port 8998 to your Pi’s IP address for TCP protocol if you want to be able to access the Cumulus web interface from the external internet (this brings potential security risk though). [Forwarding port 8002 as well was previously needed].
- Start PuTTY on your PC. In the box for ‘Host Name or IP address’, enter the Pi’s IP address from above. In the adjacent ‘Port’ box, enter 22. Connection type should be SSH. Click ‘Open’.
- A window opens. The first time you do this you will probably see a long message asking to confirm it is OK to connect to a not-previously-known device. Click ‘Yes’.
- Login to the Pi. Username is pi [lower case] and password is raspberry [lower case]
- You will see a warning that SSH is enabled but the password has not been changed, which is a security risk. We will change the password in a moment
- Type
sudo raspi-config
- Note, to copy from here (usually need to do 1 line at a time), select it then CTRL-C. To paste into the PuTTY window, right click.
- As needed, adjust the following settings:
- Change the password to something you will remember. Leaving it at raspberry is a serious security risk – exposes your whole network to hackers
- In Network Options,
- change the name of your pi to ‘Cumulus’ or something you prefer
- WiFi network and password have already been set by the wpa-supplicant.conf file added earlier
- In Boot Options, Desktop / CLI, select ‘Console Autologin’
- In Localisation Options,
- change ‘Locale’ if you need something different to en_GB.UTF-8. [Changing this takes quite a while on a slow Pi]. [As of Sep/Oct 2019, there is some kind of incompatibility between RaspBIAN Buster, mono v6.0.0.314 and locales other that en_GB - so unless you NEED another locale, it would be better to leave it as en_GB. The alternative is to force load an older version of Mono, for example v5.18]
- Change Timezone.
- Change Keyboard Layout if needed
- WiFi country has already been set by the wpa-supplicant.conf file added earlier
- In Interfacing options, SSH server has already been set to be enabled by the empty SSH file added earlier
- Select ‘Finish’. There is no need to reboot at this stage. But until you do, you will see messages "sudo: unable to resolve host raspberrypi", but these can be safely ignored (it's just because you renamed the Pi - will disappear after next reboot)
In the steps below, you will need to press y to agree to proceed at various times
If you have been building the Micro SD card on a fast Pi, now is the time to switch to the 'production' Pi, for which a slower Pi Zero W is more than adequate. Shut down the Raspberry Pi safely.
sudo halt
Move the micro SD card to the Pi Zero W. Power on the Pi Zero W. Your SSH (PuTTY) session will close out and you'll need to reconnect after the Pi has rebooted. Use username pi and the new password you chose earlier.
Add the ‘Mono’ package
- Simplification: Mono is a package which allows programs to be written cross-platform so that they will run on Linux (including Raspberry Pi), Windows and Mac OS, similar to the Windows ‘.NET Framework’.
- The previous anomaly with the USB library not working with later versions of mono, affecting Fine Offset stations and the later Oregon Scientific stations (WMR88/100/200 etc) has been fixed (in CumulusMX build 3044 onwards) and these and other stations should now be fine with later/current versions of mono. I am currently using a Fine Offset with mono v5.18
- Process is to install a security certificate, add the mono server to the list of software sources [sources.list] that the Pi searches, then install the mono-complete package:
sudo apt install apt-transport-https dirmngr gnupg ca-certificates sudo apt-key adv --keyserver hkp://keyserver.ubuntu.com:80 --recv-keys 3FA7E0328081BFF6A14DA29AA6A19B38D3D831EF echo "deb https://download.mono-project.com/repo/debian stable-raspbianbuster main" | sudo tee /etc/apt/sources.list.d/mono-official-stable.list sudo apt update sudo apt-get update && sudo apt-get upgrade sudo apt-get install -y mono-complete sudo apt autoremove
At the time of writing (18 Sep 2019), this gets Mono v6.0.0.334, which works with Buster (RaspBIAN 10). However, there have been reports of incompatabilities which require use of an older version of Mono. These may have now been fixed, or alternatively may be related to use of locales other than en_GB.UTF-8 . Please see other threads in Support Forum for discussions. NOTE: 29 Feb 2020: added -y into the line sudo apt-get install -y mono-complete . This makes the install bypass the usual 'Continue Y/n?' prompt¨which was causing strange problems for some, e.g. worked if just pressed 'Enter' to accept default 'Y', but aborted installation if pressed 'Y Enter'. Bizarre. Reboot your Raspberry Pi This would be a reasonable time to reboot your Pi:
sudo reboot
Your SSH (PuTTY) session will close out and you'll need to reconnect after the Pi has rebooted. Use username pi and the new password you chose earlier. Install Cumulus MX on the Raspberry Pi Download it from here to your PC, unzip on your PC which makes a directory named CumulusMX. Remember where that directory is located then on PC run FileZilla
- In the ‘Host’ box, enter the Raspberry Pi’s IP address eg 192.168.1.123
- In Username, enter pi
- In Password enter your pi’s password
- In Port, enter 22
- Click ‘Quickconnect’. Raspberry Pi’s directory structure appears on the right and your PC’s directory structure is on the left.
- In the LEFT window, navigate to where you unzipped the download of Cumulus MX earlier. Ensure can see the folder name ‘CumulusMX’ in the lower left window
- In the RIGHT window, ensure that the folder /home/pi is shown (see top right window; contents in bottom right window include .cache, .config etc)
- Drag the folder ‘CumulusMX’ to an empty area in the lower right window (not onto one of the existing directories). Watch progress as this copies the whole CumulusMX folder and contents to directory ~/CumulusMX on the Pi
- Close FileZilla
On Raspberry Pi PuTTY window:
sudo halt
Plug your USB weather station into the Raspberry Pi – USB cable into the OTG connector (probably via an adaptor lead) if using Raspberry Pi Zero W. If you have an ethernet or WiFi linked weather station then you won't need to do this - I don't have one so I don't know exact details. Steve below says you need to enter the IP address during Cumulus setup, but then also adjust a disconnect period if you are also using Weatherlink software.
Running Cumulus On PC, run PuTTY again and log in to the Pi as before (note you can save the IP address between sessions)
cd ~/CumulusMX sudo mono CumulusMX.exe
The next thing you will want to do is access Cumulus via its user interface from your PC, so that you can update the settings. Using the IP address for your Pi, in your internet browser, enter: 192.168.y.z:8998 (where y and z are numbers you will need to find from seeing how your router connects to your Pi. You’ll first see a dashboard page, then can access the Settings menu.
To make Cumulus run each time the Pi is rebooted (and force reboot in the early hours each day) On the Pi, type:
sudo crontab -e
On first run select the text editor you prefer (defaults to #1, nano, the easiest) Then add the following lines at the end of the file:
# Start Cumulus as background task 30s after reboot (delay to allow WiFi to startup) @reboot (sleep 30;cd /home/pi/CumulusMX;sudo mono CumulusMX.exe) & # Reboot each day at 0253 53 02 * * * sudo reboot
To stop the Pi and restart it without CumulusMX running (eg you need to do that if upgrading the CumulusMX version) type the following
sudo crontab -e
edit to put a # at the start of the line "@reboot..." Ctrl-X to save the change to crontab and reboot using
sudo reboot
When your pi restarts, CumulusMX will no longer be running. You can then do your version upgrade or other task.
To revert to normal auto-running of CumulusMX, go through the same again, but this time edit crontab to remove the # from the start of the line "@reboot...". Save changes and reboot - CumulusMX will be running.
Updating a version of CumulusMX is easily done as follows: 1. Stop CumulusMX running (it locks files while it is running) 2. Install the updated CumulusMX version into a new directory - I call mine CumulusMX3xyz (where xyz are the last 3 digits of the build number) so that I can easily see which build it is 3. copy the following from the old CumulusMX directory to the new CumulusMX3xyz directory:
- your CumulusMX/Cumulus.ini file
- your CumulusMX/data directory
- your CumulusMX/twitter.txt file (if you have personalised it)
- your CumulusMX/web directory (if you have personalised any web files)
4. Change your startup instruction to use the version in the new directory eg cd /home/pi/CumulusMX3050;sudo mono CumulusMX.exe
With that method you can easily revert back to the old version if something has gone wrong. If all is well, you can delete the old directory after a few days/weeks/months/if you need the space.
Updating mono version
- First, stop CumulusMX as above by editing crontab.
- Then remove the present version of mono:
sudo apt-get purge libmono* cli-common mono-runtime sudo apt-get autoremove
- Then install the new version
sudo apt-get install mono-complete
- Finally re-enable auto running by editing crontab to remove the # and finally
sudo reboot
Above Instructions: Last edited by ExperiMentor on Sun 01 Mar 2020 8:17 am,
Notes by Steve Loft
please note these notes ARE now obsolete, library routines have changed a lot since this was written in 2014
- If you have a Raspberry Pi 2, there is a later version of Mono available, which you may find works better that the one in the standard distribution, particularly if you use decimal commas. Mono 3.2.8 (which is the default in some Linux distributions) will not work if you use commas for decimals, as in some countries.
- On Linux you will need library libudev.so.0 which may not be installed by default. Installing package libudev0 may resolve this. There may be issues if you are using a 64-bit version of Linux. I'm not sure what the resolution is at the moment, if this is the case.
You need to specify something like /dev/ttyUSB0 for the connection for your weather station. This is set in the "station settings" and stored in the ComportName attribute in Cumulus.ini configuration file.
In some builds of MX you have to run as "root", there are ways of giving "root" like permissions when running MX as another user, see forum for details until this section has been updated.
Updating to a new MX release
Knowing when a new release is available
Using forum notifications
As new releases are announced in Cumulus MX Announcements and Download - PLEASE READ FIRST topic, you can use the spanner tool to subscribe to this topic to receive notifications of a new post announcing a new release (or any other release-related announcement).
MX installations will output message
If ...
- ...you have a monitor to see the output from the Cumulus MX engine (Windows call this a console window, for Unix-based implementations this is the output window when using terminal), AND
- ...your device running MX is connected to internet, AND
- ...your MONO (if not Windows) is not obsolete (SSL certificate out of date), AND
- ...you restart MX
... then you will see a prompt when a new version is available.
It is worth stressing that if you leave MX running, then this feature will leave you blissfully unaware that an update is available; it only checks when MX is restarted.
MXDiags
In addition ...
- ...if you can view the MXdiags file for the current session of MX, AND
- ... that is running with connection to the internet, AND
- ...you restart MX
... if a new version of MX is available, the MXDiags file will say so (the message is not easy to spot as there is a lot output before it, but here is an example, but in my experience the message has appeared at different places for each of the recent updates):
2020-05-27 04:18:48.326 Calculating sunrise and sunset times 2020-05-27 04:18:48.326 Sunrise: 04:58:11 2020-05-27 04:18:48.326 Sunset : 21:19:54 2020-05-27 04:18:48.326 Tomorrow sunrise: 04:57:08 2020-05-27 04:18:48.326 Tomorrow sunset : 21:21:11 2020-05-27 04:18:48.388 You are not running the latest version of CumulusMX, build 3080 is available. 2020-05-27 04:18:48.763 Station type:
There is no message in whatever place it can appear ...
- ... if you are using latest version, OR
- ... if you are not connected to the internet, OR
- ... if you keep MX running all the time!
Start/Stop script
When the Status option of this script is used, when a new release of MX is available, it will output a message.
What to read (and when) before updating
- If your update is from the immediately previous build, then just check the release announcement inCumulus MX Announcements and Download - PLEASE READ FIRST topic, or the précis style entry at Cumulus_MX_formal_release_versions in this wiki (if that is up to date) for details of functionality changes and which files have been affected.
- The actual release announcement should be more informative. That is where you can read if the upgrade requires one-off actions (like changing the schema if you use a database, or editing your web pages to take advantage of new web tags).
- The release announcement may sometimes include scripts to download and run to perform one-off actions.
- Be aware that it is worth while checking back on the release announcement the next day. It may have been edited because the original announcement forgot to mention something. It may have been edited to mention that some bugs have now been found, and give you advice as whether it is best to regress to an earlier version or take some other action until the next release is available.
- Any new development or change in a new version of MX might cause problems for some users. You might want to stick with the version you are already using unless you really need any new functionality or the fixes gained by upgrading.
- Also remember that there are bugs in all versions of MX, this is a large and complicated package, and the current developer has not been able to test all the code with all possible settings and all possible weather stations.
Updating from an older version
- If your update is skipping some intermediate versions, then check the corresponding release announcements or Wiki entries for every version since the one you have been using before planning your upgrade.
- Again there may be one-off actions required at particular in-between versions and these will not be described in the Wiki whether on the Software page or the Cumulus_MX_formal_release_versions page.
Back-ups
It is always best to take a backup of your existing MX installation before you do an update, this allows you to regress back to the earlier version if either you mess up installing the new version, or the new version has a issue that prevents it working with the versions of other software (like MONO) that your installation uses.
The two approaches
Some people upgrade by just copying in the files that the release announcement says have changed, others copy in all files from the downloaded zip. The first should only be used with caution, files like CumulusMX.exe.config can change between versions, but not be mentioned in a release announcement, and the developer will have been making edits to files since the previous release, and might forget exactly which files have been edited between releases. Also you may be upgrading from an earlier version and therefore be skipping several intermediate releases. You may be able to see the dates when files were changed within the zip and therefore be able to decide for yourself if you compare those dates with the previous release you were using if you have kept the download for the version you were using.
- The popular approach recommended by many forum contributors in many different posts (including at this post by Mark Crossley for example is to rename your current install directory, then unzip the new release, letting it create a new CumulusMX folder (or whatever name you prefer and specify in unzip options). Copy across Cumulus.ini and string.ini into that new directory, and then copy the contents of the data and Reports directories from your current install to the new install. Don't forget to copy any other set-up files across too. The advantage (as Mark says) is that you ensure you do use all the files in the new release, and don't miss out any he may have forgotten to mention in his release announcement. Another advantage (as PaulMy says here for example) is that you retain your old set-up intact and can easily restore it should you have a problem with new release.
- However,
- if you have a lot of set-up files, or other custom files, (i.e. files not part of release), or
- if you are downloading on a different device, or on a different disc to where you are running MX,
- then David (see this post) recommends this different approach. After downloading a new release unzip it on the device/disc where you down load it. Next simply copy the files (optionally only those that have newer dates because they have changed) into the existing MX directory on the device where you run MX. Then you know all your existing files are there, and as mentioned you can choose to only copy in the minimum number of files as specified in the release notes (find them on this forum or in Wiki here).
Updating when files within release might overwrite your own edits
If you have edited any files, see if the release notice says that file has been revised, if it has not then it is easy to keep your edited file by not copying in the replacement file from within the zip. If the release revises any file you previously edited, take a backup of your edited file, before you copy the new file into your folder. You can then use a file comparing tool to see what has changed in the release and what you changed and hopefully manage to merge to a new file that keeps any functionality change in a new release and keeps your customisation.
This includes any standard web pages you might have edited to give the look you desire, or the content you want (e.g. adding rain this month to this month page, or combining this month and this year page). If you have done major customisation to the standard website then you probably have followed the guidance and stored your new web page templates in a different directory and you use Extra Files to specify where they are, so the new MX will still find them.
If you have done any customisation to the interface then if you have followed the guidance in this article you will have copies of the files that you have customised of the interface folder so you have ability to copy them back into installation - but be careful with this one, as many releases change the interface in some way and the various components of the interface have to work together as a coherent unit. Be prepared to go back to the standard file for whatever you customised if something it depends upon has changed, after all you must not lose any vital functionality.
After update
Start the new installation of MX and watch out for any errors - If the device you run MX on has a monitor, then look in the terminal/command window. In all cases look at the latest file in the MXdiags folder to see if any errors are reported.
Finally, don't delete your old installation for a week or so as you may notice something from the older version that you haven't copied across! Check again that you copied across strings.ini, twitter.txt, Cumulus.ini, and similar files in the same folder level as CumulusMX.exe, as well as all the files in the data and Reports sub-folders.
Updating if you use a virus Checker
You may find that virus checkers such as Windows Defender reject your new version of MX. They need to be told it is safe.
Updating if you use the start/stop management script
1. look on Software download page, find the link to latest version, and fill out the '...' below appropriately as you run these 2 commands on your device where you do downloads:
cd /tmp wget https://github.com/cumulusmx/CumulusMX/ ... .zip
2. Once that download is complete, start cumulusmx.sh with option -u
/home/pi/CumulusMX/cumulusmx.sh -u
3.When asked for the zip file, enter
/tmp/CumulusMXDist
and hit the TAB Button
4.Choose the zip file with the CumulusMX update and hit return.
5. Follow the on screen instructions
6. With each update component .....you can choose: [y]es, [n]o, [A]ll, [N]one, [r]ename
I would recommend select A as that will simply replace all files without further action.
CumulusMX will be restarted after update completes.
You can check if the update was successful by using option -s:
/home/pi/CumulusMX/cumulusmx.sh -s
Optional parameters to add to the instruction to run the MX engine
Parameter for changing Port
When Cumulus starts, it will display the URL of the user interface. It runs on port 8998 by default; if this is not suitable for some reason you can over-ride it using the '-port' parameter on the command line, e.g. to use port 9999 instead:
sudo mono CumulusMX.exe -port 9999
Parameter for adding debugging
You can also add CumulusMX.exe -debug (to have full debugging turned on as MX starts), CumulusMX.exe -Logging=1 (for the Davis specific logging).
sudo mono CumulusMX.exe -debug -Logging=1
Parameter for changing Locale
On Linux and (in particular) OS X, Cumulus MX may not be given the correct locale to use, and you may get the default US locale even if that is not your locale. It will output the local it is using when it starts; if it is not correct, close it down and start it again, this time specifying your locale on the command line, using the -lang parameter . For example, in the UK, on a non-Windows device type:
sudo mono CumulusMX.exe -lang en-GB
Other local examples: CumulusMX.exe Current culture: English (United States), CumulusMX.exe -lang de-DE, CumulusMX.exe -lang el-GR (this is one of the locales that reads numbers with integer,decimal format), CumulusMX.exe -lang nl-NL.
If you are not sure what value you need to supply for the -lang parameter, there is a list here - http://msdn.microsoft.com/en-gb/library/ee825488%28v=cs.20%29.aspx. You need to supply the code in the first column ("Language Culture Name") in that list.
Note that this does not affect the language used by Cumulus MX (although it may in the future), it affects the decimal separator and the list separator.
Note that you may need to supply your administrator password after typing the 'sudo ...' command line. The system will prompt you for this if it is needed.
Library software
Cumulus MX uses library software for a lot of the standard functionality. The library software is largely included in the distribution zip.
Library software for admin interface
- Alpaca
- Found on github, alpaca software is effectively a programming language extension, and you really don't need to worry about it.
- It is used for most settings screens.
- Bootstrap
- Also known by some as Twitter Bootstrap which gives a clue as to its origins as an internal tool for those building Twitter
- The simplest way to think about this package is as a standard set of styling promoting easy responsive web site design.
- To give just a few examples, it defines a standard way to represent buttons, form components, lists, navigation, and breadcrumbs.
- Currently, MX uses very little of its functionality. Amongst, what is not implemented are colouring text according to what it represents (primary, secondary, information, warning etc.), and providing for screen readers and other accessibility aids.
- dataTables
- When MX sends out multiple lines of a log file to view or edit, the application programming interface (api) that transfers the information from the MX engine sends it in dataTables format for display on the web page in the admin interface.
- Thus dataTables does all the work of splitting a log file with lots of lines into pages of just 10 lines, and providing the ability to move between these pages.
- The free version of dataTables lacks the most useful functionality that needs a subscription licence.
- altEditor
- This is an editing tool that can read what is in dataTables, create what it calls a modal (a pop-up dialog) where rows can be added, edited or deleted individually.
- The result of whatever is done on the modal is sent back via another api to the server (the MX engine in our case) and that then regenerates the dataTables in the state after whatever action was done.
- datepicker
- Although modern browsers generally will generate a calendar type interface when they meet an entry filed defined as a date, this date picker software ensures all MX users see exactly the same interface for date selection. It is used for picking which standard (monthly) log or extra (monthly) log is to be viewed by selecting a month and year only.
- It is also used for selecting individual days in the weather diary editor.
- editable grid
- As the name perhaps suggests MX only uses this for the extra web files screens where you can make selections within a grid like interface.
- I suspect it could enhance some other functionality in the future.
- handlebars
- Put simply this is a simple HTML generator based on templates.
- I have not found any file in the admin interface actually using this, but I am scared to delete it just in case it stops something working.
- jQuery
- The admin interface uses version 1.9.1 of this javaSript based library. At the time of typing this, the current jQuery is version 3.5.1.
- Of all the old versions of jQuery, only one version, 1.9.1, has a serious error in its code, because it tries to load another script that does not match, and therefore the authors of jQuery strongly advise all 1.9.1 users to move to a later version.
- Unfortunately, there are interdependencies between all the library code used by MX, so you cannot simply update this component.
- SteelSeries
- MX uses a hacked version of the steel series library described elsewhere for all the gauges (see dashboard and gauges tabs) in MX.
- x-editable
- Put simply, this allows in-place editing of web pages using bootstrap.
- In MX it is used for the record editing screens where you adjust the extreme values.
The odd one out is Highstocks (that includes HighCharts)
- This is loaded from a Contents Distribution Node (CDN), but it is still pinned to obsolete versions of the basic script and its themes.
- This means that the Charts page in the admin interface will only work when there is an internet connection working to permit download of this software
- If you need to view your admin interface where an internet connection is not available:
Then you need to edit the interface file...
<CMX_Folder>/Interface/charts.html Change lines 20,21 from
<script src="https://code.highcharts.com/stock/8.0/h ... "></script> <script src="https://code.highcharts.com/themes/grid.js"></script>
to
<script src="webfiles/lib/highstock/js/highstock.js"></script> <script src="webfiles/lib/highstock/js/themes/grid.js"></script>
Library software for your web server
The webfiles/lib folder includes a number of software library items that are needed for the standard web pages included in the MX distribution.
- Highstock
- At the moment, as hinted in previous section, there is an old version of Highstocks included in the webfiles/lib folder.
- However, that is not used, instead (like admin interface) an old version is loaded from a CDN.
- Be careful if you also load the current version for use on web pages not produced by MX, that the browser does not try to reuse your latest version and not recognise that MX wants an older version.
- jQuery
- In this library folder there are two files:
- jquery.tmpl.js
- This script replaces spaces by tabs for better indentation. It dates from June 2014.
- This script uses a feature CommonJS that is no longer supported by jQuery, so again if somewhere else on your website you use a more modern jQuery you may have problems.
- jquery-latest.min.js
- The web template trendsT.htm uses version 1.9.1 of jQuery loaded from this badly named file, there is nothing latest about it.
- Ironically, the old version of jQuery that has been selected to be included in the webfiles/lib folder is the only old version that jQuery themselves warn you not to use because there is an error in it. However, the way MX uses jQuery does not hit the error in normal use, but you might see an error message about undefined variables if something else goes wrong.
- Again, you can cannot use the latest version from a suitable CDN, such as the jQuery site itself, because of the jquery.tmpl.js restriction.
- SteelSeries
- MX uses a hacked version of the steel series library described elsewhere for all the gauges (see dashboard and gauges tabs) in MX.
- By default, the gaugesT.htm web template uses the Google CDN and the even older version 1.8.2 of jQuery.
- You will find at the end of this web template, if you bother to read it, some instructions that are neither grammatically correct, nor understandable for me.
The provided web pages
Setting up a web site is covered in this wiki page and the pages linked from there. I won't repeat that, but will try to explain below the MX context of the various files involved. MX will produce web pages locally even if you don't have a remote web site to display them on. You can view the web pages created in the web folder using a browser.
Cumulus MX provides a set of web templates, images, and json files, in \CumulusMX\web. The first of these are called templates (and have a 'T' at the end of the file name before the extension) because they include both text and web tags. MX will process these templates as it creates a web page (file name without a "T" in same web folder), during that processing, any text in the template is copied into new file without change, any web tags found in the template are parsed and the correct value is placed in that position in the output file. If you have a web server, then MX can process these files and upload them for you (by default using File Transfer Process) providing you specify the host, port, protocol, directory, username, and password, for the upload process to use. If you don't understand any of these terms, then this is not the place for explaining them, but generally if your web space is supplied by a provider, they will be able to tell you most of these settings, and you will choose the directory name. If you have set up a web server yourself, then you should know the required settings.
The web templates included are based on designs by Beth Loft used for Cumulus 1. Remember, Steve Loft (who wrote the original Cumulus software) said "They exist because they're our web pages, and they're really only included with Cumulus as examples of how the web tags work. It never occurred to me that most people would simply use the supplied examples instead of creating their own pages!"
The templates are written in fairly simple Hyper-Text Mark-up Language, designed to help people see how to write their own web templates. Here is a list of web templates provided:
- indexT .htm
- todayT.htm
- yesterdayT.htm
- thismonth.htm
- thisyear.htm
- recordT.htm
- monthlyrecordt.htm
- gaugesT.htm
- trendsT.htm
All these templates (except gaugesT.htm and trendsT.htm) include a table for showing values and styling that gives a graded background colour. The tables include a navigation row with links to the other pages in the set. That navigation line fixes the width of the table, and you will realise it was designed in the days when all monitors were a standard shape. Therefore the standard web pages as provided cannot adapt to the range of devices we use for viewing web pages nowadays. There are a selection of alternative web page sets available on the User_Contributions page, and some of these are responsive and adapt to the width of the device they are being viewed on.
The gaugesT.htm is a template similar to SteelSeries Gauges although the latter is designed to work with a range of software and the former is specific to MX. As supplied in MX if you mouse over the provided gauges appearing on your web site you will see a box with figures, not a graph as is seen with the general steel series gauges, but there are some other differences such as how the figures are supplied for the displays. The remaining template trendsT.htm, creates a structure that can display graphs. The data for all the graphs that can be displayed is contained in the various json files in \CumulusMX\web, these files are also processed by Cumulus so latest values are added, and then uploaded so the web page produced by this template can use them.
The image that is provided in \CumulusMX\web is MoonBaseImage.png, MX can be set to use that to generate (on MX start-up and on the hour) "moon.png" which it then can FTP to your web (also on the hour).
To set up your web server for the first time
When you first want to use Cumulus web pages on your web server, you need a number of static (unchanging) files to be put onto your web server. The web pages that MX uploads for you reference that static files and will not look right without them. The files that only have to be uploaded once are found in \CumulusMX\webfiles and its sub-folders. You don't create a folder called webfiles on your web server, but you put the files and sub-folders into position relative to where MX will upload the htm files.
To do this, you will must invoke a FTP process outside of Cumulus, MX does not include any functionality to do this one-off upload for you. The filezilla client is a popular choice as it has probably the most friendly graphical user interface, although other software to do this is also available. You may prefer a tool that lets you do the uploads from a command line without requiring working with a graphical interface.
- The static files to be uploaded include the standard styling file \CumulusMX\webfiles\weatherstyle.css which you place in the directory specified for the uploads.
- Next you have three sub-folders, each of those sub-folders need to be replicated within the directory specified for the uploads.
- For example \CumulusMX\webfiles\images\picture.jpg will be stored in a "images" sub-directory of the upload directory and is used as the background image for web pages.
- There is nothing to stop you creating your own "picture.jpg" (instead of uploading the supplied one) and then Cumulus web pages will use that for the background image on each page.
- Similarly \CumulusMX\webfiles\js\cumuluscharts.js needs to be stored in a "js" sub-directory of your upload directory (this is the script that allows you to change the chart shown on the trends page and uses the appropriate json file to populate it with data).
- For example \CumulusMX\webfiles\images\picture.jpg will be stored in a "images" sub-directory of the upload directory and is used as the background image for web pages.
- The "lib" sub-folder contains further levels of sub-folders all to be replicated on your web site.
- The trends.htm web page also loads some library software from an internet Content Delivery Network (cdn) to invoke the JavaScript based Highstocks library.
Operating a web site with uploads from MX engine
The standard web pages
- If you want to operate the 'standard' web site, then just the same as with Cumulus 1, you will need to upload the contents of the webfiles folder from the zip file (don't upload the containing webfiles folder itself).
- Note that the MX web files are not the same as the ones for Cumulus 1, so make sure you upload the MX files if moving from Cumulus 1 to MX.
- The standard gauges are now the SteelSeries gauges. The default versions do not display a graph when you hover over a gauge as happened when you added the stand-alone Steel Series gauges to Cumulus 1.
- The trends web page in Cumulus 1 relied on that software generating graphs as images. In MX, the software generates files with time and value pairs, these are stored in json format, the trends page then uses a library package (Highstocks) to draw graphs from those data pairs.
Alternative ways to obtain web pages
You can choose to use some of the alternative web pages available from third parties and described on User Contributions page.
Using your own web pages
- Of course you can use your own web pages, instead of the standard ones. Assuming they need to include figures that are available as web tags, there are three alternative ways to implement this:
- MX can process template files with a HTML structure and those web tags in the structure where values are required just as it does with the standard templates, and MX can upload the resulting web pages at either the real-time interval, the standard interval, or after end of day. All of this is covered on the Customised templates page in this Wiki.
- MX can process a file with a string of web tags mirroring the realtime.txt option in MX, and upload the resulting file so your web pages can use JavaScript for a one-off insert of the values or an Ajax routine to update the web page at a fixed interval.
- Alternatively, you can use template scripts processed locally by MX that don't create web pages, but are uploaded by MX at either the real-time interval, the standard interval, or after end of day. These scripts simply initialise script variables with values obtained from web tags. You then independently have a set of web pages resident only on your web server (they don't exist where you run MX) using a combination of HTML and script content that bring in the script(s) with the variables by the appropriate syntax. All of this is covered on the PHP web tags page in this wiki. As it suggests there, you might therefore have several files processed by Cumulus MX at these different intervals, converting the web tags into script variables, and then use AJAX (JavaScript that may use json format to bring in the variables) or PHP (using 'require_once 'filename'; syntax) to put those variables into a web page.
You may find this wiki page useful for understanding more about the different script languages.
Administrative Interface
This requires a whole topic to itself, and indeed it has an article at MX Administrative Interface.
MX End of Day Process
I have added this section, because this process has given me some headaches. If you write custom SQL, or have a template being processed at end of day, then what I find strange is that web tags related to system date report the new date, but other web tags report weather derivatives from the old day. Put another way, the date changes at start of rollover, but the weather web tags change at end of rollover. However, it is not quite as simple as that, the month and year are reset after any Custom SQL is run (so that SQL can use monthly and yearly web tags related to previous day), but before the extra files are processed (so they cannot use monthly web tags at end of month, nor yearly web tags at end of year). See why I found it hard to digest, and why I wanted to write it here to make it easier for others.
Mark Crossley says the MX day reset does this...
Reset midnight rain Entering Day Reset (message about current day of month, at this stage web tag <#metdate> changes to new date) Day Reset (message about date ending, time shown as 00:00:00 because time not defined, not because it is midnight, it might be 9am or 10am) Run EOD custom SQL Save dayfile entry (uses what is still in today.ini that includes old date, i.e. what is now in web tag <#metdateyesterday>) Write monthly & yearly file entries Write any new daily extreme records if day of month = 1 then: copy month.ini to saved file, reset monthly figures if day of month = 1 and month = 1 then: copy year.ini to saved file, reset yearly figures Copy todays high/lows to yesterdays Reset todays high/lows to current Write today.ini & yesterday.ini Create NOAA reports Execute user daily external program Process Extra EOD files
But independent of above EOD thread that occurs on the rollover hour, the normal interval and hourly processes thread is seeking to run at same time, whether that happens at same time depends on processing capability and whether it can process multiple threads.
What actually happens in above list depends on your settings, and if your FTP interval is synchronised with the logging interval.
SPECIAL CONSIDERATIONS - Text by Steve Loft
Restrictions in MX for decimal separators
On the subject of decimal and list separators, there are a couple of issues which users of decimal commas may encounter.
- The first is that there may be an issue with some of the user interface not working correctly. Please report these issues and I will fix them. There may be aspects of the displays that I cannot change (because the package used does not support decimal commas) but it should be possible to at least get it working.
- The second issue with decimal separators only affects the Raspberry Pi (as far as I am aware). There is apparently an issue with a version (3.2.8) of the Mono package on Raspbian 'hard float' where it cannot parse values using decimal commas. If this does turn out to be an issue, there are a number of possible workarounds until the Raspbian package gets updated. One workaround is to use the 'soft float' version of Debian instead. Obviously, this will have performance issues, but is probably the easiest. The second workaround is to build Mono from the latest sources, see http://www.mono-project.com/docs/compiling-mono/linux/. I am told that this fixes the problem. Another possible workaround would be to find an already fixed binary package, but I don't know if one currently exists.
PLEASE NOTE: The issues that Steve describes seem to have gone away with currently available versions of Mono; update your Mono if you are using an old version and encounter problems. Like any software, Mono might have bugs at a particular version, and sometimes you might need to swap to an older version if the current version has an outstanding issue.
If you want to use your Cumulus 1 data with MX
If you use decimal commas in your Cumulus 1 data, you will need to edit the .ini files to change the decimal commas into periods/full stops, because Cumulus MX always expects periods/full stops in .ini files regardless of the locale in use. The other data files will be OK - assuming you are using the same decimal and list separators in MX as you used in Cumulus 1 (i.e. the same locale). If you try to switch to a different locale, then your data log files will of course no longer be in the correct format, so you would need to edit all of your files. You can select the locale for MX to use as a switch parameter when it starts up, see earlier on this page.
A note to Davis owners
I am experimenting with the use of the LOOP2 packet. The current code uses this for two purposes. First, it uses the 'peak 10-minute gust' value, to avoid the problem where a gust might be missed (although hopefully this will not be such an issue with Cumulus MX as it does not use the Davis DLL), and secondly it uses the 'absolute pressure' value to make calculation of 'altimeter pressure' easier and more accurate. This is mainly used if you upload to CWOP.
The LOOP2 packet is supported on the VP2 with firmware version 1.90 or later, and on the Vue. If you have a Vantage Pro (i.e. the original 'VP1'), or a VP2 with pre-1.90 firmware, or if you are using Virtual VP, none of these support the LOOP2 packet. In these cases, you should edit cumulus.ini and add a line to the [Station] section:
UseDavisLoop2=0
With this setting, Cumulus will revert to calculating the 10-minute gust value itself from the individual wind speed readings, but it will not currently attempt to calculate altimeter pressure correctly, it will simply use the sea-level pressure instead. This is likely to be an issue if you are at high altitude and you upload to CWOP using Cumulus MX.
Also for Davis stations, I have assumed that people using millimetres in Cumulus have a metric rain gauge (0.2 mm per tip), and those using inches have a 0.01" rain gauge. This can be over-ridden by adding a line to the [Station] section of Cumulus.ini:
VPrainGaugeType=0
or
VPrainGaugeType=1
Where 0 is a 0.2mm gauge and 1 is a 0.01" gauge. Note that changing this after MX has already read some data may cause your rainfall reading for today etc to change considerably, so you will need to correct that.
Almost all of the web tags for all Cumulus flavours on this Wiki page that you could use in Cumulus 1 are also supported in Cumulus MX.
Each new build of the beta MX has increased the range of web tags it supports. Since MX has come out of beta, new versions have not only implemented the remaining tags from Cumulus 1, they have also added new tags not previously available. For full details see the web tags article, but a quick précis follows in next few sections.
All builds of MX
The 'format' parameter on the date/time output modifier for web tags is unfortunately different, because many of the characters used are different. See the modifiers list page of this Wiki.
Note that this difference in date/time modifiers also affects how you specify the NOAA report file names. For example in Cumulus 1 you can specify a 2 digit month number by either 'mm' or 'MM', but MX (later versions) has to change the former to the latter as MX uses 'mm' for minutes. The same applies to using 'mmm' or 'MMM' for 3 letter month abbreviation in Cumulus 1, only the latter works in MX, so MX (later versions) will adjust that. If you are using an older MX version, you should upgrade to latest as you are missing a lot of functionality, but while you use that old version, ensure that your file names for NOAA reports do use the correct modifiers for MX.
Beta builds of MX
The following web tags were not available or worked differently:
- The individual 'record set' tags such as <#TempRecordSet> etc did not work (because the interface then had no indicators for new records and no way to reset them).
- The <#newrecord> tag does work, but works differently, it turns itself off automatically after 24 hours.
- Some of the 'system status' web tags do not work: <#CpuName>, <#MemoryStatus>, <#DisplayMode>, <#DiskSize> and <#DiskFree>
- The <#txbattery> web tag has no content currently. Using it with a 'channel' parameter causes a 'token error'.
- The snow tags were not available as there was no Weather Diary
Current builds of MX
The web tags you have depend on which build you are using:
From beta version 3.0.0 - Build 3046 of 2 Jan 2019
- added <#snowdepth> tag processing
- added diary.db file
From beta version 3.0.0 - build 3047
- Web token parser updated to cope with html tag characters "<>" in the format string e.g. <#TapptempH format="dd' 'MMM' 'yyyy' at 'HH:mm''">
- All record Value tags should now return '---' and Date tags '----' until they are first set.
- <#MoonAge>, <#MoonPercent>, <#MoonPercentAbs> - all given new 'dp' and 'rc' parameters.
From version 3.1.1 - build 3054
- Adds new web tags <#snowlying>, <#snowfalling>, both provide 1|0 responses
From version 3.2.0 - build 3056 of 19 November 2019:
- Enables alarms as per Cumulus 1
- New Alarm page under Settings
- Alarms are shown visually on the dashboard
- Due to browser restrictions, alarm sounds on the browser page may require you to click a button on the first alarm in order to hear it.
- You can add the MX admin site to your browsers list of sites allowed to play sound automatically. Your browser should "learn" that you want to allow sounds to play automatically.
- Alarm sound files should be placed in the /interface/sounds folder, they must be a browser compatible format (mp3 are good). The alarm settings for the sound file should be just the filename without any path
- Lots of new web tags not available in Cumulus 1, see release announcement for details
From Version 3.2.2 - build 3058
- Implements the missing <#txbattery> web tag
From version 3.5.1 - build 3072 of 10 April 2020
- Implements the tags that indicate when records are broken
- You configure whether if a record is set it turns off after 24 hours or a different period.
Cumulus MX FAQ
A new FAQ for MX has been started at another page.
Many MX specific questions, such as those related to installation are now covered by the updated text on this "Cumulus MX" page.
Cumulus MX Known Issues
Subcategories
This category has the following 5 subcategories, out of 5 total.
Pages in category "Cumulus MX"
The following 72 pages are in this category, out of 72 total.
A
C
- Calculate Missing Values
- Compare C1 and MX
- Correcting Extremes
- Cs Code Modules
- Cumulus 3 (MX) beta documentation
- Cumulus MX FAQ
- Cumulus MX formal release versions
- Cumulus MX Local API
- Cumulus template file
- Cumulus.ini
- Cumulus.ini (MX 3.0.0 to 3.7.0)
- Cumulusmx.db
- Cumulusmx.db (preserving history)
- Customised templates