SmaAt-UNet

Code for the Paper "SmaAt-UNet: Precipitation Nowcasting using a Small Attention-UNet Architecture" Arxiv-link, Elsevier-link

The proposed SmaAt-UNet can be found in the model-folder under SmaAt_UNet.

>>>IMPORTANT<<<

The original Code from the paper can be found in this branch: https://github.com/HansBambel/SmaAt-UNet/tree/snapshot-paper

The current master branch has since upgraded packages and was refactored. Since the exact package-versions differ the experiments may not be 100% reproducible.

If you have problems running the code, feel free to open an issue here on Github.

Installing dependencies

This project is using rye as dependency management. Therefore, installing the required dependencies is as easy as this:

rye sync --no-lock

In any case a requirements.txt is also added by converting the lock-file from rye:

sed '/^-e/d' requirements.lock > requirements.txt
sed '/^-e/d' requirements-dev.lock > requirements-dev.txt

Basically, only the following requirements are needed:

tqdm
torch
lightning
tensorboard
torchsummary
h5py
numpy

---

For the paper we used the Lightning -module (PL) which simplifies the training process and allows easy additions of loggers and checkpoint creations. In order to use PL we created the model UNetDS_Attention whose parent inherits from the pl.LightningModule. This model is the same as the pure PyTorch SmaAt-UNet implementation with the added PL functions.

Training

An example training script is given for a classification task (PascalVOC).

For training on the precipitation task we used the train_precip_lightning.py file. The training will place a checkpoint file for every model in the default_save_path lightning/precip_regression. After finishing training place the best models (probably the ones with the lowest validation loss) that you want to compare in another folder in checkpoints/comparison.

Testing

The script calc_metrics_test_set.py will use all the models placed in checkpoints/comparison to calculate the MSEs and other metrics such as Precision, Recall, Accuracy, F1, CSI, FAR, HSS. The results will get saved in a json in the same folder as the models.

The metrics of the persistence model (for now) are only calculated using the script test_precip_lightning.py. This script will also use all models in that folder and calculate the test-losses for the models in addition to the persistence model. It will get handled by this issue.

Plots

Example code for creating similar plots as in the paper can be found in plot_examples.ipynb.

Precipitation dataset

The dataset consists of precipitation maps in 5-minute intervals from 2016-2019 resulting in about 420,000 images.

The dataset is based on radar precipitation maps from the The Royal Netherlands Meteorological Institute (KNMI). The original images were cropped as can be seen in the example below:

If you are interested in the dataset that we used please write an e-mail to: [email protected] and [email protected]

The 50% dataset has 4GB in size and the 20% dataset has 16.5GB in size. Use the create_dataset.py to create the two datasets used from the original dataset.

The dataset is already normalized using a Min-Max normalization. In order to revert this you need to multiply the images by 47.83; this results in the images showing the mm/5min.

Citation

@article{TREBING2021,
title = {SmaAt-UNet: Precipitation Nowcasting using a Small Attention-UNet Architecture},
journal = {Pattern Recognition Letters},
year = {2021},
issn = {0167-8655},
doi = {https://doi.org/10.1016/j.patrec.2021.01.036},
url = {https://www.sciencedirect.com/science/article/pii/S0167865521000556},
author = {Kevin Trebing and Tomasz Staǹczyk and Siamak Mehrkanoon},
keywords = {Domain adaptation, neural networks, kernel methods, coupling regularization},
abstract = {Weather forecasting is dominated by numerical weather prediction that tries to model accurately the physical properties of the atmosphere. A downside of numerical weather prediction is that it is lacking the ability for short-term forecasts using the latest available information. By using a data-driven neural network approach we show that it is possible to produce an accurate precipitation nowcast. To this end, we propose SmaAt-UNet, an efficient convolutional neural networks-based on the well known UNet architecture equipped with attention modules and depthwise-separable convolutions. We evaluate our approaches on a real-life datasets using precipitation maps from the region of the Netherlands and binary images of cloud coverage of France. The experimental results show that in terms of prediction performance, the proposed model is comparable to other examined models while only using a quarter of the trainable parameters.}
}