RainNet: A Large-Scale Dataset for Spatial Precipitation Downscaling

Spatial Precipitation Downscaling is one of the most important problems in the geo-science community. However, it still remains an unaddressed issue. Deep learning is a promising potential solution for downscaling. In order to facilitate the research on precipitation downscaling for deep learning, we present the first \textbf{REAL} (non-simulated) Large-Scale Spatial Precipitation Downscaling Dataset, \textbf{RainNet}, which contains \textbf{62,424} pairs of low-resolution and high-resolution precipitation maps for 17 years. Contrary to simulated data, this real dataset covers various types of real meteorological phenomena (e.g., Hurricane, Squall, etc.), and shows the physical characters - \textbf{Temporal Misalignment}, \textbf{Temporal Sparse} and \textbf{Fluid Properties} - that challenge the downscaling algorithms. In order to fully explore potential downscaling solutions, we propose an implicit physical estimation framework to learn the above characteristics. Eight metrics specifically considering the physical property of the data set are raised, while fourteen models are evaluated on the proposed dataset. Finally, we analyze the effectiveness and feasibility of these models on precipitation downscaling task. The Dataset and Code will be available at \url{this https URL}.

[1]  Kamal Ahmed,et al.  Statistical downscaling of precipitation using machine learning techniques , 2018, Atmospheric Research.

[2]  Kyoung Mu Lee,et al.  Enhanced Deep Residual Networks for Single Image Super-Resolution , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[3]  Chen Change Loy,et al.  EDVR: Video Restoration With Enhanced Deformable Convolutional Networks , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[4]  Yu Qiao,et al.  ESRGAN: Enhanced Super-Resolution Generative Adversarial Networks , 2018, ECCV Workshops.

[5]  Chenliang Xu,et al.  TDAN: Temporally-Deformable Alignment Network for Video Super-Resolution , 2018, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Gregory Shakhnarovich,et al.  Recurrent Back-Projection Network for Video Super-Resolution , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  D. Seo,et al.  Assessment and Implications of NCEP Stage IV Quantitative Precipitation Estimates for Product Intercomparisons , 2016 .

[8]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Seoung Wug Oh,et al.  Deep Video Super-Resolution Network Using Dynamic Upsampling Filters Without Explicit Motion Compensation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[10]  José Manuel Gutiérrez,et al.  Configuration and intercomparison of deep learning neural models for statistical downscaling , 2019, Geoscientific Model Development.

[11]  T. Wigley,et al.  Statistical downscaling of general circulation model output: A comparison of methods , 1998 .

[12]  Paul Poli,et al.  The ERA-Interim archive, version 2.0 , 2011 .

[13]  Jiajun Wu,et al.  Video Enhancement with Task-Oriented Flow , 2018, International Journal of Computer Vision.

[14]  Peter Bauer,et al.  The quiet revolution of numerical weather prediction , 2015, Nature.

[15]  P. Courtier,et al.  A strategy for operational implementation of 4D‐Var, using an incremental approach , 1994 .

[16]  Jan P. Allebach,et al.  Zooming Slow-Mo: Fast and Accurate One-Stage Space-Time Video Super-Resolution , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Paulin Coulibaly,et al.  Uncertainty analysis of statistical downscaling methods , 2006 .

[18]  Renjie Liao,et al.  Video Super-Resolution via Deep Draft-Ensemble Learning , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[19]  Mohammad Najafi,et al.  Statistical Downscaling of Precipitation Using Machine Learning with Optimal Predictor Selection , 2011 .

[20]  Alexei A. Efros,et al.  The Unreasonable Effectiveness of Deep Features as a Perceptual Metric , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[21]  Thomas Vandal,et al.  Intercomparison of machine learning methods for statistical downscaling: the case of daily and extreme precipitation , 2017, Theoretical and Applied Climatology.

[22]  R. Keys Cubic convolution interpolation for digital image processing , 1981 .

[23]  Renjie Liao,et al.  Detail-Revealing Deep Video Super-Resolution , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[24]  K. Mo,et al.  Continental-scale water and energy flux analysis and validation for the North American Land Data Assimilation System project phase 2 (NLDAS-2): 1. Intercomparison and application of model products , 2012 .

[25]  Sangram Ganguly,et al.  DeepSD: Generating High Resolution Climate Change Projections through Single Image Super-Resolution , 2017, KDD.

[26]  Alex J. Cannon,et al.  Downscaling Extremes—An Intercomparison of Multiple Statistical Methods for Present Climate , 2012 .

[27]  Joachim Denzler,et al.  Deep learning and process understanding for data-driven Earth system science , 2019, Nature.

[28]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[29]  Liang Wang,et al.  Bidirectional Recurrent Convolutional Networks for Multi-Frame Super-Resolution , 2015, NIPS.

[30]  J. Sheffield,et al.  Spatial downscaling of precipitation using adaptable random forests , 2016 .

[31]  B. L. White,et al.  Downscaling Numerical Weather Models with GANs , 2019 .

[32]  Nils Thürey,et al.  tempoGAN: A Temporally Coherent, Volumetric GAN for Super-resolution Fluid Flow , 2018, ACM Trans. Graph..

[33]  Christian Ledig,et al.  Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Gregory Shakhnarovich,et al.  Deep Back-Projection Networks for Super-Resolution , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[35]  Christian Ledig,et al.  Real-Time Video Super-Resolution with Spatio-Temporal Networks and Motion Compensation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Claire Monteleoni,et al.  ClimAlign: Unsupervised statistical downscaling of climate variables via normalizing flows , 2020, CI.

[37]  Yun Fu,et al.  Image Super-Resolution Using Very Deep Residual Channel Attention Networks , 2018, ECCV.

[38]  Julie Delon,et al.  FastDVDnet: Towards Real-Time Deep Video Denoising Without Flow Estimation , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[39]  Michelle Simões Reboita,et al.  The state of the art and fundamental aspects of regional climate modeling in South America , 2018, Annals of the New York Academy of Sciences.