Improving Precipitation Estimation Using Convolutional Neural Network

Precipitation process is generally considered to be poorly represented in numerical weather/climate models. Statistical downscaling (SD) methods, which relate precipitation with model resolved dynamics, often provide more accurate precipitation estimates compared to model's raw precipitation products. We introduce the convolutional neural network model to foster this aspect of SD for daily precipitation prediction. Specifically, we restrict the predictors to the variables that are directly resolved by discretizing the atmospheric dynamics equations. In this sense, our model works as an alternative to the existing precipitation‐related parameterization schemes for numerical precipitation estimation. We train the model to learn precipitation‐related dynamical features from the surrounding dynamical fields by optimizing a hierarchical set of spatial convolution kernels. We test the model at 14 geogrid points across the contiguous United States. Results show that provided with enough data, precipitation estimates from the convolutional neural network model outperform the reanalysis precipitation products, as well as SD products using linear regression, nearest neighbor, random forest, or fully connected deep neural network. Evaluation for the test set suggests that the improvements can be seamlessly transferred to numerical weather modeling for improving precipitation prediction. Based on the default network, we examine the impact of the network architectures on model performance. Also, we offer simple visualization and analyzing approaches to interpret the models and their results. Our study contributes to the following two aspects: First, we offer a novel approach to enhance numerical precipitation estimation; second, the proposed model provides important implications for improving precipitation‐related parameterization schemes using a data‐driven approach.

[1]  Nils Thürey,et al.  Latent Space Physics: Towards Learning the Temporal Evolution of Fluid Flow , 2018, Comput. Graph. Forum.

[2]  Kuolin Hsu,et al.  HESS Opinions: Incubating deep-learning-powered hydrologic science advances as a community , 2018, Hydrology and Earth System Sciences.

[3]  Pierre Gentine,et al.  Could Machine Learning Break the Convection Parameterization Deadlock? , 2018, Geophysical Research Letters.

[4]  Pierre Gentine,et al.  Deep learning to represent subgrid processes in climate models , 2018, Proceedings of the National Academy of Sciences.

[5]  C. Tung,et al.  A Deep Learning Approach to Downscaling Precipitation and Temperature over Myanmar , 2018 .

[6]  Nils Thürey,et al.  tempoGAN: A Temporally Coherent, Volumetric GAN for Super-resolution Fluid Flow , 2018, ACM Trans. Graph..

[7]  Chaopeng Shen,et al.  A Transdisciplinary Review of Deep Learning Research and Its Relevance for Water Resources Scientists , 2017, Water Resources Research.

[8]  Patrick Gallinari,et al.  Deep learning for physical processes: incorporating prior scientific knowledge , 2017, ICLR.

[9]  Kuolin Hsu,et al.  The Use of Convolutional Neural Network in Relating Precipitation to Circulation , 2017 .

[10]  Andrew Stuart,et al.  Earth System Modeling 2.0: A Blueprint for Models That Learn From Observations and Targeted High‐Resolution Simulations , 2017, 1709.00037.

[11]  Dit-Yan Yeung,et al.  Deep Learning for Precipitation Nowcasting: A Benchmark and A New Model , 2017, NIPS.

[12]  Sangram Ganguly,et al.  DeepSD: Generating High Resolution Climate Change Projections through Single Image Super-Resolution , 2017, KDD.

[13]  Ken Perlin,et al.  Accelerating Eulerian Fluid Simulation With Convolutional Networks , 2016, ICML.

[14]  Gabriel Kreiman,et al.  Deep Predictive Coding Networks for Video Prediction and Unsupervised Learning , 2016, ICLR.

[15]  Richard A. Marcum,et al.  Application of deep convolutional neural networks to automatic feature/object detection in high resolution remote sensing imagery , 2017 .

[16]  J. Templeton,et al.  Reynolds averaged turbulence modelling using deep neural networks with embedded invariance , 2016, Journal of Fluid Mechanics.

[17]  E. Barnes,et al.  Storm track processes and the opposing influences of climate change , 2016 .

[18]  E. Wood,et al.  CFSv2-based sub-seasonal precipitation and temperature forecast skill over the contiguous United States , 2016 .

[19]  M. Vohland,et al.  Downscaling land surface temperatures at regional scales with random forest regression , 2016 .

[20]  Prabhat,et al.  Application of Deep Convolutional Neural Networks for Detecting Extreme Weather in Climate Datasets , 2016, ArXiv.

[21]  Shuyu Wang,et al.  Statistical downscaling and dynamical downscaling of regional climate in China: Present climate evaluations and future climate projections , 2016 .

[22]  A. Ihler,et al.  A Deep Neural Network Modeling Framework to Reduce Bias in Satellite Precipitation Products , 2016 .

[23]  Chong Wang,et al.  Deep Speech 2 : End-to-End Speech Recognition in English and Mandarin , 2015, ICML.

[24]  M. Déqué,et al.  Intercomparison of statistical and dynamical downscaling models under the EURO- and MED-CORDEX initiative framework: present climate evaluations , 2016, Climate Dynamics.

[25]  Helen F. Dacre,et al.  How Do Atmospheric Rivers Form , 2015 .

[26]  Dit-Yan Yeung,et al.  Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting , 2015, NIPS.

[27]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[28]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[29]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[31]  Gilles Louppe,et al.  Understanding Random Forests: From Theory to Practice , 2014, 1407.7502.

[32]  Jonathon Shlens,et al.  A Tutorial on Principal Component Analysis , 2014, ArXiv.

[33]  Andrew Zisserman,et al.  Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps , 2013, ICLR.

[34]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[35]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[36]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[38]  T. Ouarda,et al.  Multisite statistical downscaling model for daily precipitation combined by multivariate multiple linear regression and stochastic weather generator , 2012, Climatic Change.

[39]  J. Dudhia,et al.  A Comparison of Statistical and Dynamical Downscaling of Winter Precipitation over Complex Terrain , 2011 .

[40]  A. Gobiet,et al.  Empirical‐statistical downscaling and error correction of daily precipitation from regional climate models , 2011 .

[41]  Andrew Y. Ng,et al.  Parsing Natural Scenes and Natural Language with Recursive Neural Networks , 2011, ICML.

[42]  D. Maraun,et al.  Precipitation downscaling under climate change: Recent developments to bridge the gap between dynamical models and the end user , 2010 .

[43]  Léon Bottou,et al.  Large-Scale Machine Learning with Stochastic Gradient Descent , 2010, COMPSTAT.

[44]  Emily Becker,et al.  Understanding the Characteristics of Daily Precipitation over the United States Using the North American Regional Reanalysis , 2009 .

[45]  I. Smith,et al.  A Statistical Downscaling Model for Southern Australia Winter Rainfall , 2009 .

[46]  Pascal Vincent,et al.  Visualizing Higher-Layer Features of a Deep Network , 2009 .

[47]  Hayley J. Fowler,et al.  Linking climate change modelling to impacts studies: recent advances in downscaling techniques for hydrological modelling , 2007 .

[48]  Melissa Bukovsky,et al.  A Brief Evaluation of Precipitation from the North American Regional Reanalysis , 2007 .

[49]  Ian T. Jolliffe,et al.  Empirical orthogonal functions and related techniques in atmospheric science: A review , 2007 .

[50]  Torben Schmith,et al.  Statistical and dynamical downscaling of precipitation: An evaluation and comparison of scenarios for the European Alps , 2007 .

[51]  Jake Bouvrie,et al.  Notes on Convolutional Neural Networks , 2006 .

[52]  V. V. Srinivas,et al.  Downscaling of precipitation for climate change scenarios: A support vector machine approach , 2006 .

[53]  G. Cawley,et al.  Published online in Wiley InterScience (www.interscience.wiley.com). DOI: 10.1002/joc.1318 DOWNSCALING HEAVY PRECIPITATION OVER THE UNITED KINGDOM: A COMPARISON OF DYNAMICAL AND STATISTICAL METHODS AND THEIR FUTURE SCENARIOS , 2006 .

[54]  David D. Parrish,et al.  NORTH AMERICAN REGIONAL REANALYSIS , 2006 .

[55]  P. Hope,et al.  Projected future changes in synoptic systems influencing southwest Western Australia , 2006 .

[56]  Christopher K. Wikle,et al.  Atmospheric Modeling, Data Assimilation, and Predictability , 2005, Technometrics.

[57]  Balaji Rajagopalan,et al.  Statistical downscaling using K‐nearest neighbors , 2005 .

[58]  Frederic Vitart,et al.  Monthly Forecasting at ECMWF , 2004 .

[59]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[60]  S. Pryor,et al.  Downscaling temperature and precipitation: a comparison of regression‐based methods and artificial neural networks , 2001 .

[61]  T. Wigley,et al.  Precipitation predictors for downscaling: observed and general circulation model relationships , 2000 .

[62]  James M. Murphy,et al.  Predictions of climate change over Europe using statistical and dynamical downscaling techniques , 2000 .

[63]  James M. Murphy,et al.  An Evaluation of Statistical and Dynamical Techniques for Downscaling Local Climate , 1999 .

[64]  A. Betts,et al.  Surface Energy and Water Balance for the Arkansas-Red River Basin from the ECMWF Reanalysis , 1998 .

[65]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[66]  F. Nebeker Calculating the weather : meteorology in the 20th century , 1997 .

[67]  K. Mo,et al.  The moisture budget of the central United States in spring as evaluated in the NCEP/NCAR and the NASA/DAO reanalyses , 1996 .

[68]  David Draper,et al.  Assessment and Propagation of Model Uncertainty , 2011 .

[69]  Frederik Nebeker,et al.  Calculating the weather , 1995 .

[70]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[71]  Paul J. Werbos,et al.  Applications of advances in nonlinear sensitivity analysis , 1982 .

[72]  M. J. Bader,et al.  Orographic rainfall in warm sectors of depressions , 1977 .

[73]  J. Holton An introduction to dynamic meteorology , 2004 .

[74]  H. Glahn,et al.  The Use of Model Output Statistics (MOS) in Objective Weather Forecasting , 1972 .

[75]  O. D. Kellogg Fields of Force , 1967 .

[76]  C. Rossby Relation between variations in the intensity of the zonal circulation of the atmosphere and the displacements of the semi-permanent centers of action , 1939 .

[77]  Karl Pearson F.R.S. LIII. On lines and planes of closest fit to systems of points in space , 1901 .