A Short-Term Rainfall Prediction Model Using Multi-task Convolutional Neural Networks

Precipitation prediction, such as short-term rainfall prediction, is a very important problem in the field of meteorological service. In practice, most of recent studies focus on leveraging radar data or satellite images to make predictions. However, there is another scenario where a set of weather features are collected by various sensors at multiple observation sites. The observations of a site are sometimes incomplete but provide important clues for weather prediction at nearby sites, which are not fully exploited in existing work yet. To solve this problem, we propose a multi-task convolutional neural network model to automatically extract features from the time series measured at observation sites and leverage the correlation between the multiple sites for weather prediction via multi-tasking. To the best of our knowledge, this is the first attempt to use multi-task learning and deep learning techniques to predict short-term rainfall amount based on multi-site features. Specifically, we formulate the learning task as an end-to-end multi-site neural network model which allows to leverage the learned knowledge from one site to other correlated sites, and model the correlations between different sites. Extensive experiments show that the learned site correlations are insightful and the proposed model significantly outperforms a broad set of baseline models including the European Centre for Medium-range Weather Forecasts system (ECMWF).

[1]  Lior Wolf,et al.  A Dynamic Convolutional Layer for short rangeweather prediction , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Xiaoli Li,et al.  Deep Convolutional Neural Network Based Regression Approach for Estimation of Remaining Useful Life , 2016, DASFAA.

[3]  José Manuel Gutiérrez,et al.  Bayesian Networks for Probabilistic Weather Prediction , 2002, ECAI.

[4]  Bjarke Tobias Olsen,et al.  On the performance of the new NWP nowcasting system at the Danish Meteorological Institute during a heavy rain period , 2015, Meteorology and Atmospheric Physics.

[5]  Silvio Savarese,et al.  Structured Recurrent Temporal Restricted Boltzmann Machines , 2014, ICML.

[6]  Yann LeCun,et al.  Convolutional networks and applications in vision , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[7]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[8]  A. Barros,et al.  Localized Precipitation Forecasts from a Numerical Weather Prediction Model Using Artificial Neural Networks , 1998 .

[9]  Jieping Ye,et al.  Multi-Task Feature Learning Via Efficient l2, 1-Norm Minimization , 2009, UAI.

[10]  Tom Heskes,et al.  Task Clustering and Gating for Bayesian Multitask Learning , 2003, J. Mach. Learn. Res..

[11]  C. Collier Flash flood forecasting: What are the limits of predictability? , 2007 .

[12]  Klaus-Robert Müller,et al.  Efficient BackProp , 2012, Neural Networks: Tricks of the Trade.

[13]  Massimiliano Pontil,et al.  Multi-Task Feature Learning , 2006, NIPS.

[14]  Olivier Caumont,et al.  An Observation Operator for Radar Refractivity Change: Comparison of Observations and Convective-Scale Simulations , 2013, Boundary-Layer Meteorology.

[15]  Anastasia Kakou Point process based models for rainfall , 1997 .

[16]  Pj Northrop,et al.  Spatial-temporal rainfall fields: modelling and statistical aspects , 2000 .

[17]  P. Cheung,et al.  Reprint 1025 Application of optical-flow technique to significant convection nowcast for terminal areas in Hong Kong , 2012 .

[18]  Dit-Yan Yeung,et al.  A Convex Formulation for Learning Task Relationships in Multi-Task Learning , 2010, UAI.

[19]  Vicente Julián,et al.  Rainfall Prediction: A Deep Learning Approach , 2016, HAIS.

[20]  Pak Wai Chan,et al.  Deep neural network based feature representation for weather forecasting , 2014 .

[21]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[22]  L. Besson,et al.  Links Between Weather Phenomena and Characteristics of Refractivity Measured by Precipitation Radar , 2012, Boundary-Layer Meteorology.

[23]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[24]  Yoshua Bengio,et al.  Convolutional networks for images, speech, and time series , 1998 .

[25]  Massimiliano Pontil,et al.  Regularized multi--task learning , 2004, KDD.

[26]  Rich Caruana,et al.  Multitask Learning , 1997, Machine-mediated learning.

[27]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[28]  Ravi Sankar,et al.  Time Series Prediction Using Support Vector Machines: A Survey , 2009, IEEE Computational Intelligence Magazine.

[29]  Juanzhen Sun,et al.  Use of NWP for Nowcasting Convective Precipitation: Recent Progress and Challenges , 2014 .

[30]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[31]  David R. Cox,et al.  A simple spatial-temporal model of rainfall , 1988, Proceedings of the Royal Society of London. A. Mathematical and Physical Sciences.

[32]  Dit-Yan Yeung,et al.  Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting , 2015, NIPS.

[33]  Eric Horvitz,et al.  A Deep Hybrid Model for Weather Forecasting , 2015, KDD.

[34]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[35]  Jack S. Bushong Quantitative Precipitation Forecast: Its Generation and Verification at the Southeast River Forecast Center , 1999 .