Deep Shared Representation Learning for Weather Elements Forecasting

Abstract The accuracy and reliability of weather forecasting are of importance for many economic, business and management activities. This paper introduces novel data-driven predictive models based on deep convolutional neural networks (CNN) architecture for temperature and wind speed prediction in weather data. In particular, the proposed deep learning framework employs different upgrading versions of the convolutional neural networks i.e. 1d-, 2d- and 3d-CNN. The introduced models exploit the spatio-temporal multivariate weather data for learning shared representations using historical data and forecasting weather elements for a number of user defined weather stations simultaneously in an end-to-end fashion. The embedded feature learning component of the models as well as coupling the learned features of different input layers have shown to have a significant impact on the prediction task. The proposed models show promising results compared to the classical neural networks architecture used for modeling nonlinear systems. Two experimental setups have been considered based on a dataset collected from the Weather Underground website at six stations located in Netherlands and Belgium as well as a larger dataset with higher temporal resolution from the National Climatic Data Center (NCDC) at five stations located in Denmark. First, we focus on simultaneously predicting the temperature of two main stations of Amsterdam and Brussels for 1–10 days ahead. The second experiment concerns wind speed prediction at three weather stations located in Denmark for 6 and 12 h ahead. The obtained numerical results show that learning new shared representations of the weather data by means of convolutional operations improves the prediction performance.

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  Pertti Nurmi,et al.  Expected impacts and value of improvements in weather forecasting on the road transport sector , 2013 .

[3]  Mario Vasak,et al.  Deep neural networks for ultra-short-term wind forecasting , 2015, 2015 IEEE International Conference on Industrial Technology (ICIT).

[4]  José Manuel Gutiérrez,et al.  Bayesian Networks for Probabilistic Weather Prediction , 2002, ECAI.

[5]  Nitesh V. Chawla,et al.  Complex networks as a unified framework for descriptive analysis and predictive modeling in climate science , 2011, Stat. Anal. Data Min..

[6]  A. H. Murphy,et al.  Hailfinder: A Bayesian system for forecasting severe weather , 1996 .

[7]  Guriĭ Ivanovich Marchuk,et al.  Numerical Methods in Weather Prediction , 1974 .

[8]  Yoshua Bengio,et al.  Random Search for Hyper-Parameter Optimization , 2012, J. Mach. Learn. Res..

[9]  Ravi Sankar,et al.  Time Series Prediction Using Support Vector Machines: A Survey , 2009, IEEE Computational Intelligence Magazine.

[10]  Sepp Hochreiter,et al.  Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) , 2015, ICLR.

[11]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[12]  Tianqi Chen,et al.  Empirical Evaluation of Rectified Activations in Convolutional Network , 2015, ArXiv.

[13]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[14]  Lewis F. Richardson,et al.  Weather Prediction by Numerical Process , 1922 .

[15]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[16]  A. Barros,et al.  Localized Precipitation Forecasts from a Numerical Weather Prediction Model Using Artificial Neural Networks , 1998 .

[17]  Afan Galih Salman,et al.  Weather forecasting using deep learning techniques , 2015, 2015 International Conference on Advanced Computer Science and Information Systems (ICACSIS).

[18]  Vladimir M. Krasnopolsky,et al.  Complex hybrid models combining deterministic and machine learning components for numerical climate modeling and weather prediction , 2006, Neural Networks.

[19]  Dit-Yan Yeung,et al.  Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting , 2015, NIPS.

[20]  Eric Horvitz,et al.  A Deep Hybrid Model for Weather Forecasting , 2015, KDD.

[21]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[23]  Harris Drucker,et al.  Learning algorithms for classification: A comparison on handwritten digit recognition , 1995 .

[24]  Johan A. K. Suykens,et al.  Deep hybrid neural-kernel networks using random Fourier features , 2018, Neurocomputing.

[25]  H. A. David,et al.  The Paired t Test Under Artificial Pairing , 1997 .

[26]  A. Kusiak,et al.  Short-Term Prediction of Wind Farm Power: A Data Mining Approach , 2009, IEEE Transactions on Energy Conversion.

[27]  Ashfaqur Rahman,et al.  Autoencoder for wind power prediction , 2017 .

[28]  L.L. Lai,et al.  Intelligent weather forecast , 2004, Proceedings of 2004 International Conference on Machine Learning and Cybernetics (IEEE Cat. No.04EX826).

[29]  Xu Lai,et al.  Comparison between ARIMA and ANN Models Used in Short-Term Wind Speed Forecasting , 2011, 2011 Asia-Pacific Power and Energy Engineering Conference.

[30]  Y. Radhika,et al.  Atmospheric Temperature Prediction using Support Vector Machines , 2009 .