Temporal convolutional neural (TCN) network for an effective weather forecasting using time-series data from the local weather station

Non-predictive or inaccurate weather forecasting can severely impact the community of users such as farmers. Numerical weather prediction models run in major weather forecasting centers with several supercomputers to solve simultaneous complex nonlinear mathematical equations. Such models provide the medium-range weather forecasts, i.e., every 6 h up to 18 h with grid length of 10–20 km. However, farmers often depend on more detailed short-to medium-range forecasts with higher-resolution regional forecasting models. Therefore, this research aims to address this by developing and evaluating a lightweight and novel weather forecasting system, which consists of one or more local weather stations and state-of-the-art machine learning techniques for weather forecasting using time-series data from these weather stations. To this end, the system explores the state-of-the-art temporal convolutional network (TCN) and long short-term memory (LSTM) networks. Our experimental results show that the proposed model using TCN produces better forecasting compared to the LSTM and other classic machine learning approaches. The proposed model can be used as an efficient localized weather forecasting tool for the community of users, and it could be run on a stand-alone personal computer.

[1]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[2]  Aakanksha Sharaff,et al.  Comparative Analysis of Temperature Prediction Using Regression Methods and Back Propagation Neural Network , 2018, 2018 2nd International Conference on Trends in Electronics and Informatics (ICOEI).

[3]  Jordan G. Powers,et al.  The Weather Research and Forecasting Model: Overview, System Efforts, and Future Directions , 2017 .

[4]  Ying-Hwa Kuo,et al.  Regional Real-Time Numerical Weather Prediction: Current Status and Future Potential , 1998 .

[5]  R. Buizza,et al.  Neural Network Load Forecasting with Weather Ensemble Predictions , 2002, IEEE Power Engineering Review.

[6]  Leopold Haimberger,et al.  Toward Elimination of the Warm Bias in Historic Radiosonde Temperature Records—Some New Results from a Comprehensive Intercomparison of Upper-Air Data , 2008 .

[7]  K. S,et al.  A comparative analysis on linear regression and support vector regression , 2016, 2016 Online International Conference on Green Engineering and Technologies (IC-GET).

[8]  Fei-Yue Wang,et al.  Travel time prediction with LSTM neural network , 2016, 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).

[9]  Wojciech Zaremba,et al.  An Empirical Exploration of Recurrent Network Architectures , 2015, ICML.

[10]  Boris Khattatov,et al.  Data Assimilation and Information , 2010 .

[11]  Nemesio J. Rodríguez-Fernández,et al.  SMOS Neural Network Soil Moisture Data Assimilation , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[12]  Jean-Louis Roujean,et al.  ECOCLIMAP-II: a climatologic global data base of ecosystems and land surface parameters at 1 km based on the analysis of time series of VEGETATION data , 2007, 2007 IEEE International Geoscience and Remote Sensing Symposium.

[13]  Azadeh Mohebi,et al.  Hybrid model for weather forecasting using ensemble of neural networks and mutual information , 2014, 2014 IEEE Geoscience and Remote Sensing Symposium.

[14]  Alex Graves,et al.  Supervised Sequence Labelling with Recurrent Neural Networks , 2012, Studies in Computational Intelligence.

[15]  U. C. Mohanty,et al.  Impact of Satellite Radiance Data on Simulations of Bay of Bengal Tropical Cyclones Using the WRF-3DVAR Modeling System , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[16]  SchmidhuberJürgen Deep learning in neural networks , 2015 .

[17]  Vladlen Koltun,et al.  An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling , 2018, ArXiv.

[18]  S. Marshall,et al.  Standard regression-based methods for measuring recovery after sport-related concussion , 2005, Journal of the International Neuropsychological Society.

[19]  M. Sachidananda,et al.  Rain Rate Estimates from Differential Polarization Measurements , 1987 .

[20]  Gregory D. Hager,et al.  Temporal Convolutional Networks for Action Segmentation and Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Tae Soo Kim,et al.  Interpretable 3 D Human Action Analysis with Temporal Convolutional Networks , 2018 .

[22]  Russell H. Lambert,et al.  Elementary cost functions for blind separation of non-stationary source signals , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[23]  S. Santhosh Baboo,et al.  An Efficient Weather Forecasting System using Artificial Neural Network , 2010 .

[24]  Soteris A. Kalogirou,et al.  Machine learning methods for solar radiation forecasting: A review , 2017 .

[25]  Peter C. Y. Chen,et al.  LSTM network: a deep learning approach for short-term traffic forecast , 2017 .

[26]  Shili Yang,et al.  Assessing Parameter Importance of the Weather Research and Forecasting Model Based On Global Sensitivity Analysis Methods , 2018 .

[27]  Peter Lynch,et al.  The Emergence of Numerical Weather Prediction: Richardson's Dream , 2006 .

[28]  Kan Li,et al.  A rough set based fuzzy neural network algorithm for weather prediction , 2005, 2005 International Conference on Machine Learning and Cybernetics.

[29]  Yaxing Wei,et al.  Daymet: Daily Surface Weather Data on a 1-km Grid for North America, Version 2 , 2014 .

[30]  Danilo P. Mandic,et al.  On the choice of parameters of the cost function in nested modular RNN's , 2000, IEEE Trans. Neural Networks Learn. Syst..

[31]  D. Basak,et al.  Support Vector Regression , 2008 .

[32]  Alex Graves,et al.  Supervised Sequence Labelling , 2012 .

[33]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[34]  Dit-Yan Yeung,et al.  Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting , 2015, NIPS.

[35]  Adrian E. Raftery,et al.  Weather Forecasting with Ensemble Methods , 2005, Science.

[36]  Anastasios A. Tsonis,et al.  Nonlinear Prediction, Chaos, and Noise. , 1992 .

[37]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[38]  V. K. Mittal,et al.  Correlation among environmental parameters using an online Smart Weather Station System , 2015, 2015 Annual IEEE India Conference (INDICON).

[39]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[40]  Sushil J. Louis,et al.  Forecasting the weather of Nevada: A deep learning approach , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[41]  Austin Reiter,et al.  Interpretable 3D Human Action Analysis with Temporal Convolutional Networks , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[42]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[43]  Sancho Salcedo-Sanz,et al.  Local models-based regression trees for very short-term wind speed prediction , 2015 .

[44]  Stanley G. Benjamin,et al.  Predictions of 2010’s Tropical Cyclones Using the GFS and Ensemble-Based Data Assimilation Methods , 2011 .

[45]  Ardhendu Behera,et al.  Context-driven Multi-stream LSTM (M-LSTM) for Recognizing Fine-Grained Activity of Drivers , 2018, GCPR.

[46]  H. Glahn,et al.  The Use of Model Output Statistics (MOS) in Objective Weather Forecasting , 1972 .

[47]  M. Deo,et al.  Basin-Scale Prediction of Sea Surface Temperature with Artificial Neural Networks , 2018, 2018 OCEANS - MTS/IEEE Kobe Techno-Oceans (OTO).

[48]  Mohsen Hayati,et al.  Application of Artificial Neural Networks for Temperature Forecasting , 2007 .

[49]  Yong Yu,et al.  Intelligent time series fast forecasting for fashion sales: A research agenda , 2011, 2011 International Conference on Machine Learning and Cybernetics.

[50]  Taiji Suzuki,et al.  Short-term local weather forecast using dense weather station by deep neural network , 2018, 2018 IEEE International Conference on Big Data (Big Data).

[51]  William H. Klein,et al.  forecasting local weather by means of model output statistics , 1974 .

[52]  Dheeraj Kumar Singh,et al.  Weather Forecasting Using Artificial Neural Network , 2018, 2018 Second International Conference on Inventive Communication and Computational Technologies (ICICCT).

[53]  B. Khattatov,et al.  Data assimilation : making sense of observations , 2010 .

[54]  Avinash Kumar,et al.  A Feature Based Neural Network Model for Weather Forecasting , 2007 .

[55]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[56]  D. Hardin,et al.  Support Vector Regression (SVR) , 2011 .

[57]  G. Powers,et al.  A Description of the Advanced Research WRF Version 3 , 2008 .

[58]  David B. Stephenson,et al.  Calibration Strategies: A Source of Additional Uncertainty in Climate Change Projections , 2012 .

[59]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.