Time Series Forecasting for Outdoor Temperature using Nonlinear Autoregressive Neural Network Models

Weather forecasting is a challenging time series forecasting problem because of its dynamic, continuous, data-intensive, chaotic and irregular behavior. At present, enormous time series forecasting techniques exist and are widely adapted. However, competitive research is still going on to improve the methods and techniques for accurate forecasting. This research article presents the time series forecasting of the metrological parameter, i.e., temperature with NARX (Nonlinear Autoregressive with eXogenous input) based ANN (Artificial Neural Network). In this research work, several time series dependent Recurrent NARX-ANN models are developed and trained with dynamic parameter settings to find the optimum network model according to its desired forecasting task. Network performance is analyzed on the basis of its Mean Square Error (MSE) value over training, validation and test data sets. In order to perform the forecasting for next 4,8 and 12 steps horizon, the model with less MSE is chosen to be the most accurate temperature forecaster. Unlike one step ahead prediction, multi-step ahead forecasting is more difficult and challenging problem to solve due to its underlying additional complexity. Thus, the empirical findings in this work provide valuable suggestions for the parameter settings of NARX model specifically the selection of hidden layer size and autoregressive lag terms in accordance with an appropriate multi-step ahead time series forecasting.

[1]  K. Hipel,et al.  Time series modelling of water resources and environmental systems , 1994 .

[2]  A. Lapedes,et al.  Nonlinear signal processing using neural networks: Prediction and system modelling , 1987 .

[3]  Eija Koskivaara Artificial Neural Networks in Auditing : State of the Art , 2003 .

[4]  Nian Zhang,et al.  Time series prediction with recurrent neural networks trained by a hybrid PSO-EA algorithm , 2004, Neurocomputing.

[5]  Guoqiang Peter Zhang,et al.  A neural network ensemble method with jittered training data for time series forecasting , 2007, Inf. Sci..

[6]  Kishan G. Mehrotra,et al.  Forecasting the behavior of multivariate time series using neural networks , 1992, Neural Networks.

[7]  Guoqiang Peter Zhang,et al.  Neural network forecasting for seasonal and trend time series , 2005, Eur. J. Oper. Res..

[8]  Claas de Groot,et al.  Analysis of univariate time series with connectionist nets: A case study of two classical examples , 1991, Neurocomputing.

[9]  Peter Tiño,et al.  Learning long-term dependencies in NARX recurrent neural networks , 1996, IEEE Trans. Neural Networks.

[10]  Peter Vas,et al.  Artificial-Intelligence-Based Electrical Machines and Drives: Application of Fuzzy, Neural, Fuzzy-neural, and Genetic-Algorithm-based Techniques , 1999 .

[11]  Amir F. Atiya,et al.  An Empirical Comparison of Machine Learning Models for Time Series Forecasting , 2010 .

[12]  Ralf Salomon Improved Convergence Rate of Back-Propagation with Dynamic Adaptation of the Learning Rate , 1990, PPSN.

[13]  Kin Keung Lai,et al.  A novel nonlinear ensemble forecasting model incorporating GLAR and ANN for foreign exchange rates , 2005, Comput. Oper. Res..

[14]  Guoqiang Peter Zhang,et al.  Time series forecasting using a hybrid ARIMA and neural network model , 2003, Neurocomputing.

[15]  Tugba Taskaya-Temizel,et al.  2005 Special Issue: A comparative study of autoregressive neural network hybrids , 2005 .

[16]  Yoshua Bengio,et al.  Learning long-term dependencies with gradient descent is difficult , 1994, IEEE Trans. Neural Networks.

[17]  Ajith Abraham,et al.  An ensemble of neural networks for weather forecasting , 2004, Neural Computing & Applications.

[18]  Rob J Hyndman,et al.  25 years of time series forecasting , 2006 .

[19]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[20]  Hava T. Siegelmann,et al.  Computational capabilities of recurrent NARX neural networks , 1997, IEEE Trans. Syst. Man Cybern. Part B.

[21]  Dawn M. Tilbury,et al.  Multi-Step Ahead Predictions for Critical Levels in Physiological Time Series , 2016, IEEE Transactions on Cybernetics.

[22]  Amir F. Atiya,et al.  A review and comparison of strategies for multi-step ahead time series forecasting based on the NN5 forecasting competition , 2011, Expert Syst. Appl..

[23]  S. Bertazzoni,et al.  Local meteorological forecasting by type-2 fuzzy systems time series prediction , 2005, CIMSA. 2005 IEEE International Conference on Computational Intelligence for Measurement Systems and Applications, 2005..

[24]  Arianna Mencattini,et al.  Short Term Local Meteorological Forecasting Using Type-2 Fuzzy Systems , 2005, WIRN/NAIS.