Neural Network Techniques for Time Series Prediction: A Review

It is important to predict a time series because many problems that are related to prediction such as health prediction problem, climate change prediction problem and weather prediction problem include a time component. To solve the time series prediction problem various techniques have been developed over many years to enhance the accuracy of forecasting. This paper presents a review of the prediction of physical time series applications using the neural network models. Neural Networks (NN) have appeared as an effective tool for forecasting of time series.  Moreover, to resolve the problems related to time series data, there is a need of network with single layer trainable weights that is Higher Order Neural Network (HONN) which can perform nonlinearity mapping of input-output. So, the developers are focusing on HONN that has been recently considered to develop the input representation spaces broadly. The HONN model has the ability of functional mapping which determined through some time series problems and it shows the more benefits as compared to conventional Artificial Neural Networks (ANN) . The goal of this research is to present the reader awareness about HONN for physical time series prediction, to highlight some benefits and challenges using HONN.

[1]  Jinhui Wang,et al.  Occurrence and potential risks of harmful algal blooms in the East China Sea. , 2009, The Science of the total environment.

[2]  Abir Jaafar Hussain,et al.  Recurrent pi-sigma networks for DPCM image coding , 2003, Neurocomputing.

[3]  Z. Huang,et al.  Use of time-series analysis to model and forecast wind speed , 1995 .

[4]  Subhash Mishra,et al.  A Survey on Applications of Multi Layer Perceptron Neural Networks in DOA Estimation for Smart Antennas , 2013 .

[5]  Wei Deng,et al.  A Hybrid Genetic Learning Algorithm for Pi-Sigma Neural Network and the Analysis of Its Convergence , 2008, 2008 Fourth International Conference on Natural Computation.

[6]  B. Santer,et al.  Human-Induced Changes in the Hydrology of the Western United States , 2008, Science.

[7]  Anifat Olawoyin.  Time series prediction using Artificial Neural Network , 2018 .

[8]  Eglė Butkevičiūtė,et al.  Short-term wind speed forecasting using ARIMA model , 2016 .

[9]  Dhiya Al-Jumeily,et al.  Regularized dynamic self-organized neural network inspired by the immune algorithm for financial time series prediction , 2016, Neurocomputing.

[10]  Kyungsook Han,et al.  Intelligent Computing Methodologies , 2014, Lecture Notes in Computer Science.

[11]  Chris Christodoulou,et al.  Artificial neural networks for earthquake prediction using time series magnitude data or Seismic Electric Signals , 2011, Expert Syst. Appl..

[12]  Wei Ming Ho,et al.  Travel Time Prediction for Urban Networks: the Comparisons of Simulation-based and Time-Series Models , 2010 .

[13]  Luigi Piroddi,et al.  Jordan recurrent neural network versus IHACRES in modelling daily streamflows , 2008 .

[14]  Rozaida Ghazali,et al.  Using Artificial Bee Colony to Improve Functional Link Neural Network Training , 2012 .

[15]  Waddah Waheeb,et al.  Ridge Polynomial Neural Network with Error Feedback for Time Series Forecasting , 2016, PloS one.

[16]  Fabrice Rossi,et al.  Multi-Layer Perceptrons and Symbolic Data , 2008, ArXiv.

[17]  Urooj Akram,et al.  An Improved Pi-Sigma Neural Network with Error Feedback for Physical Time Series Prediction , 2019, International Journal of Advanced Trends in Computer Science and Engineering.

[18]  Dhiya Al-Jumeily,et al.  The Prediction of Non-Stationary Physical Time Series Using the Application of Regularization Technique in Self-organised Multilayer Perceptrons Inspired by the Immune Algorithm , 2010, 2010 Developments in E-systems Engineering.

[19]  R. K. Agrawal,et al.  A combination of artificial neural network and random walk models for financial time series forecasting , 2013, Neural Computing and Applications.

[20]  Terry L. Jernigan,et al.  The Basics of Brain Development , 2010, Neuropsychology Review.

[21]  Rozaida Ghazali,et al.  THE EFFECT OF NETWORK PARAMETERS ON PI-SIGMA NEURAL NETWORK FOR TEMPERATURE FORECASTING , 2012 .

[22]  C. Lee Giles,et al.  Encoding Geometric Invariances in Higher-Order Neural Networks , 1987, NIPS.

[23]  Ju Shen,et al.  Virtual Mirror Rendering With Stationary RGB-D Cameras and Stored 3-D Background , 2013, IEEE Transactions on Image Processing.

[24]  Abir Jaafar Hussain,et al.  Non-stationary and stationary prediction of financial time series using dynamic ridge polynomial neural network , 2009, Neurocomputing.

[25]  Mahip M. Bartere,et al.  Review Paper on Artificial Neural Networks , 2013 .

[26]  Joydeep Ghosh,et al.  The pi-sigma network: an efficient higher-order neural network for pattern classification and function approximation , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[27]  Garrison W. Cottrell,et al.  A Dual-Stage Attention-Based Recurrent Neural Network for Time Series Prediction , 2017, IJCAI.

[28]  Rozaida Ghazali,et al.  Jordan Pi-Sigma Neural Network for Temperature Prediction , 2011, UCMA.

[29]  Yongquan Zhou,et al.  Training Feedforward Neural Networks Using Symbiotic Organisms Search Algorithm , 2016, Comput. Intell. Neurosci..

[30]  Irfan Khan,et al.  An Innovative Cognitive Architecture for Humanoid Robot , 2017 .

[31]  Nitin Malik.  Artificial Neural Networks and their Applications , 2005, ArXiv.

[32]  Joydeep Ghosh,et al.  Ridge polynomial networks , 1995, IEEE Trans. Neural Networks.

[33]  Ilya Sutskever,et al.  Learning Recurrent Neural Networks with Hessian-Free Optimization , 2011, ICML.

[34]  Reza Gharoie Ahangar,et al.  The Comparison of Methods Artificial Neural Network with Linear Regression Using Specific Variables for Prediction Stock Price in Tehran Stock Exchange , 2010, ArXiv.

[35]  Abdulrahman Alarifi,et al.  Earthquakes magnitude predication using artificial neural network in northern Red Sea area , 2009 .

[36]  Paulo J. G. Lisboa,et al.  Financial time series prediction using polynomial pipelined neural networks , 2008, Expert Syst. Appl..

[37]  Tarik A. Rashid,et al.  Multi-Context Recurrent Neural Network for Time Series Applications , 2007 .

[38]  Prem Kumar Kalra,et al.  Time series prediction with single multiplicative neuron model , 2007, Appl. Soft Comput..

[39]  Carlos Serrano-Cinca,et al.  Feedforward neural networks in the classification of financial information , 1997 .

[40]  Hissam Tawfik,et al.  Physical time series prediction using Recurrent Pi-Sigma Neural Networks , 2008, Int. J. Artif. Intell. Soft Comput..

[41]  H. S. Behera,et al.  A higher order evolutionary Jordan Pi-Sigma Neural Network with gradient descent learning for classification , 2014, 2014 International Conference on High Performance Computing and Applications (ICHPCA).

[42]  Pankaj Sharma,et al.  FEEDFORWARD NEURAL NETWORK: A Review , 2013 .

[43]  Zijun Zhang,et al.  Short-term wind speed forecasting with Markov-switching model , 2014 .

[44]  Rozaida Ghazali,et al.  A Comprehensive Survey on Pi-Sigma Neural Network for Time Series Prediction , 2017 .

[45]  Rozaida Ghazali,et al.  An approach to improve functional link neural network training using modified artificial bee colony for classification task , 2013 .

[46]  Maciej Lawrynczuk,et al.  Jordan neural network for modelling and predictive control of dynamic systems , 2015, 2015 20th International Conference on Methods and Models in Automation and Robotics (MMAR).

[47]  B. B. Misra,et al.  Functional Link Artificial Neural Network for Classification Task in Data Mining , 2007 .

[48]  Xin Yu,et al.  Monotonicity and convergence of asynchronous update gradient method for ridge polynomial neural network , 2014, Neurocomputing.

[49]  Ali Akbar Safavi,et al.  Application of neural network and ANFIS model for earthquake occurrence in Iran , 2013, Earth Science Informatics.

[50]  M. Karamouz,et al.  Hydrology and Hydroclimatology: Principles and Applications , 2012 .

[51]  Sibanda Wilbert,et al.  Novel Application of Multi-Layer Perceptrons (MLP) Neural Networks to Model HIV in South Africa using Seroprevalence Data from Antenatal Clinics , 2011 .

[52]  Yashpal Singh,et al.  NEURAL NETWORKS IN DATA MINING , 2014 .

[53]  Muhammad Faheem Mushtaq,et al.  A Cognitive Architecture for Self Learning in Humanoid Robots , 2017 .

[54]  Michael Y. Hu,et al.  A simulation study of artificial neural networks for nonlinear time-series forecasting , 2001, Comput. Oper. Res..

[55]  Hakan Tongal,et al.  Comparison of Recurrent Neural Network, Adaptive Neuro-Fuzzy Inference System and Stochastic Models in Eğirdir Lake Level Forecasting , 2010 .

[56]  Abir Jaafar Hussain,et al.  The application of ridge polynomial neural network to multi-step ahead financial time series prediction , 2008, Neural Computing and Applications.

[57]  B. Krishna,et al.  Monthly Rainfall Prediction Using Wavelet Neural Network Analysis , 2013, Water Resources Management.

[58]  Rozaida Ghazali,et al.  An Application of Jordan Pi-Sigma Neural Network for the Prediction of Temperature Time Series Signal , 2012 .