Approximation of nonlinear discrete-time system using FA-based neural network

In this paper, we focus on an important nature inspired optimization method known as Firefly Algorithm (FA). Weight initialization of neural network is a random matrix between certain interval; FA is used for weight initialization instead of random weights to Back-Propagation Neural Network (BPN). This work emphasis on approximation of nonlinear discrete-time system using FA-based BPN, i.e., FABPN. Neural network behaves as granular computing methodologies, which depends on some important parameters including initial weight matrix. FA is gradient-free optimization method used for balanced premature convergence and stagnation. We consider Mean Square Error (MSE) and Mean Absolute Percentage Error (MAPE) as objective functions. The proposed method is based on characteristics of fireflies, i.e., updating population, moving fireflies, and best solution. The performance of FA-based Back-Propagation Network (FABPN) has been demonstrated using two nonlinear discrete-time systems and one real example. Results of the FABPN envisage that the proposed method exhibits sky-scraping identification accuracy and tracking error in comparison with Particle Swarm Optimization-based BPN (PSOBPN). Tracking error using proposed method is lies on compact set in the closed neighborhood of zero.

[1]  Oscar Castillo,et al.  Optimization of type-2 fuzzy weights in backpropagation learning for neural networks using GAs and PSO , 2016, Appl. Soft Comput..

[2]  Tsu-Tian Lee,et al.  The Chebyshev-polynomials-based unified model neural networks for function approximation , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[3]  Tianyou Chai,et al.  A Nonlinear Control Method Based on ANFIS and Multiple Models for a Class of SISO Nonlinear Systems and Its Application , 2011, IEEE Transactions on Neural Networks.

[4]  Rodney A. Stewart,et al.  ANN-based residential water end-use demand forecasting model , 2013, Expert Syst. Appl..

[5]  Bidyadhar Subudhi,et al.  A differential evolution based neural network approach to nonlinear system identification , 2011, Appl. Soft Comput..

[6]  Byung Ro Moon,et al.  A Hybrid Neurogenetic Approach for Stock Forecasting , 2007, IEEE Transactions on Neural Networks.

[7]  Shyi-Ming Chen,et al.  Granular Computing and Intelligent Systems , 2011 .

[8]  Patricia Melin,et al.  Optimization with genetic algorithm and particle swarm optimization of type-2 fuzzy integrator for ensemble neural network in time series , 2016, 2016 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[9]  Li Zhang,et al.  An evaluation of back-propagation neural networks for the optimal design of structural systems: Part I. Training procedures , 2002 .

[10]  Witold Pedrycz,et al.  The development of granular rule-based systems: a study in structural model compression , 2017, GRC 2017.

[11]  R.J. Cohen,et al.  Linear and nonlinear ARMA model parameter estimation using an artificial neural network , 1997, IEEE Transactions on Biomedical Engineering.

[12]  Sheng Chen,et al.  Representations of non-linear systems: the NARMAX model , 1989 .

[13]  Witold Pedrycz,et al.  Information granularity, big data, and computational intelligence , 2015 .

[14]  Uday Pratap Singh,et al.  FCPN Approach for Uncertain Nonlinear Dynamical System with Unknown Disturbance , 2017, Int. J. Fuzzy Syst..

[15]  S. C. Tong,et al.  Adaptive Neural Network Decentralized Backstepping Output-Feedback Control for Nonlinear Large-Scale Systems With Time Delays , 2011, IEEE Transactions on Neural Networks.

[16]  Uday Pratap Singh,et al.  Modified Chaotic Bat Algorithm Based Counter Propagation Neural Network for Uncertain Nonlinear Discrete Time System , 2016, Int. J. Comput. Intell. Appl..

[17]  Xin-She Yang,et al.  Chapter 8 – Firefly Algorithms , 2014 .

[18]  Xin-She Yang,et al.  Engineering Optimization: An Introduction with Metaheuristic Applications , 2010 .

[19]  Shuzhi Sam Ge,et al.  Robust Adaptive Neural Network Control for a Class of Uncertain MIMO Nonlinear Systems With Input Nonlinearities , 2010, IEEE Transactions on Neural Networks.

[20]  Tao Chen,et al.  Back propagation neural network with adaptive differential evolution algorithm for time series forecasting , 2015, Expert Syst. Appl..

[21]  Tommy W. S. Chow,et al.  A weight initialization method for improving training speed in feedforward neural network , 2000, Neurocomputing.

[22]  X.-F. Ni,et al.  Nonlinear dynamic system identification using radial basis function networks , 1996, Proceedings of 35th IEEE Conference on Decision and Control.

[23]  Jonathan L. Ticknor.  A Bayesian regularized artificial neural network for stock market forecasting , 2013, Expert Syst. Appl..

[24]  Wei Huang,et al.  The Criticality of Spare Parts Evaluating Model Using Artificial Neural Network Approach , 2006, International Conference on Computational Science.

[25]  Grigorios N. Beligiannis,et al.  Combining evolutionary and stochastic gradient techniques for system identification , 2009 .

[26]  Oscar Castillo,et al.  Generalized type-2 fuzzy weight adjustment for backpropagation neural networks in time series prediction , 2015, Inf. Sci..

[27]  Nader Sadegh,et al.  A perceptron network for functional identification and control of nonlinear systems , 1993, IEEE Trans. Neural Networks.

[28]  Aderemi Oluyinka Adewumi,et al.  Comparison of ARIMA and Artificial Neural Networks Models for Stock Price Prediction , 2014, J. Appl. Math..

[29]  Amjad Alipanah,et al.  Nonclassical Pseudospectral Method for a Class of Singular Boundary Value Problems Arising in Physiology , 2012 .

[30]  Shaocheng Tong,et al.  Adaptive Fuzzy Robust Output Feedback Control of Nonlinear Systems With Unknown Dead Zones Based on a Small-Gain Approach , 2014, IEEE Transactions on Fuzzy Systems.

[31]  Witold Pedrycz,et al.  Granular Computing and Decision-Making: Interactive and Iterative Approaches , 2015 .

[32]  Grigorios N. Beligiannis,et al.  Nonlinear model structure identification of complex biomedical data using a genetic-programming-based technique , 2005, IEEE Transactions on Instrumentation and Measurement.

[33]  W. Pedrycz,et al.  Granular computing and intelligent systems : design with information granules of higher order and higher type , 2011 .

[34]  Uday Pratap Singh,et al.  Optimization of neural network for nonlinear discrete time system using modified quaternion firefly algorithm: case study of Indian currency exchange rate prediction , 2018, Soft Comput..

[35]  Kumpati S. Narendra,et al.  Identification and control of a nonlinear discrete-time system based on its linearization: a unified framework , 2004, IEEE Transactions on Neural Networks.

[36]  Mingli Song,et al.  A study of granular computing in the agenda of growth of artificial neural networks , 2016, Granular Computing.

[37]  Jian Li,et al.  Multistatic Adaptive Microwave Imaging for Early Breast Cancer Detection , 2006, IEEE Transactions on Biomedical Engineering.

[38]  Yaman Arkun,et al.  Control of nonlinear systems using polynomial ARMA models , 1993 .

[39]  Guijun Wang,et al.  Approximation performance of the nonlinear hybrid fuzzy system based on variable universe , 2017, GRC 2017.

[40]  Masahiro Abe,et al.  Incipient fault diagnosis of chemical processes via artificial neural networks , 1989 .

[41]  Tugrul U. Daim,et al.  Using artificial neural network models in stock market index prediction , 2011, Expert Syst. Appl..

[42]  Kumpati S. Narendra,et al.  Identification and control of dynamical systems using neural networks , 1990, IEEE Trans. Neural Networks.