A new Neuro-Fuzzy Inference System with Dynamic Neurons (NFIS-DN) for system identification and time series forecasting

Abstract A new Neuro-Fuzzy Inference System with Dynamic Neurons or NFIS-DN is presented here for discrete time dynamic system identification and time series forecasting problems. The proposed dynamic system based neuron, referred to as Dynamic Neuron (DN) is realized by a discrete-time nonlinear state-space model. The DN is designed such way, that the output considers only the effect of finite past instances, enabling the system with finite memory. The NFIS-DN model has five layers, and DNs are employed only in the layers handling crisp values. The antecedent and the consequent parameters of NFIS-DN are updated using a self-regulated backpropagation through time learning algorithm. The performance evaluation of NFIS-DN has been carried-out using benchmark problems in the areas of nonlinear system identification and time series forecasting. The results are compared with the state-of-the-art method on the neural fuzzy networks. The obtained results clearly suggest that the NFIS-DN performs significantly better while using a smaller or similar number of fuzzy rules. Finally the practical application of the NFIS-DN has been demonstrated using two real-world problems.

[1]  Yuanjie Zheng,et al.  An evolving recurrent interval type-2 intuitionistic fuzzy neural network for online learning and time series prediction , 2019, Appl. Soft Comput..

[2]  Ranjan Ganguli,et al.  A direct adaptive neural command controller design for an unstable helicopter , 2005, Eng. Appl. Artif. Intell..

[3]  Narasimhan Sundararajan,et al.  Online Sequential Fuzzy Extreme Learning Machine for Function Approximation and Classification Problems , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[4]  Chin-Teng Lin,et al.  Identification and Prediction of Dynamic Systems Using an Interactively Recurrent Self-Evolving Fuzzy Neural Network , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[5]  Seref Sagiroglu,et al.  Data mining and wind power prediction: A literature review , 2012 .

[6]  D.P. Filev,et al.  An approach to online identification of Takagi-Sugeno fuzzy models , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[7]  A. K. Das,et al.  A computationally fast Interval Type-2 Neuro-Fuzzy Inference System and its Meta-Cognitive projection based learning algorithm , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[8]  Kwon Soon Lee,et al.  Robust friction state observer and recurrent fuzzy neural network design for dynamic friction compensation with backstepping control , 2010 .

[9]  H. J. Kim,et al.  A sequential learning algorithm for self-adaptive resource allocation network classifier , 2010, Neurocomputing.

[10]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[11]  Paris A. Mastorocostas,et al.  A recurrent fuzzy-neural model for dynamic system identification , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[12]  Jakub Nowotarski,et al.  LTSC_EXAMPLE: MATLAB example script and data for "Robust estimation and forecasting of the long-term seasonal component of electricity spot prices" , 2013 .

[13]  Jae S. Lim,et al.  Two-Dimensional Signal and Image Processing , 1989 .

[14]  Niels Haldrup,et al.  Vector Autoregressive Model for Electricity Prices Subject to Long Memory and Regime Switching , 2007 .

[15]  Ching-Hung Lee,et al.  Identification and control of dynamic systems using recurrent fuzzy neural networks , 2000, IEEE Trans. Fuzzy Syst..

[16]  James D. Hamilton.  Time Series Analysis , 1994 .

[17]  Sundaram Suresh,et al.  A complex-valued neuro-fuzzy inference system and its learning mechanism , 2014, Neurocomputing.

[18]  Cheng-Jian Lin,et al.  Prediction and identification using wavelet-based recurrent fuzzy neural networks , 2004, IEEE Trans. Syst. Man Cybern. Part B.

[19]  E. Michael Azoff,et al.  Neural Network Time Series: Forecasting of Financial Markets , 1994 .

[20]  P. S. Sastry,et al.  Memory neuron networks for identification and control of dynamical systems , 1994, IEEE Trans. Neural Networks.

[21]  Helmut Ltkepohl,et al.  New Introduction to Multiple Time Series Analysis , 2007 .

[22]  I. J. Leontaritis,et al.  Input-output parametric models for non-linear systems Part II: stochastic non-linear systems , 1985 .

[23]  Kenji Doya,et al.  Recurrent networks: supervised learning , 1998 .

[24]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1971 .

[25]  Chin-Teng Lin,et al.  A recurrent self-organizing neural fuzzy inference network , 1999, IEEE Trans. Neural Networks.

[26]  Suresh Sundaram,et al.  A Meta-cognitive Recurrent Fuzzy Inference System with Memory Neurons (McRFIS-MN) and its Fast Learning Algorithm for Time Series Forecasting , 2018, 2018 IEEE Symposium Series on Computational Intelligence (SSCI).

[27]  Paramasivan Saratchandran,et al.  Sequential Adaptive Fuzzy Inference System (SAFIS) for nonlinear system identification and prediction , 2006, Fuzzy Sets Syst..

[28]  José de Jesús Rubio,et al.  USNFIS: Uniform stable neuro fuzzy inference system , 2017, Neurocomputing.

[29]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[30]  W. Gan,et al.  Adaptive recurrent fuzzy neural networks for active noise control , 2006 .

[31]  Ankit Kumar Das,et al.  An Evolving Interval Type-2 Neurofuzzy Inference System and Its Metacognitive Sequential Learning Algorithm , 2015, IEEE Transactions on Fuzzy Systems.

[32]  Paul J. Werbos,et al.  Backpropagation Through Time: What It Does and How to Do It , 1990, Proc. IEEE.

[33]  Plamen P. Angelov,et al.  PANFIS: A Novel Incremental Learning Machine , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[34]  Cuntai Guan,et al.  eT2FIS: An Evolving Type-2 Neural Fuzzy Inference System , 2013, Inf. Sci..

[35]  Jie Zhang,et al.  Recurrent neuro-fuzzy networks for nonlinear process modeling , 1999, IEEE Trans. Neural Networks.

[36]  Sundaram Suresh,et al.  A meta-cognitive sequential learning algorithm for neuro-fuzzy inference system , 2012, Appl. Soft Comput..

[37]  Ying-Chung Wang,et al.  Direct adaptive iterative learning control of nonlinear systems using an output-recurrent fuzzy neural network , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[38]  Chia-Feng Juang,et al.  A Locally Recurrent Fuzzy Neural Network With Support Vector Regression for Dynamic-System Modeling , 2010, IEEE Transactions on Fuzzy Systems.

[39]  Yang-Yin Lin,et al.  A recurrent self-evolving fuzzy neural network with local feedbacks and its application to dynamic system processing , 2010, Fuzzy Sets Syst..

[40]  José de Jesús Rubio,et al.  SOFMLS: Online Self-Organizing Fuzzy Modified Least-Squares Network , 2009, IEEE Transactions on Fuzzy Systems.

[41]  Kazuyuki Aihara,et al.  Complex-valued prediction of wind profile using augmented complex statistics , 2009 .

[42]  Narasimhan Sundararajan,et al.  Nonlinear Adaptive Neural Controller for Unstable Aircraft , 2005 .

[43]  Kumpati S. Narendra,et al.  Identification and control of dynamical systems using neural networks , 1990, IEEE Trans. Neural Networks.

[44]  Mahardhika Pratama,et al.  GENEFIS: Toward an Effective Localist Network , 2014, IEEE Transactions on Fuzzy Systems.

[45]  Sundaram Suresh,et al.  Lift coefficient prediction at high angle of attack using recurrent neural network , 2003 .

[46]  K S Narendra,et al.  Control of nonlinear dynamical systems using neural networks. II. Observability, identification, and control , 1996, IEEE Trans. Neural Networks.

[47]  Sundaram Suresh,et al.  Meta-cognitive RBF Network and its Projection Based Learning algorithm for classification problems , 2013, Appl. Soft Comput..

[48]  Ching-Chih Tsai,et al.  Generalized predictive control using recurrent fuzzy neural networks for industrial processes , 2007 .

[49]  Plamen P. Angelov,et al.  Autonomous Learning Multimodel Systems From Data Streams , 2018, IEEE Transactions on Fuzzy Systems.

[50]  Çagdas Hakan Aladag,et al.  Recurrent Multiplicative Neuron Model Artificial Neural Network for Non-linear Time Series Forecasting , 2014, Neural Processing Letters.

[51]  Chia-Feng Juang,et al.  A TSK-type recurrent fuzzy network for dynamic systems processing by neural network and genetic algorithms , 2002, IEEE Trans. Fuzzy Syst..

[52]  Junfei Qiao,et al.  Nonlinear system modeling using a self-organizing recurrent radial basis function neural network , 2017, Appl. Soft Comput..

[53]  Bijan Fazlollahi,et al.  Evolutionary algorithm-based learning of fuzzy neural networks. Part 2: Recurrent fuzzy neural networks , 2009, Fuzzy Sets Syst..

[54]  Plamen P. Angelov,et al.  Simpl_eTS: a simplified method for learning evolving Takagi-Sugeno fuzzy models , 2005, The 14th IEEE International Conference on Fuzzy Systems, 2005. FUZZ '05..