Gradient-based back-propagation dynamical iterative learning scheme for the neuro-fuzzy inference system

In this paper, a gradient-based back propagation dynamical iterative learning algorithm is proposed for structure optimization and parameter tuning of the neuro-fuzzy system. Premise and consequent parameters of the neuro-fuzzy model are initialized randomly and then tuned by the proposed iterative algorithm. The learning algorithm is based on the first order partial derivative of the output with respect to the structure parameters. The first order derivative of the model output with respect to the structure parameters determines the sensitivity of the model to structure parameters. The sensitivity values are then used to set the tuning factors and parameters updating step sizes. Therefore, an adaptive dynamical iterative scheme is achieved which adapts the learning procedure to the current state of the performance during the optimization process. Larger tuning step sizes make the convergence speed higher and vice versa. In this regard, this parameter is treated according to the calculated sensitivity of the model to the parameter. The proposed learning algorithm is compared with the least square back propagation method, genetic algorithm and chaotic genetic algorithm in the neuro-fuzzy model structure optimization. Smaller mean square error and shorter learning time are sought in this paper, and the performance of the proposed learning algorithm is versified regarding these criteria.

[1]  Detlef Nauck,et al.  A Neuro-Fuzzy Development Tool for Fuzzy Controllers under MATLAB/SIMULINK , 2000 .

[2]  Kazuo Tanaka,et al.  Successive identification of a fuzzy model and its applications to prediction of a complex system , 1991 .

[3]  Omid Khayat,et al.  Differentiating adaptive Neuro-Fuzzy Inference System for accurate function derivative approximation , 2013, Neurocomputing.

[4]  Omid Khayat Structural parameter tuning of the first-order derivative of an adaptive neuro-fuzzy system for chaotic function modeling , 2014, J. Intell. Fuzzy Syst..

[5]  M. Ali Akcayol Application of adaptive neuro-fuzzy controller for SRM , 2004 .

[6]  Elif Derya Übeyli,et al.  Adaptive neuro-fuzzy inference system for classification of EEG signals using wavelet coefficients , 2005, Journal of Neuroscience Methods.

[7]  Francesco Masulli,et al.  Building a neuro-fuzzy system to efficiently forecast chaotic time series , 1997 .

[8]  Jyh-Shing Roger Jang,et al.  Self-learning fuzzy controllers based on temporal backpropagation , 1992, IEEE Trans. Neural Networks.

[9]  Ronald R. Yager,et al.  Fuzzy sets, neural networks, and soft computing , 1994 .

[10]  Wen-Pai Wang,et al.  A neuro-fuzzy based forecasting approach for rush order control applications , 2008, Expert Syst. Appl..

[11]  Simon Parsons,et al.  Soft computing: fuzzy logic, neural networks and distributed artificial intelligence by F. Aminzadeh and M. Jamshidi (Eds.), PTR Prentice Hall, Englewood Cliffs, NJ, pp 301, ISBN 0-13-146234-2 , 1996, Knowl. Eng. Rev..

[12]  H. Joel Trussell,et al.  Fuzzy inference systems implemented on neural architectures for motor fault detection and diagnosis , 1999, IEEE Trans. Ind. Electron..

[13]  Junfei Qiao,et al.  A self-organizing fuzzy neural network and its applications to function approximation and forecast modeling , 2008, Neurocomputing.

[14]  Okyay Kaynak,et al.  Fuzzy Wavelet Neural Networks for Identification and Control of Dynamic Plants—A Novel Structure and a Comparative Study , 2008, IEEE Transactions on Industrial Electronics.

[15]  Per Capita,et al.  About the authors , 1995, Machine Vision and Applications.

[16]  Derek A. Linkens,et al.  A systematic neuro-fuzzy modeling framework with application to material property prediction , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[17]  Mohammad Mehdi Ebadzadeh,et al.  A novel hybrid algorithm for creating self-organizing fuzzy neural networks , 2009, Neurocomputing.

[18]  Oliver Vornberger,et al.  Sales forecasting using neural networks , 1997, Proceedings of International Conference on Neural Networks (ICNN'97).

[19]  A. Lapedes,et al.  Nonlinear signal processing using neural networks: Prediction and system modelling , 1987 .

[20]  Michio Sugeno,et al.  A fuzzy-logic-based approach to qualitative modeling , 1993, IEEE Trans. Fuzzy Syst..