Developing deep fuzzy network with Takagi Sugeno fuzzy inference system

The state-of-art algorithms in computational intelligence have become better than human intelligence in some of pattern recognition areas. Most of these state-of-art algorithms have been developed from the concept of multi-layered artificial neural networks. Large amount of numerical and linguistic rule data has been created in recent years. Fuzzy sets are useful in modeling uncertainty due to vagueness, ambiguity and imprecision. Fuzzy inference systems incorporate linguistic rules intelligible to human beings. Many attempts have been made to combine assets of fuzzy sets, fuzzy inference systems and artificial neural networks. Use of a single fuzzy inference system limits the performance. In this paper, we propose a generic architecture of multi-layered network developed from Takagi Sugeno fuzzy inference systems as basic units. This generic architecture is called “Takagi Sugeno Deep Fuzzy Network”. Multiple distinct fuzzy inference structures can be identified using proposed architecture. A general three layered TS deep fuzzy network is explained in detail in this paper. The generic algorithm for identification of all network parameters of three layered deep fuzzy network using error backpropagation is presented in the paper. The proposed architecture as well as its identification procedure are validated using two experimental case studies. The performance of proposed architecture is evaluated in normal, imprecise and vague situations and it is compared with performance of artificial neural network with same architecture. The results illustrate that the proposed architecture eclipses over three layered feedforward artificial neural network in all situations.

[1]  Lukás Burget,et al.  Recurrent neural network based language model , 2010, INTERSPEECH.

[2]  Yie-Chien Chen,et al.  A model reference control structure using a fuzzy neural network , 1995 .

[3]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[4]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[5]  Yu-Jun Zheng,et al.  Airline Passenger Profiling Based on Fuzzy Deep Machine Learning , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[6]  José M. N. Vieira,et al.  Neuro-Fuzzy Systems: A Survey , 2004 .

[7]  Kurt Hornik,et al.  Universal approximation of an unknown mapping and its derivatives using multilayer feedforward networks , 1990, Neural Networks.

[8]  Madan M. Gupta,et al.  On the principles of fuzzy neural networks , 1994 .

[9]  Youyong Kong,et al.  A Hierarchical Fused Fuzzy Deep Neural Network for Data Classification , 2017, IEEE Transactions on Fuzzy Systems.

[10]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[11]  L. Wang,et al.  Fuzzy systems are universal approximators , 1992, [1992 Proceedings] IEEE International Conference on Fuzzy Systems.

[12]  Geoffrey E. Hinton,et al.  Acoustic Modeling Using Deep Belief Networks , 2012, IEEE Transactions on Audio, Speech, and Language Processing.

[13]  C. L. Philip Chen,et al.  Fuzzy Restricted Boltzmann Machine for the Enhancement of Deep Learning , 2015, IEEE Transactions on Fuzzy Systems.

[14]  Philip M. Wolfe,et al.  The amalgamation of neural networks and fuzzy logic systems—a survey , 1995 .

[15]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[16]  Rudolf Kruse,et al.  Fuzzy neural network , 2008, Scholarpedia.

[17]  Jerry M. Mendel,et al.  Generating fuzzy rules by learning from examples , 1992, IEEE Trans. Syst. Man Cybern..

[18]  Yuichi Motai,et al.  Intra- and Inter-Fractional Variation Prediction of Lung Tumors Using Fuzzy Deep Learning , 2016, IEEE Journal of Translational Engineering in Health and Medicine.

[19]  C. R kavitha Fuzzy Neural Networks , 2017 .

[20]  J. Buckley,et al.  Fuzzy neural networks: a survey , 1994 .