Fuzzy Inference Network with Mamdani Fuzzy Inference System

In the modern era, the amount of data generated is increasing at an exponential rate. The generated data has both numeric as well as linguistic form. Learning or extracting relevant information from these types of data is a major challenge for researchers. In this chapter, we have proposed a generic architecture of a network built from Mamdani fuzzy inference system as its basic building blocks and it tries to learn the information from data. Each node of the network acts as a complete Mamdani fuzzy inference system mapping numeric as well as linguistic information of the data from input to output in terms of linguistic rule-based inference. Parameters of the input fuzzy membership functions appearing in the premise parts and output fuzzy membership functions appearing in consequent parts of the rules in the fuzzy rule base of each node in the network constitute overall parameters of the network. The proposed model is trained using advanced optimization techniques to optimize the network parameters for better performance. The effectiveness of the trained model is tested on two different datasets. The proposed approach is compared with the Takagi-Sugeno Fuzzy Inference Network and feed-forward artificial neural network with similar architecture.

[1]  R. Fletcher.  Practical Methods of Optimization , 1988 .

[2]  D. Shanno.  Conditioning of Quasi-Newton Methods for Function Minimization , 1970 .

[3]  Jerry M. Mendel,et al.  Back-propagation fuzzy system as nonlinear dynamic system identifiers , 1992, [1992 Proceedings] IEEE International Conference on Fuzzy Systems.

[4]  J. Buckley,et al.  Fuzzy genetic algorithm and applications , 1994 .

[5]  Nishchal K. Verma,et al.  Developing deep fuzzy network with Takagi Sugeno fuzzy inference system , 2017, 2017 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[6]  Alexei A. Efros,et al.  Colorful Image Colorization , 2016, ECCV.

[7]  Hon Keung Kwan,et al.  A fuzzy neural network and its application to pattern recognition , 1994, IEEE Trans. Fuzzy Syst..

[8]  Dumitru Erhan,et al.  Deep Neural Networks for Object Detection , 2013, NIPS.

[9]  Nishchal K. Verma,et al.  Interval type-2 TS fuzzy model for angle of attack sensor of the aircraft , 2018, J. Intell. Fuzzy Syst..

[10]  Lawrence. Davis,et al.  Handbook Of Genetic Algorithms , 1990 .

[11]  María José del Jesús,et al.  Genetic tuning of fuzzy rule deep structures preserving interpretability and its interaction with fuzzy rule set reduction , 2005, IEEE Transactions on Fuzzy Systems.

[12]  Youyong Kong,et al.  A Hierarchical Fused Fuzzy Deep Neural Network for Data Classification , 2017, IEEE Transactions on Fuzzy Systems.

[13]  R. Fletcher,et al.  A New Approach to Variable Metric Algorithms , 1970, Comput. J..

[14]  Jerry M. Mendel,et al.  Generating fuzzy rules by learning from examples , 1992, IEEE Trans. Syst. Man Cybern..

[15]  James J. Buckley,et al.  Fuzzy genetic algorithms for optimization , 1993, Proceedings of 1993 International Conference on Neural Networks (IJCNN-93-Nagoya, Japan).

[16]  Andrew G. Howard,et al.  Some Improvements on Deep Convolutional Neural Network Based Image Classification , 2013, ICLR.

[17]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[18]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[19]  Ai Hui Tan,et al.  From a Gaussian mixture model to additive fuzzy systems , 2005, IEEE Transactions on Fuzzy Systems.

[20]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[21]  Radko Mesiar,et al.  On special fuzzy implications , 2009, Fuzzy Sets Syst..

[22]  W. Pitts,et al.  A Logical Calculus of the Ideas Immanent in Nervous Activity (1943) , 2021, Ideas That Created the Future.

[23]  Qingcai Chen,et al.  Fuzzy deep belief networks for semi-supervised sentiment classification , 2014, Neurocomputing.

[24]  Fei-Fei Li,et al.  Deep visual-semantic alignments for generating image descriptions , 2015, CVPR.

[25]  D. Goldfarb.  A family of variable-metric methods derived by variational means , 1970 .

[26]  Nishchal K. Verma,et al.  Additive and Nonadditive Fuzzy Hidden Markov Models , 2010, IEEE Transactions on Fuzzy Systems.

[27]  Nishchal K. Verma,et al.  Adaptive non-additive generalized fuzzy systems , 2010, Appl. Soft Comput..

[28]  Jiajun Zhang,et al.  Deep Neural Networks in Machine Translation: An Overview , 2015, IEEE Intelligent Systems.

[29]  Nishchal K. Verma,et al.  Adaptive Type-2 Fuzzy Approach for Filtering Salt and Pepper Noise in Grayscale Images , 2018, IEEE Transactions on Fuzzy Systems.

[30]  Rahul Kumar Sevakula,et al.  Compounding General Purpose Membership Functions for Fuzzy Support Vector Machine Under Noisy Environment , 2017, IEEE Transactions on Fuzzy Systems.

[31]  C. G. Broyden.  The Convergence of a Class of Double-rank Minimization Algorithms 1. General Considerations , 1970 .

[32]  Nishchal K. Verma,et al.  Data driven model using adaptive fuzzy system , 2008, Int. J. Autom. Control..

[33]  Edward T. Lee,et al.  Fuzzy Neural Networks , 1975 .

[34]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups , 2012, IEEE Signal Processing Magazine.