Interval Type-2 Radial Basis Function Neural Network: A Modeling Framework

In this paper, an interval type-2 radial basis function neural network (IT2-RBF-NN) is proposed as a new modeling framework. We take advantage of the functional equivalence of radial basis function neural networks (RBF-NNs) to a class of type-1 fuzzy logic systems (T1-FLS) to propose a new interval type-2 equivalent system; it is systematically shown that the type equivalence (between RBF and FLS) of the new modeling structure is maintained in the case of the IT2 system. The new IT2-RBF-NN incorporates interval type-2 fuzzy sets within the radial basis function layer of the neural network in order to account for linguistic uncertainty in the system's variables. The antecedent part in each rule in the IT2-RBF-NN is an interval type-2 fuzzy set, and the consequent part is of Mamdani type with interval weights, which are used for the Karnik and Mendel type-reduction process in the output layer of the network. The structural and parametric optimization of the IT2-RBF-NN parameters is carried out by a hybrid approach that is based on estimating the initial rule base and footprint of uncertainty (FOU) directly via a granular computing approach and an adaptive back propagation approach. The effectiveness of the new modeling framework is assessed in two parts. First, the IT2-RBF-NN is tested against a number of popular benchmark datasets, and second, it is demonstrated in a real-world industrial application that has particular challenges that are related to the uncertainty of the raw information. Via simulation results, it is shown that the proposed modeling framework performs well as compared with its T1 equivalent system. In addition, a very good computational efficiency is demonstrated as a result of the systematic and automatic creation of IT2 linguistic information and the FOU. Crucially, the proposed modeling framework opens up a host of opportunities for the academic community that already uses the popular T1-RBF-NN-based structure to try the new IT2-RBF-NN and take advantage of the numerous existing RBF-based adaptive learning algorithms, RBF-based multiobjective optimization techniques, granular computing-based information capture techniques, and real-world FLS implementations, and, in general, take advantage of the computational efficiency of the fusion of IT2-FLS and RBF-NN.

[1]  R. Fisher THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[2]  Meng Joo Er,et al.  Dynamic fuzzy neural networks-a novel approach to function approximation , 2000, IEEE Trans. Syst. Man Cybern. Part B.

[3]  Ahmad Lotfi,et al.  Comments on "Functional equivalence between radial basis function networks and fuzzy inference systems" [and reply] , 1998, IEEE Trans. Neural Networks.

[4]  H. Hagras,et al.  Type-2 FLCs: A New Generation of Fuzzy Controllers , 2007, IEEE Computational Intelligence Magazine.

[5]  Ricardo Martínez-Soto,et al.  Optimization of Interval Type-2 Fuzzy Logic Controllers for a Perturbed Autonomous Wheeled Mobile Robot Using Genetic Algorithms , 2009, Soft Computing for Hybrid Intelligent Systems.

[6]  H. B. Mitchell Pattern recognition using type-II fuzzy sets , 2005, Inf. Sci..

[7]  Hani Hagras Comments on "Dynamical Optimal Training for Interval Type-2 Fuzzy Neural Network (T2FNN) , 2006, IEEE Trans. Syst. Man Cybern. Part B.

[8]  I. Burhan Türksen,et al.  Discrete Interval Type 2 Fuzzy System Models Using Uncertainty in Learning Parameters , 2007, IEEE Transactions on Fuzzy Systems.

[9]  Byung-In Choi,et al.  Interval Type-2 Fuzzy Membership Function Design and its Application to Radial Basis Function Neural Networks , 2007, 2007 IEEE International Fuzzy Systems Conference.

[10]  Yee Leung,et al.  A genetic-based method for training fuzzy systems , 2001, 10th IEEE International Conference on Fuzzy Systems. (Cat. No.01CH37297).

[11]  Jerry M. Mendel,et al.  Interval type-2 fuzzy logic systems , 2000, Ninth IEEE International Conference on Fuzzy Systems. FUZZ- IEEE 2000 (Cat. No.00CH37063).

[12]  Oscar Castillo,et al.  Neural Network with Type-2 Fuzzy Weights Adjustment for Pattern Recognition of the Human Iris Biometrics , 2012, MICAI.

[13]  Paul Horton,et al.  A Probabilistic Classification System for Predicting the Cellular Localization Sites of Proteins , 1996, ISMB.

[14]  Witold Pedrycz,et al.  Type-2 fuzzy neural networks with fuzzy clustering and differential evolution optimization , 2011, Inf. Sci..

[15]  Shie-Jue Lee,et al.  General type-2 fuzzy neural network with hybrid learning for function approximation , 2009, 2009 IEEE International Conference on Fuzzy Systems.

[16]  Chuen-Tsai Sun,et al.  Functional equivalence between radial basis function networks and fuzzy inference systems , 1993, IEEE Trans. Neural Networks.

[17]  Roderick Murray-Smith,et al.  Extending the functional equivalence of radial basis function networks and fuzzy inference systems , 1996, IEEE Trans. Neural Networks.

[18]  Héctor Pomares,et al.  Multiobjective Optimization and Comparison of Nonsingleton Type-1 and Singleton Interval Type-2 Fuzzy Logic Systems , 2013, IEEE Transactions on Fuzzy Systems.

[19]  George Panoutsos,et al.  A neural-fuzzy modelling framework based on granular computing: Concepts and applications , 2010, Fuzzy Sets Syst..

[20]  Dongrui Wu,et al.  Approaches for Reducing the Computational Cost of Interval Type-2 Fuzzy Logic Systems: Overview and Comparisons , 2013, IEEE Transactions on Fuzzy Systems.

[21]  George Panoutsos,et al.  Granular computing neural-fuzzy modelling: A neutrosophic approach , 2013, Appl. Soft Comput..

[22]  George Panoutsos,et al.  Modelling steel heat treatment data using granular data compression and multiple granularity modelling , 2010, Int. J. Granul. Comput. Rough Sets Intell. Syst..

[23]  Jerry M. Mendel,et al.  Enhanced Karnik--Mendel Algorithms , 2009, IEEE Transactions on Fuzzy Systems.

[24]  Sung-Kwun Oh,et al.  Optimized FCM-Based Radial Basis Function Neural Networks: A Comparative Analysis of LSE and WLSE Method , 2010, ISNN.

[25]  Oscar Castillo,et al.  A hybrid learning algorithm for a class of interval type-2 fuzzy neural networks , 2009, Inf. Sci..

[26]  Milos Manic,et al.  Uncertainty modeling for interval Type-2 Fuzzy Logic Systems based on sensor characteristics , 2011, 2011 IEEE Symposium on Advances in Type-2 Fuzzy Logic Systems (T2FUZZ).

[27]  Jerry M. Mendel,et al.  Uncertainty measures for interval type-2 fuzzy sets , 2007, Inf. Sci..

[28]  Chia-Feng Juang,et al.  Evolutionary Robot Wall-Following Control Using Type-2 Fuzzy Controller With Species-DE-Activated Continuous ACO , 2013, IEEE Transactions on Fuzzy Systems.

[29]  Lotfi A. Zadeh,et al.  Toward a generalized theory of uncertainty (GTU)--an outline , 2005, Inf. Sci..

[30]  Humberto Bustince,et al.  Interval Type-2 Fuzzy Sets Constructed From Several Membership Functions: Application to the Fuzzy Thresholding Algorithm , 2013, IEEE Transactions on Fuzzy Systems.

[31]  Derek A. Linkens,et al.  A systematic neuro-fuzzy modeling framework with application to material property prediction , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[32]  Ismael Lopez-Juarez,et al.  Interval singleton type-2 TSK fuzzy logic systems using orthogonal least-squares and backpropagation methods as hybrid learning mechanism , 2011, 2011 11th International Conference on Hybrid Intelligent Systems (HIS).

[33]  Danuta Rutkowska,et al.  Neuro-Fuzzy Architectures and Hybrid Learning , 2002, Studies in Fuzziness and Soft Computing.

[34]  Oscar Castillo,et al.  Interval type-2 fuzzy logic and modular neural networks for face recognition applications , 2009, Appl. Soft Comput..

[35]  P. Melin,et al.  Backpropagation method with type-2 fuzzy weight adjustment for neural network learning , 2012, 2012 Annual Meeting of the North American Fuzzy Information Processing Society (NAFIPS).

[36]  M. Kanehisa,et al.  Expert system for predicting protein localization sites in gram‐negative bacteria , 1991, Proteins.

[37]  Oscar Castillo,et al.  An optimization method for designing type-2 fuzzy inference systems based on the footprint of uncertainty using genetic algorithms , 2012, Expert Syst. Appl..

[38]  Jerry M. Mendel,et al.  Simplified Interval Type-2 Fuzzy Logic Systems , 2013, IEEE Transactions on Fuzzy Systems.

[39]  Yang-Yin Lin,et al.  A Recurrent Self-Evolving Interval Type-2 Fuzzy Neural Network for Dynamic System Processing , 2009, IEEE Transactions on Fuzzy Systems.

[40]  Jerry M. Mendel,et al.  Type-2 fuzzy sets and systems: an overview , 2007, IEEE Computational Intelligence Magazine.

[41]  Jeng-Shyang Pan,et al.  Fuzzy Rules Interpolation for Sparse Fuzzy Rule-Based Systems Based on Interval Type-2 Gaussian Fuzzy Sets and Genetic Algorithms , 2013, IEEE Transactions on Fuzzy Systems.

[42]  Witold Pedrycz,et al.  Granular computing: an introduction , 2001, Proceedings Joint 9th IFSA World Congress and 20th NAFIPS International Conference (Cat. No. 01TH8569).

[43]  Sei-Wang Chen,et al.  Attributed concept maps: fuzzy integration and fuzzy matching , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[44]  Chia-Feng Juang,et al.  An Interval Type-2 Fuzzy-Neural Network With Support-Vector Regression for Noisy Regression Problems , 2010, IEEE Transactions on Fuzzy Systems.

[45]  Jerry M. Mendel,et al.  Interval Type-2 Fuzzy Logic Systems Made Simple , 2006, IEEE Transactions on Fuzzy Systems.

[46]  John Moody,et al.  Fast Learning in Networks of Locally-Tuned Processing Units , 1989, Neural Computation.

[47]  Gerardo M. Mendez,et al.  Hybrid learning for interval type-2 fuzzy logic systems based on orthogonal least-squares and back-propagation methods , 2009, Inf. Sci..

[48]  R.I. John,et al.  Type 2 fuzzy sets and neuro-fuzzy clustering of radiographic tibia images , 1998, 1998 IEEE International Conference on Fuzzy Systems Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36228).

[49]  Jerry M. Mendel,et al.  Computing derivatives in interval type-2 fuzzy logic systems , 2004, IEEE Transactions on Fuzzy Systems.

[50]  Jonathan Tenner,et al.  Optimisation of the heat treatment of steel using neural networks , 2000 .

[51]  G.M. Mendez Orthogonal-back propagation hybrid learning algorithm for type-2 fuzzy logic systems , 2004, IEEE Annual Meeting of the Fuzzy Information, 2004. Processing NAFIPS '04..

[52]  Jerry M. Mendel,et al.  On the importance of interval sets in type-2 fuzzy logic systems , 2001, Proceedings Joint 9th IFSA World Congress and 20th NAFIPS International Conference (Cat. No. 01TH8569).