A non-singleton type-2 fuzzy neural network with adaptive secondary membership for high dimensional applications

Abstract This paper develops a non-singleton type-2 fuzzy neural network (NT2FNN) with type-2 3-dimensional membership functions (MFs) and adaptive secondary membership. A new approach based on the square-root cubature quadrature Kalman filter (SR-CQKF) is proposed for the training the level of the secondary membership and the centers of membership functions. The consequent parameters are learned by using rule-ordered extended Kalman filter (EKF). To show the applicability and effectiveness of proposed NT2FNN in high dimensional problems, four real-world datasets with 4, 7, 13 and 32 input variables are considered. Additionally, the performance of NT2FNN with the proposed learning algorithm is compared with other well-known neural networks and learning algorithms. The simulations demonstrate that the developed method results in high performance in contrast to the other methods.

[1]  Roozbeh Razavi-Far,et al.  zSlices-Based General Type-2 Fuzzy Fusion of Support Vector Machines With Application to Bearing Fault Detection , 2017, IEEE Transactions on Industrial Electronics.

[2]  Jianqiang Yi,et al.  A fast learning method for data-driven design of interval type-2 fuzzy logic system , 2017, Journal of Intelligent & Fuzzy Systems.

[3]  Mehmet Karaköse,et al.  Image Processing-Based Center Calculation Method for General and Interval Type-2 Fuzzy Systems , 2018, Int. J. Fuzzy Syst..

[4]  John Yen,et al.  Extracting fuzzy rules for system modeling using a hybrid of genetic algorithms and Kalman filter , 1999, Fuzzy Sets Syst..

[5]  Paramasivan Saratchandran,et al.  Sequential Adaptive Fuzzy Inference System (SAFIS) for nonlinear system identification and prediction , 2006, Fuzzy Sets Syst..

[6]  Tomislav Dragicevic,et al.  An optimal general type-2 fuzzy controller for Urban Traffic Network. , 2017, ISA transactions.

[7]  José de Jesús Rubio,et al.  SOFMLS: Online Self-Organizing Fuzzy Modified Least-Squares Network , 2009, IEEE Transactions on Fuzzy Systems.

[8]  Sundaram Suresh,et al.  A meta-cognitive interval type-2 fuzzy inference system and its projection based learning algorithm , 2014, Evol. Syst..

[9]  Xiao-Jun Zeng,et al.  A structure evolving learning method for fuzzy systems , 2010, Evol. Syst..

[10]  Josef F. Krems,et al.  Adaptive fuzzy pattern classification for the online detection of driver lane change intention , 2017, Neurocomputing.

[11]  Chin-Teng Lin,et al.  An online self-constructing neural fuzzy inference network and its applications , 1998, IEEE Trans. Fuzzy Syst..

[12]  Witold Pedrycz,et al.  Linguistic models as a framework of user-centric system modeling , 2006, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[13]  Chia-Feng Juang,et al.  An Interval Type-2 Fuzzy-Neural Network With Support-Vector Regression for Noisy Regression Problems , 2010, IEEE Transactions on Fuzzy Systems.

[14]  Woei Wan Tan,et al.  Towards an efficient type-reduction method for interval type-2 fuzzy logic systems , 2008, 2008 IEEE International Conference on Fuzzy Systems (IEEE World Congress on Computational Intelligence).

[15]  Juan R. Castro,et al.  Genetic Algorithm Optimization for Type-2 Non-singleton Fuzzy Logic Controllers , 2014, Recent Advances on Hybrid Approaches for Designing Intelligent Systems.

[16]  Oscar Castillo,et al.  Short Remark on Fuzzy Sets, Interval Type-2 Fuzzy Sets, General Type-2 Fuzzy Sets and Intuitionistic Fuzzy Sets , 2014, IEEE Conf. on Intelligent Systems.

[17]  Jerry M. Mendel,et al.  Similarity Measures for Closed General Type-2 Fuzzy Sets: Overview, Comparisons, and a Geometric Approach , 2019, IEEE Transactions on Fuzzy Systems.

[18]  Asifullah Khan,et al.  Robust fuzzy RBF network based image segmentation and intelligent decision making system for carotid artery ultrasound images , 2015, Neurocomputing.

[19]  Oscar Castillo,et al.  A generalized type-2 fuzzy logic approach for dynamic parameter adaptation in bee colony optimization applied to fuzzy controller design , 2017, Inf. Sci..

[20]  Y Lu,et al.  A Sequential Learning Scheme for Function Approximation Using Minimal Radial Basis Function Neural Networks , 1997, Neural Computation.

[21]  Sehraneh Ghaemi,et al.  Synchronization of chaotic systems and identification of nonlinear systems by using recurrent hierarchical type-2 fuzzy neural networks. , 2015, ISA transactions.

[22]  Xiao-Jun Zeng,et al.  An Evolving-Construction Scheme for Fuzzy Systems , 2010 .

[23]  Maryam Kiani,et al.  Adaptive Square-Root Cubature–Quadrature Kalman Particle Filter for satellite attitude determination using vector observations , 2014 .

[24]  Patricia Melin,et al.  Optimization of type-1, interval type-2 and general type-2 fuzzy inference systems using a hierarchical genetic algorithm for modular granular neural networks , 2018, Granular Computing.

[25]  Chia-Feng Juang,et al.  A Self-Evolving Interval Type-2 Fuzzy Neural Network With Online Structure and Parameter Learning , 2008, IEEE Transactions on Fuzzy Systems.

[26]  Oscar Castillo,et al.  General Type-2 Fuzzy Edge Detection in the Preprocessing of a Face Recognition System , 2017, Nature-Inspired Design of Hybrid Intelligent Systems.

[27]  Mahdi Mahfouf,et al.  Psychophysiologically Based Real-Time Adaptive General Type 2 Fuzzy Modeling and Self-Organizing Control of Operator's Performance Undertaking a Cognitive Task , 2017, IEEE Transactions on Fuzzy Systems.

[28]  Okyay Kaynak,et al.  Robust ${H_\infty }$-Based Synchronization of the Fractional-Order Chaotic Systems by Using New Self-Evolving Nonsingleton Type-2 Fuzzy Neural Networks , 2016, IEEE Transactions on Fuzzy Systems.

[29]  Xiao-Jun Zeng,et al.  A simplified structure evolving method for Mamdani fuzzy system identification and its application to high-dimensional problems , 2013, Inf. Sci..

[30]  Visakan Kadirkamanathan,et al.  A Function Estimation Approach to Sequential Learning with Neural Networks , 1993, Neural Computation.

[31]  Oscar Castillo,et al.  Edge Detection Method Based on General Type-2 Fuzzy Logic Applied to Color Images , 2017, Inf..

[32]  Derong Liu,et al.  Self-tuned local feedback gain based decentralized fault tolerant control for a class of large-scale nonlinear systems , 2017, Neurocomputing.

[33]  Minghao Chen,et al.  Constructing optimized interval type-2 TSK neuro-fuzzy systems with noise reduction property by quantum inspired BFA , 2016, Neurocomputing.

[34]  Shovan Bhaumik,et al.  Cubature quadrature Kalman filter , 2013, IET Signal Process..

[35]  Amit Konar,et al.  Secondary factor induced stock index time-series prediction using Self-Adaptive Interval Type-2 Fuzzy Sets , 2016, Neurocomputing.

[36]  Mojtaba Ahmadieh Khanesar,et al.  Levenberg-Marquardt training method for Type-2 fuzzy neural networks and its stability analysis , 2015, 2015 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[37]  Francisco Herrera,et al.  Solving Electrical Distribution Problems Using Hybrid Evolutionary Data Analysis Techniques , 2004, Applied Intelligence.

[38]  Oscar Castillo,et al.  A New Method for Parameterization of General Type-2 Fuzzy Sets , 2018 .

[39]  Plamen P. Angelov,et al.  Simpl_eTS: a simplified method for learning evolving Takagi-Sugeno fuzzy models , 2005, The 14th IEEE International Conference on Fuzzy Systems, 2005. FUZZ '05..

[40]  Oscar Castillo,et al.  Optimization of type-2 fuzzy weights in backpropagation learning for neural networks using GAs and PSO , 2016, Appl. Soft Comput..

[41]  Hak-Keung Lam,et al.  Classification of epilepsy seizure phase using interval type-2 fuzzy support vector machines , 2016, Neurocomputing.

[42]  Thor I. Fossen,et al.  Feedback Linearization Control for Systems with Mismatched Uncertainties via Disturbance Observers , 2019, ArXiv.

[43]  Frederick E. Daum,et al.  Extended Kalman Filters , 2015, Encyclopedia of Systems and Control.

[44]  Mojtaba Ahmadieh Khanesar,et al.  Identification of Nonlinear Dynamic Systems Using Type-2 Fuzzy Neural Networks—A Novel Learning Algorithm and a Comparative Study , 2015, IEEE Transactions on Industrial Electronics.

[45]  Yang Chen,et al.  Forecasting by general type-2 fuzzy logic systems optimized with QPSO algorithms , 2017 .

[46]  Joarder Kamruzzaman,et al.  A hybrid of multiobjective Evolutionary Algorithm and HMM-Fuzzy model for time series prediction , 2012, Neurocomputing.

[47]  Zhigang Zeng,et al.  Advances in Neural Networks, Intelligent Control and Information Processing , 2016, Neurocomputing.

[48]  Patricia Melin,et al.  A hybrid learning method composed by the orthogonal least-squares and the back-propagation learning algorithms for interval A2-C1 type-1 non-singleton type-2 TSK fuzzy logic systems , 2015, Soft Comput..

[49]  Robert Ivor John,et al.  Learning of interval and general type-2 fuzzy logic systems using simulated annealing: Theory and practice , 2016, Inf. Sci..

[50]  D.P. Filev,et al.  An approach to online identification of Takagi-Sugeno fuzzy models , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[51]  Oscar Castillo,et al.  High order α-planes integration: A new approach to computational cost reduction of General Type-2 Fuzzy Systems , 2018, Eng. Appl. Artif. Intell..

[52]  Mahmood Otadi Fully fuzzy polynomial regression with fuzzy neural networks , 2014, Neurocomputing.

[53]  Junfei Qiao,et al.  A self-organizing interval Type-2 fuzzy-neural-network for modeling nonlinear systems , 2018, Neurocomputing.

[54]  Oscar Castillo,et al.  Finishing mill strip gage setup and control by interval type-1 non-singleton type-2 fuzzy logic systems , 2014, Appl. Soft Comput..

[55]  Patricia Melin,et al.  Non-singleton Interval Type-2 Fuzzy Systems as Integration Methods in Modular Neural Networks Used Genetic Algorithms to Design , 2017, Nature-Inspired Design of Hybrid Intelligent Systems.

[56]  Chih-Min Lin,et al.  Self-evolving function-link interval type-2 fuzzy neural network for nonlinear system identification and control , 2017, Neurocomputing.

[57]  Longbing Cao,et al.  T2FELA: Type-2 Fuzzy Extreme Learning Algorithm for Fast Training of Interval Type-2 TSK Fuzzy Logic System , 2014, IEEE Transactions on Neural Networks and Learning Systems.