An enhanced discriminability recurrent fuzzy neural network for temporal classification problems

This paper proposes an enhanced discriminability recurrent fuzzy neural network for temporal classification problems. To consider classification problems, the most important consideration is the ''discriminability''. To enhance the ''discriminability'', the feedback topology of the proposed fuzzy neural network is fully connected in order to handle temporal pattern behavior. Furthermore, the proposed fuzzy neural network considers minimum-classification-error and minimum-training-error. In minimum-classification-error, the weights are updated by maximizing the discrimination among different classes. In minimum-training-error, the parameter learning adopts the gradient descent method to reduce the cost function. Therefore, the novelty of the enhanced discriminability recurrent fuzzy neural network is that it not only minimizes the cost function but also maximizes the discriminability. It is constructed from structure and parameter learning. Simulations and comparisons with other recurrent fuzzy neural networks verify the performance of the enhanced discriminability recurrent fuzzy neural network under noisy conditions. Analysis results indicate that the proposed fuzzy neural network exhibits excellent classification performance.

[1]  Ching-Hung Lee,et al.  Identification and control of dynamic systems using recurrent fuzzy neural networks , 2000, IEEE Trans. Fuzzy Syst..

[2]  Chia-Feng Juang,et al.  A Self-Organizing TS-Type Fuzzy Network With Support Vector Learning and its Application to Classification Problems , 2007, IEEE Transactions on Fuzzy Systems.

[3]  Chia-Feng Juang,et al.  Water bath temperature control by a recurrent fuzzy controller and its FPGA implementation , 2006, IEEE Transactions on Industrial Electronics.

[4]  Chia-Feng Juang,et al.  Zero-order TSK-type fuzzy system learning using a two-phase swarm intelligence algorithm , 2008, Fuzzy Sets Syst..

[5]  Cheng-Jian Lin,et al.  Prediction and identification using wavelet-based recurrent fuzzy neural networks , 2004, IEEE Trans. Syst. Man Cybern. Part B.

[6]  Sung-Kwun Oh,et al.  Polynomial-based radial basis function neural networks (P-RBF NNs) realized with the aid of particle swarm optimization , 2011, Fuzzy Sets Syst..

[7]  Chin-Teng Lin,et al.  An online self-constructing neural fuzzy inference network and its applications , 1998, IEEE Trans. Fuzzy Syst..

[8]  George C. Mouzouris,et al.  Dynamic non-Singleton fuzzy logic systems for nonlinear modeling , 1997, IEEE Trans. Fuzzy Syst..

[9]  Yixin Chen,et al.  Support vector learning for fuzzy rule-based classification systems , 2003, IEEE Trans. Fuzzy Syst..

[10]  Jung-Hsien Chiang,et al.  Support vector learning mechanism for fuzzy rule-based modeling: a new approach , 2004, IEEE Trans. Fuzzy Syst..

[11]  Chia-Feng Juang,et al.  Reinforcement Interval Type-2 Fuzzy Controller Design by Online Rule Generation and Q-Value-Aided Ant Colony Optimization , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[12]  Chia-Feng Juang,et al.  A TSK-type recurrent fuzzy network for dynamic systems processing by neural network and genetic algorithms , 2002, IEEE Trans. Fuzzy Syst..

[13]  Chin-Teng Lin,et al.  A recurrent neural fuzzy network for word boundary detection in variable noise-level environments , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[14]  Chin-Teng Lin,et al.  A recurrent self-organizing neural fuzzy inference network , 1999, IEEE Trans. Neural Networks.

[15]  Jerry M. Mendel,et al.  On the Stability of Interval Type-2 TSK Fuzzy Logic Control Systems , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[16]  Gin-Der Wu,et al.  A Maximizing-Discriminability-Based Self-Organizing Fuzzy Network for Classification Problems , 2010, IEEE Transactions on Fuzzy Systems.

[17]  Chin-Teng Lin,et al.  Word boundary detection with mel-scale frequency bank in noisy environment , 2000, IEEE Trans. Speech Audio Process..

[18]  Chia-Feng Juang,et al.  Hierarchical Singleton-Type Recurrent Neural Fuzzy Networks for Noisy Speech Recognition , 2007, IEEE Transactions on Neural Networks.

[19]  Chin-Teng Lin,et al.  Support-vector-based fuzzy neural network for pattern classification , 2006, IEEE Transactions on Fuzzy Systems.

[20]  Alain Biem,et al.  Minimum classification error training for online handwriting recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Faa-Jeng Lin,et al.  Adaptive Control of Two-Axis Motion Control System Using Interval Type-2 Fuzzy Neural Network , 2009, IEEE Transactions on Industrial Electronics.

[22]  Paris A. Mastorocostas,et al.  A recurrent fuzzy-neural model for dynamic system identification , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[23]  Yang-Yin Lin,et al.  A recurrent self-evolving fuzzy neural network with local feedbacks and its application to dynamic system processing , 2010, Fuzzy Sets Syst..

[24]  Jeih-Weih Hung,et al.  Optimization of temporal filters for constructing robust features in speech recognition , 2006, IEEE Transactions on Audio, Speech, and Language Processing.

[25]  Roelof K. Brouwer,et al.  Modified fuzzy c-means for ordinal valued attributes with particle swarm for optimization , 2010, Fuzzy Sets Syst..

[26]  Qiang Shen,et al.  Fuzzy-rough data reduction with ant colony optimization , 2005, Fuzzy Sets Syst..

[27]  Herman J. M. Steeneken,et al.  Assessment for automatic speech recognition: II. NOISEX-92: A database and an experiment to study the effect of additive noise on speech recognition systems , 1993, Speech Commun..

[28]  Meng Joo Er,et al.  NARMAX time series model prediction: feedforward and recurrent fuzzy neural network approaches , 2005, Fuzzy Sets Syst..

[29]  Yang-Yin Lin,et al.  A Recurrent Self-Evolving Interval Type-2 Fuzzy Neural Network for Dynamic System Processing , 2009, IEEE Transactions on Fuzzy Systems.

[30]  Jie Zhang,et al.  Recurrent neuro-fuzzy networks for nonlinear process modeling , 1999, IEEE Trans. Neural Networks.

[31]  Gin-Der Wu,et al.  A TS-Type Maximizing-Discriminability-Based Recurrent Fuzzy Network for Classification Problems , 2011, IEEE Transactions on Fuzzy Systems.

[32]  Hao Ying,et al.  Derivation and Analysis of the Analytical Structures of the Interval Type-2 Fuzzy-PI and PD Controllers , 2010, IEEE Transactions on Fuzzy Systems.

[33]  Ying-Chung Wang,et al.  Direct adaptive iterative learning control of nonlinear systems using an output-recurrent fuzzy neural network , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[34]  Chia-Feng Juang,et al.  An Interval Type-2 Fuzzy-Neural Network With Support-Vector Regression for Noisy Regression Problems , 2010, IEEE Transactions on Fuzzy Systems.

[35]  Mohammad Teshnehlab,et al.  Training ANFIS as an identifier with intelligent hybrid stable learning algorithm based on particle swarm optimization and extended Kalman filter , 2009, Fuzzy Sets Syst..

[36]  Marcos Angel Gonzalez-Olvera,et al.  A new recurrent neurofuzzy network for identification of dynamic systems , 2007, Fuzzy Sets Syst..