Dual-Discriminability-Analysis Type-2 Fuzzy-Neural-Network Based Speech Classification for Human-Machine Interaction

Speech detection and speech recognition are two important classification problems in human-robot interaction. They are easily affected by the noisy environment. To solve this problem, a dual-discriminability-analysis type-2 fuzzy neural network (DDA2FNN) is presented to solve the problem of noisy data classification. In handing problems with uncertainties such as noisy data, type-2 fuzzy-systems generally outperform their type-1 counterparts. Hence, type-2 fuzzy-sets are adopted in the antecedent parts to model the noisy data. The most important consideration for classification problems is the “discriminability”. To enhance the “discriminability”, a dual-discriminability-analysis (DDA) method is proposed in the consequent parts. The novelty of DDA is its consideration of both linear-discriminant-analysis (LDA) and minimum-classification-error (MCE). The proposed dual-discriminability-analysis type-2 fuzzy rule includes an LDA-matrix and an MCE-matrix. Compared with other existing fuzzy neural networks, the novelty of the proposed DDA2FNN is its consideration of both uncertainty and discriminability. The effectiveness of the proposed DDA2FNN is demonstrated by two speech classification problems. Experimental results and theoretical analysis indicate that the proposed DDA2FNN performs better than the other fuzzy neural networks.

[1]  Chin-Teng Lin,et al.  Support-vector-based fuzzy neural network for pattern classification , 2006, IEEE Transactions on Fuzzy Systems.

[2]  Chunyan Miao,et al.  An Extension to Fuzzy Cognitive Maps for Classification and Prediction , 2011, IEEE Transactions on Fuzzy Systems.

[3]  Chia-Feng Juang,et al.  An Interval Type-2 Fuzzy-Neural Network With Support-Vector Regression for Noisy Regression Problems , 2010, IEEE Transactions on Fuzzy Systems.

[4]  Alain Biem,et al.  Minimum classification error training for online handwriting recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Giuseppe Pirlo,et al.  Fuzzy-Zoning-Based Classification for Handwritten Characters , 2011, IEEE Transactions on Fuzzy Systems.

[6]  Chia-Feng Juang,et al.  Speech detection in noisy environments by wavelet energy-based recurrent neural fuzzy network , 2009, Expert Syst. Appl..

[7]  Hidetomo Ichihashi,et al.  Fuzzy PCA-Guided Robust $k$-Means Clustering , 2010, IEEE Transactions on Fuzzy Systems.

[8]  Faa-Jeng Lin,et al.  Adaptive Control of Two-Axis Motion Control System Using Interval Type-2 Fuzzy Neural Network , 2009, IEEE Transactions on Industrial Electronics.

[9]  Chin-Teng Lin,et al.  An online self-constructing neural fuzzy inference network and its applications , 1998, IEEE Trans. Fuzzy Syst..

[10]  Mohammad Teshnehlab,et al.  Training ANFIS as an identifier with intelligent hybrid stable learning algorithm based on particle swarm optimization and extended Kalman filter , 2009, Fuzzy Sets Syst..

[11]  Chia-Feng Juang,et al.  Reinforcement Interval Type-2 Fuzzy Controller Design by Online Rule Generation and Q-Value-Aided Ant Colony Optimization , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[12]  Herman J. M. Steeneken,et al.  Assessment for automatic speech recognition: II. NOISEX-92: A database and an experiment to study the effect of additive noise on speech recognition systems , 1993, Speech Commun..

[13]  Jesús Alcalá-Fdez,et al.  A Fuzzy Association Rule-Based Classification Model for High-Dimensional Problems With Genetic Rule Selection and Lateral Tuning , 2011, IEEE Transactions on Fuzzy Systems.

[14]  Yang-Yin Lin,et al.  A Recurrent Self-Evolving Interval Type-2 Fuzzy Neural Network for Dynamic System Processing , 2009, IEEE Transactions on Fuzzy Systems.

[15]  Qiang Shen,et al.  Fuzzy-rough data reduction with ant colony optimization , 2005, Fuzzy Sets Syst..

[16]  Chin-Teng Lin,et al.  A recurrent neural fuzzy network for word boundary detection in variable noise-level environments , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[17]  Jing Huang,et al.  Audio-visual deep learning for noise robust speech recognition , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[18]  Zhang Yi,et al.  A Family of Fuzzy Learning Algorithms for Robust Principal Component Analysis Neural Networks , 2010, IEEE Transactions on Fuzzy Systems.

[19]  Chin-Teng Lin,et al.  GA-based noisy speech recognition using two-dimensional cepstrum , 2000, IEEE Trans. Speech Audio Process..

[20]  Roelof K. Brouwer,et al.  Modified fuzzy c-means for ordinal valued attributes with particle swarm for optimization , 2010, Fuzzy Sets Syst..

[21]  Chia-Feng Juang,et al.  A Self-Evolving Interval Type-2 Fuzzy Neural Network With Online Structure and Parameter Learning , 2008, IEEE Transactions on Fuzzy Systems.

[22]  Jerry M. Mendel,et al.  Computing derivatives in interval type-2 fuzzy logic systems , 2004, IEEE Transactions on Fuzzy Systems.

[23]  Xiaowei Yang,et al.  A Kernel Fuzzy c-Means Clustering-Based Fuzzy Support Vector Machine Algorithm for Classification Problems With Outliers or Noises , 2011, IEEE Transactions on Fuzzy Systems.

[24]  Chia-Feng Juang,et al.  Recurrent type-2 fuzzy neural network using Haar wavelet energy and entropy features for speech detection in noisy environments , 2012, Expert Syst. Appl..

[25]  Hao Ying,et al.  Derivation and Analysis of the Analytical Structures of the Interval Type-2 Fuzzy-PI and PD Controllers , 2010, IEEE Transactions on Fuzzy Systems.

[26]  Jeih-Weih Hung,et al.  Optimization of temporal filters for constructing robust features in speech recognition , 2006, IEEE Transactions on Audio, Speech, and Language Processing.

[27]  Kun-Ching Wang.  A Novel Approach Based on Adaptive Long-Term Sub-Band Entropy and Multi-Thresholding Scheme for Detecting Speech Signal , 2012, IEICE Trans. Inf. Syst..

[28]  Geoffrey E. Hinton,et al.  Acoustic Modeling Using Deep Belief Networks , 2012, IEEE Transactions on Audio, Speech, and Language Processing.

[29]  Gin-Der Wu,et al.  A TS-Type Maximizing-Discriminability-Based Recurrent Fuzzy Network for Classification Problems , 2011, IEEE Transactions on Fuzzy Systems.

[30]  Nelson Morgan,et al.  Deep and Wide: Multiple Layers in Automatic Speech Recognition , 2012, IEEE Transactions on Audio, Speech, and Language Processing.

[31]  Chia-Feng Juang,et al.  A Self-Organizing TS-Type Fuzzy Network With Support Vector Learning and its Application to Classification Problems , 2007, IEEE Transactions on Fuzzy Systems.

[32]  Chia-Feng Juang,et al.  Zero-order TSK-type fuzzy system learning using a two-phase swarm intelligence algorithm , 2008, Fuzzy Sets Syst..

[33]  Sung-Kwun Oh,et al.  Polynomial-based radial basis function neural networks (P-RBF NNs) realized with the aid of particle swarm optimization , 2011, Fuzzy Sets Syst..

[34]  Jung-Hsien Chiang,et al.  Support vector learning mechanism for fuzzy rule-based modeling: a new approach , 2004, IEEE Transactions on Fuzzy Systems.

[35]  Yixin Chen,et al.  Support vector learning for fuzzy rule-based classification systems , 2003, IEEE Trans. Fuzzy Syst..

[36]  Chin-Teng Lin,et al.  Word boundary detection with mel-scale frequency bank in noisy environment , 2000, IEEE Trans. Speech Audio Process..

[37]  Chin-Teng Lin,et al.  An On-Line Self-Constructing Neural Fuzzy Inference Network and Its Applications , 1998 .

[38]  Jeih-Weih Hung,et al.  Comparative analysis for data-driven temporal filters obtained via principal component analysis (PCA) and linear discriminant analysis (LDA) in speech recognition , 2001, INTERSPEECH.

[39]  Jerry M. Mendel,et al.  On the Stability of Interval Type-2 TSK Fuzzy Logic Control Systems , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[40]  Gin-Der Wu,et al.  A Maximizing-Discriminability-Based Self-Organizing Fuzzy Network for Classification Problems , 2010, IEEE Transactions on Fuzzy Systems.