Identification of Question and Non-Question Segments in Arabic Monologues Using Prosodic Features: Novel Type-2 Fuzzy Logic and Sensitivity-Based Linear Learning Approaches

In this paper, we extend our previous study of addressing the important problem of automatically identifying question and non-question segments in Arabic monologues using prosodic features. We propose here two novel classification approaches to this problem: one based on the use of the powerful type-2 fuzzy logic systems (type-2 FLS) and the other on the use of the discriminative sensitivity-based linear learning method (SBLLM). The use of prosodic features has been used in a plethora of practical applications, including speech-related applications, such as speaker and word recognition, emotion and accent identification, topic and sentence segmentation, and text-to-speech applications. In this paper, we continue to specifically focus on the Arabic language, as other languages have received a lot of attention in this regard. Moreover, we aim to improve the performance of our previously-used techniques, of which the support vector machine (SVM) method was the best performing, by applying the two above-mentioned powerful classification approaches. The recorded continuous speech is first segmented into sentences using both energy and time duration parameters. The prosodic features are then extracted from each sentence and fed into each of the two proposed classifiers so as to classify each sentence as a Question or a Non-Question sentence. Our extensive simulation work, based on a moderately-sized database, showed the two proposed classifiers outperform SVM in all of the experiments carried out, with the type-2 FLS classifier consistently exhibiting the best performance, because of its ability to handle all forms of uncertainties.

[1]  Andreas Stolcke,et al.  Can Prosody Aid the Automatic Classification of Dialog Acts in Conversational Speech? , 1998, Language and speech.

[2]  Ian Witten,et al.  Data Mining , 2000 .

[3]  Enrique F. Castillo,et al.  Sensitivity analysis in discrete Bayesian networks , 1997, IEEE Trans. Syst. Man Cybern. Part A.

[4]  Jerry M. Mendel,et al.  New results about the centroid of an interval type-2 fuzzy set, including the centroid of a fuzzy granule , 2007, Inf. Sci..

[5]  J. Mendel Uncertain Rule-Based Fuzzy Logic Systems: Introduction and New Directions , 2001 .

[6]  Feilong Liu,et al.  An efficient centroid type-reduction strategy for general type-2 fuzzy logic system , 2008, Inf. Sci..

[7]  Vladik Kreinovich,et al.  Interval-Valued Degrees of Belief: Applications of Interval Computations to Expert Systems and Intelligent Control , 1997, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[8]  Lotfi A. Zadeh,et al.  The Concepts of a Linguistic Variable and its Application to Approximate Reasoning , 1975 .

[9]  Shrikanth S. Narayanan,et al.  Toward detecting emotions in spoken dialogs , 2005, IEEE Transactions on Speech and Audio Processing.

[10]  Seungsoo Lee,et al.  A Ranking Method for Type-2 Fuzzy Values , 2002 .

[11]  Jerry M. Mendel,et al.  Centroid of a type-2 fuzzy set , 2001, Inf. Sci..

[12]  Jerry M. Mendel,et al.  A vector similarity measure for linguistic approximation: Interval type-2 and type-1 fuzzy sets , 2008, Inf. Sci..

[13]  M. Swerts Prosodic features at discourse boundaries of different strength. , 1997, The Journal of the Acoustical Society of America.

[14]  L. A. ZADEH,et al.  The concept of a linguistic variable and its application to approximate reasoning - I , 1975, Inf. Sci..

[15]  Jerry M. Mendel,et al.  Computing with words and its relationships with fuzzistics , 2007, Inf. Sci..

[16]  Ali Selamat,et al.  Modeling the permeability of carbonate reservoir using type-2 fuzzy logic systems , 2011, Comput. Ind..

[17]  Jerry M. Mendel,et al.  Type-2 fuzzy logic systems , 1999, IEEE Trans. Fuzzy Syst..

[18]  E. Castillo,et al.  Working with differential, functional and difference equations using functional networks , 1999 .

[19]  Jerry M. Mendel,et al.  Type-2 fuzzy sets made simple , 2002, IEEE Trans. Fuzzy Syst..

[20]  Oscar Castillo,et al.  Type-2 Fuzzy Logic , 2007 .

[21]  M MendelJerry,et al.  A vector similarity measure for linguistic approximation , 2008 .

[22]  Jerry M. Mendel,et al.  Interval type-2 fuzzy logic systems , 2000, Ninth IEEE International Conference on Fuzzy Systems. FUZZ- IEEE 2000 (Cat. No.00CH37063).

[23]  Silvia Pfeiffer,et al.  Pause concepts for audio segmentation at different semantic levels , 2001, MULTIMEDIA '01.

[24]  J. Mendel,et al.  Overcoming time-varying co-channel interference using type-2 fuzzy adaptive filters , 2000 .

[25]  อนิรุธ สืบสิงห์,et al.  Data Mining Practical Machine Learning Tools and Techniques , 2014 .

[26]  Enrique F. Castillo,et al.  A General Method for Local Sensitivity Analysis With Application to Regression Models and Other Optimization Problems , 2004, Technometrics.

[27]  Amparo Alonso-Betanzos,et al.  A Very Fast Learning Method for Neural Networks Based on Sensitivity Analysis , 2006, J. Mach. Learn. Res..

[28]  Jerry M. Mendel,et al.  Uncertainty measures for interval type-2 fuzzy sets , 2007, Inf. Sci..

[29]  Ali Selamat,et al.  A Hybrid Model through the Fusion of Type-2 Fuzzy Logic Systems and Sensitivity-Based Linear Learning Method for Modeling PVT Properties of Crude Oil Systems , 2012, Adv. Fuzzy Syst..

[30]  Ali Selamat,et al.  Predicting correlations properties of crude oil systems using type-2 fuzzy logic systems , 2011, Expert Syst. Appl..

[31]  Mohammad Hossein Fazel Zarandi,et al.  A type-2 fuzzy rule-based expert system model for stock price analysis , 2009, Expert Syst. Appl..

[32]  L. Cheded,et al.  A PRELIMINARY STUDY OF PROSODY-BASED DETECTION OF QUESTIONS IN ARABIC SPEECH MONOLOGUES , 2010 .

[33]  Jerry M. Mendel,et al.  Connection admission control in ATM networks using survey-based type-2 fuzzy logic systems , 2000, IEEE Trans. Syst. Man Cybern. Part C.

[34]  Rosalind W. Picard,et al.  Dialog Act Classification from Prosodic Features Using Support Vector Machines , 2002 .

[35]  Jerry M. Mendel,et al.  Equalization of nonlinear time-varying channels using type-2 fuzzy adaptive filters , 2000, IEEE Trans. Fuzzy Syst..

[36]  H. Carter Fuzzy Sets and Systems — Theory and Applications , 1982 .

[37]  Oscar Castillo,et al.  Type-2 Fuzzy Logic in Intelligent Control Applications , 2011, Studies in Fuzziness and Soft Computing.

[38]  Jerry M. Mendel,et al.  Fuzzy sets for words: a new beginning , 2003, The 12th IEEE International Conference on Fuzzy Systems, 2003. FUZZ '03..

[39]  Wasfi G. Al-Khatib,et al.  Detection of Questions in Arabic Audio Monologues Using Prosodic Features , 2007, ISM 2007.

[40]  Ali Selamat,et al.  Modeling the correlations of crude oil properties based on sensitivity based linear learning method , 2011, Eng. Appl. Artif. Intell..

[41]  E. Cox Adaptive fuzzy systems , 1993, IEEE Spectrum.