The contribution of mutual information in the intonational phrase prediction in Chinese text

The contribution of mutual information (MI) in the intonational phrase (IP) prediction is analyzed and verified. The basic idea of employing MI in IP prediction is that people are likely to pause between the less correlated words, where the MI value is low. We present a decision tree based predictor which adopts POS as the main feature firstly as the baseline, and then we analyze the correlation between MI and IP. The approach which only bases on the MI to predict the IP boundary is demonstrated, and three methods combining the MI and POS in the predictor is presented too. In the MI based approach, a considerable performance (F-Score: 64.2%) is achieved, and 3.4% promotion from the baseline is achieved after combining MI and POS in our experiment. All our work indicates that MI is an effective feature in the prosodic phrase boundaries prediction in Chinese text, and combining the MI and POS in the predictor is valuable.

[1]  Mari Ostendorf,et al.  A Hierarchical Stochastic Model for Automatic Prediction of Prosodic Boundary Location , 1994, CL.

[2]  James Paul Gee,et al.  Performance structures: A psycholinguistic and linguistic appraisal , 1983, Cognitive Psychology.

[3]  Eileen Fitzpatrick,et al.  Parsing for prosody: what a text-to-speech system needs from syntax , 1989, [1989] Proceedings. The Annual AI Systems in Government Conference.

[4]  Paul Taylor,et al.  Assigning phrase breaks from part-of-speech sequences , 1997, Comput. Speech Lang..

[5]  Elisabeth Selkirk,et al.  Phonology and Syntax: The Relation between Sound and Structure , 1984 .

[6]  Kenneth Ward Church,et al.  A comparison of the enhanced Good-Turing and deleted estimation methods for estimating probabilities of English bigrams , 1991 .

[7]  Chu Min.  A text-to-speech system with high intelligibility and naturalness for Chinese , 1996 .

[8]  Min Chu,et al.  Locating Boundaries for Prosodic Constituents in Unrestricted Mandarin Texts , 2001, Int. J. Comput. Linguistics Chin. Lang. Process..

[9]  Keh-Yih Su,et al.  Corpus-based Automatic Compound Extraction with Mutual Information and Relative Frequency Count , 1993, ROCLING/IJCLCLP.

[10]  K. McKeown,et al.  Learning Intonation Rules for Concept to Speech Generation , 2022, COLING.

[11]  Mill Johannes G.A. Van,et al.  Transmission Of Information , 1961 .

[12]  Amiel Feinstein,et al.  Transmission of Information. , 1962 .

[13]  Slava M. Katz,et al.  Estimation of probabilities from sparse data for the language model component of a speech recognizer , 1987, IEEE Trans. Acoust. Speech Signal Process..

[15]  Nicoletta Calzolari,et al.  Acquisition of Lexical Information from a Large Textual Italian Corpus , 1990, COLING.

[16]  M. Ostendorf,et al.  Markov modeling of prosodic phrase structure , 1990, International Conference on Acoustics, Speech, and Signal Processing.

[17]  J. Cleary,et al.  \self-organized Language Modeling for Speech Recognition". In , 1997 .

[18]  Ronald Rosenfeld,et al.  Statistical language modeling using the CMU-cambridge toolkit , 1997, EUROSPEECH.

[19]  Julia Hirschberg,et al.  Training intonational phrasing rules automatically for English and Spanish text-to-speech , 1996, Speech Commun..

[20]  Lee-Feng Chien,et al.  PAT-tree-based keyword extraction for Chinese information retrieval , 1997, SIGIR '97.

[21]  Frederick Jelinek,et al.  Self-organizing language modeling for speech recognition , 1990 .

[22]  Julia Hirschberg,et al.  Exploring features from natural language generation for prosody modeling , 2002, Comput. Speech Lang..

[24]  Yung-Hwan Oh,et al.  Tree-based modeling of prosodic phrasing and segmental duration for Korean TTS systems , 1999, Speech Commun..

[25]  Xu Bo,et al.  A CART_Based Hierarchical Stochastic Model for Prosodic Phrasing in Chinese 1 , 2000 .

[26]  Julia Hirschberg,et al.  Predicting Intonational Phrasing from Text , 1991, ACL.

[27]  Mitchell P. Marcus,et al.  Parsing a Natural Language Using Mutual Information Statistics , 1990, AAAI.

[28]  Wang Jian-qi.  On Chinese Language Processing , 2003 .