Automatic Prosody Boundary Labeling of Mandarin Using Both Text and Acoustic Information

Prosody is an important factor for a high quality text-to- speech (TTS) system. Prosody is often described with a hierarchical structure. So the generation of the hierarchical prosody structure is very important both in the corpus building and the real-time text analysis, but the prosody labeling procedure is laborious and time consuming. In this paper, an automatic prosody boundary label system is presented, in which the classification and regression tree (CART) framework is used. In this system, we build a prosody model using acoustic information and the text information based on large speech corpus with prosodic structure label (ASCCD). Experiments show this model can achieve prosody boundary detection 90.86% accuracy.

[1]  Mari Ostendorf,et al.  Automatic labeling of prosodic patterns , 1994, IEEE Trans. Speech Audio Process..

[2]  Paul Taylor,et al.  The tilt intonation model , 1998, ICSLP.

[3]  Mari Ostendorf,et al.  TOBI: a standard for labeling English prosody , 1992, ICSLP.

[4]  Shrikanth S. Narayanan,et al.  Automatic Prosodic Event Detection Using Acoustic, Lexical, and Syntactic Evidence , 2008, IEEE Transactions on Audio, Speech, and Language Processing.

[5]  Bo Xu,et al.  Study on prosodic boundary location in Chinaese mandarin , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[6]  Francis Nolan,et al.  IVie - a comparative transcription system for intonational variation in English , 1998, ICSLP.

[7]  Wei Zhang,et al.  Automatic prosody labeling using both text and acoustic information , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[8]  Shrikanth S. Narayanan,et al.  Exploiting Acoustic and Syntactic Features for Automatic Prosody Labeling in a Maximum Entropy Framework , 2008, IEEE Transactions on Audio, Speech, and Language Processing.

[9]  LIU Yabin Cues of Prosodic Boundaries in Chi , 2003 .