Extending the punctuation module for european portuguese

This paper describes our recent work on extending the punctuation module of automatic subtitles for Portuguese Broadcast News. The main improvement was achieved by the use of prosodic information. This enabled the extension of the previous module which covered only full stops and commas, to cover question marks as well. The approach uses lexical, acoustic and prosodic information. Our results show that the latter is relevant for all types of punctuation. An analysis of the results also shows what type of interrogative is better dealt with by our method, taking into account the specificities of Portuguese. This may lead to different results for different types of corpora, depending on the types of interrogatives that are more frequent.

[1]  Fernando Batista,et al.  Comparing automatic rich transcription for Portuguese, Spanish and English Broadcast News , 2009, 2009 IEEE Workshop on Automatic Speech Recognition & Understanding.

[2]  Mattias Heldner,et al.  Boundaries and groupings: the structuring of speech in different communicative situations. A description of the GROG project , 2002 .

[3]  João Paulo da Silva Neto,et al.  Incorporating acoustical modelling of phone transitions in an hybrid ANN/HMM speech recognizer , 2008, INTERSPEECH.

[4]  Gökhan Tür,et al.  Prosody-based automatic segmentation of speech into sentences and topics , 2000, Speech Commun..

[5]  Isabel Trancoso,et al.  THE DEVELOPMENT OF AN AUTOMATIC SYSTEM FOR SELECTIVE DISSEMINATION OF MULTIMEDIA INFORMATION , 2003 .

[6]  Estelle Campione,et al.  A large-scale multilingual study of silent pause duration , 2002, Speech Prosody 2002.

[7]  Dilek Z. Hakkani-Tür,et al.  Speech segmentation and spoken document processing , 2008, IEEE Signal Processing Magazine.

[8]  Yoshihiko Gotoh,et al.  Sentence Boundary Detection in Broadcast Speech Transcripts , 2000 .

[9]  João Paulo da Silva Neto,et al.  Evaluation of a live broadcast news subtitling system for portuguese , 2008, INTERSPEECH.

[10]  Michiel Bacchiani,et al.  Restoring punctuation and capitalization in transcribed speech , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[11]  Jacqueline Vaissière,et al.  Language-Independent Prosodic Features , 1983 .

[12]  Andreas Stolcke,et al.  Enriching speech recognition with automatic detection of sentence boundaries and disfluencies , 2006, IEEE Transactions on Audio, Speech, and Language Processing.

[13]  Heidi Christensen,et al.  Punctuation annotation using statistical prosody models. , 2001 .

[14]  Ralph Weischedel,et al.  PERFORMANCE MEASURES FOR INFORMATION EXTRACTION , 2007 .

[15]  Geoffrey Zweig,et al.  Maximum entropy model for punctuation annotation from speech , 2002, INTERSPEECH.

[16]  Hal Daumé.  Notes on CG and LM-BFGS Optimization of Logistic Regression , 2008 .

[17]  Fernando Batista,et al.  Recovering capitalization and punctuation marks for automatic speech recognition: Case study for Portuguese broadcast news , 2008, Speech Commun..

[18]  Dilek Z. Hakkani-Tür,et al.  Any questions? Automatic question detection in meetings , 2009, 2009 IEEE Workshop on Automatic Speech Recognition & Understanding.

[19]  Dilek Z. Hakkani-Tür,et al.  Syntactically-informed models for comma prediction , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[20]  Ji-Hwan Kim,et al.  The use of prosody in a combined system for punctuation generation and speech recognition , 2001, INTERSPEECH.

[21]  Ricardo Ribeiro,et al.  Using Morphossyntactic Information in TTS Systems: Comparing Stratgies for European Portuguese , 2003, PROPOR.

[22]  Dilek Z. Hakkani-Tür,et al.  Prosodic Similarities of Dialog Act Boundaries Across Speaking Styles , 2008 .

[23]  Shrikanth S. Narayanan,et al.  A multi-pass linear fold algorithm for sentence boundary detection using prosodic cues , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.