Automatic dialogue act recognition with syntactic features

This work studies the usefulness of syntactic information in the context of automatic dialogue act recognition in Czech. Several pieces of evidence are presented in this work that support our claim that syntax might bring valuable information for dialogue act recognition. In particular, a parallel is drawn with the related domain of automatic punctuation generation and a set of syntactic features derived from a deep parse tree is further proposed and successfully used in a Czech dialogue act recognition system based on conditional random fields. We finally discuss the possible reasons why so few works have exploited this type of information before and propose future research directions to further progress in this area.

[1]  Toine Andernach.  A Machine Learning Approach to the Classification of Dialogue Utterances , 1996, ArXiv.

[2]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[3]  Roger K. Moore,et al.  A theory of word frequencies and its application to dialogue move recognition , 1996, Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96.

[4]  R. Power.  The organisation of purposeful dialogues , 1979 .

[5]  David Traum,et al.  Speech Acts for Dialogue Agents , 1999 .

[6]  Steve Renals,et al.  Recognition of Dialogue Acts in Multiparty Meetings Using a Switching DBN , 2008, IEEE Transactions on Audio, Speech, and Language Processing.

[7]  Eva Hajičová.  Dependency-based underlying-structure tagging of a very large Czech corpus , 2000 .

[8]  Barbara Di Eugenio,et al.  Dialogue Act Classification, Higher Order Dialogue Structure, and Instance-Based Learning , 2010 .

[9]  Dilek Z. Hakkani-Tür,et al.  MODEL ADAPTATION FOR DIALOG ACT TAGGING , 2006, 2006 IEEE Spoken Language Technology Workshop.

[10]  Emiel Krahmer,et al.  Machine Learning for Shallow Interpretation of User Utterances in Spoken Dialogue Systems , 2003 .

[11]  E. Maier,et al.  Dialogue Acts in VERBMOBIL , 1995 .

[12]  Norbert Reithinger,et al.  Insights into the Dialogue Processing of VERBMOBIL , 1997, ANLP.

[13]  Massimo Poesio,et al.  Using high level dialogue information for dialogue act recognition using prosodic features. , 1999 .

[14]  Elmar Nöth,et al.  Automatic classification of dialog acts with semantic classification trees and polygrams , 1995, Learning for Natural Language Processing.

[15]  Virginia Teller.  Review of Speech and language processing: an introduction to natural language processing, computational linguistics, and speech recognition by Daniel Jurafsky and James H. Martin. Prentice Hall 2000. , 2000 .

[16]  Jeff A. Bilmes,et al.  Backoff Model Training using Partially Observed Data: Application to Dialog Act Tagging , 2006, NAACL.

[17]  E. Schegloff,et al.  A simplest systematics for the organization of turn-taking for conversation , 1974 .

[18]  Sandra Carberry,et al.  Plan Recognition in Natural Language Dialogue , 1990 .

[19]  Fabio Pianesi,et al.  The NESPOLE! System for multilingual speech communication over the Internet , 2006, IEEE Transactions on Audio, Speech, and Language Processing.

[20]  E. Schegloff.  Sequencing in Conversational Openings , 1968 .

[21]  Yuji Matsumoto.  MaltParser: A language-independent system for data-driven dependency parsing , 2005 .

[22]  Pavel Král,et al.  Automatic Dialog Acts Recognition Based on Sentence Structure , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[23]  Barbara Di Eugenio,et al.  FLSA: Extending Latent Semantic Analysis with Features for Dialogue Act Classification , 2004, ACL.

[24]  Joseph Y. Halpern.  A Computing Research Repository , 1998, D Lib Mag..

[25]  Gary Geunbae Lee,et al.  Triangular-Chain Conditional Random Fields , 2008, IEEE Transactions on Audio, Speech, and Language Processing.

[26]  Josef van Genabith,et al.  A Linguistically Inspired Statistical Model for Chinese Punctuation Generation , 2010, TALIP.

[27]  David Vilar,et al.  Dialogue act classification using a Bayesian approach ∗ , 2004 .

[28]  Pavel Král,et al.  Commas Recovery with Syntactic Features in French and in Czech , 2011, INTERSPEECH.

[29]  A. Koller,et al.  Speech Acts: An Essay in the Philosophy of Language , 1969 .

[30]  Harry Bunt,et al.  Incremental dialogue act understanding , 2011, IWCS.

[31]  Henry A. Kautz.  A formal theory of plan recognition , 1987 .

[32]  Diane J. Litman,et al.  Plan recognition and discourse analysis: an integrated approach for understanding dialogues , 1986 .

[33]  Shafiq R. Joty,et al.  Unsupervised Modeling of Dialog Acts in Asynchronous Conversations , 2011, IJCAI.

[34]  Jeff A. Bilmes,et al.  Dialog act tagging using graphical models , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[35]  Ralf Kompe,et al.  Prosody in Speech Understanding Systems , 1997, Lecture Notes in Computer Science.

[36]  A. Stolcke,et al.  Automatic detection of discourse structure for speech recognition and understanding , 1997, 1997 IEEE Workshop on Automatic Speech Recognition and Understanding Proceedings.

[37]  Anton Nijholt,et al.  Dialogue Act Recognition with Bayesian Networks for Dutch Dialogues , 2002, SIGDIAL Workshop.

[38]  Pavel Král,et al.  Lexical Structure for Dialogue Act Recognition , 2007, J. Multim..

[39]  Ken Samuel,et al.  Dialogue Act Tagging with Transformation-Based Learning , 1998, ACL.

[40]  Harry Bunt,et al.  Context and Dialogue Control , 1994 .

[41]  Hans Uszkoreit,et al.  Using Syntactic and Semantic based Relations for Dialogue Act Recognition , 2010, COLING.

[42]  Pavel Král,et al.  Combination of classifiers for automatic recognition of dialog acts , 2005, INTERSPEECH.

[43]  Andreas Stolcke,et al.  Dialogue act modeling for automatic tagging and recognition of conversational speech , 2000, CL.

[44]  Helen Wright,et al.  Automatic utterance type detection using suprasegmental features , 1998, ICSLP.

[45]  Dirk Heylen,et al.  DIALOGUE-ACT TAGGING USING SMART FEATURE SELECTION; RESULTS ON MULTIPLE CORPORA , 2006, 2006 IEEE Spoken Language Technology Workshop.

[46]  Giuseppe Riccardi,et al.  Simultaneous dialog act segmentation and classification from human-human spoken conversations , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[47]  Elizabeth Shriberg,et al.  Automatic dialog act segmentation and classification in multiparty meetings , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[48]  Stephen G. Pulman,et al.  Unsupervised Classification of Dialogue Acts using a Dirichlet Process Mixture Model , 2009, SIGDIAL Conference.

[49]  Dilek Z. Hakkani-Tür,et al.  Syntactically-informed models for comma prediction , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[50]  Alon Lavie,et al.  Domain Specific Speech Acts for Spoken Language Translation , 2003, SIGDIAL Workshop.

[51]  Andreas Stolcke,et al.  Joint Segmentation and Classification of Dialog Acts in Multiparty Meetings , 2005, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[52]  J. Kleckova,et al.  Sentence Structure for Dialog Act Recognition in Czech , 2006, 2006 2nd International Conference on Information & Communication Technologies.

[53]  Elizabeth Shriberg,et al.  Switchboard SWBD-DAMSL shallow-discourse-function annotation coders manual , 1997 .

[54]  James F. Allen,et al.  Draft of DAMSL Dialog Act Markup in Several Layers , 2007 .

[55]  Andreas Stolcke,et al.  Can Prosody Aid the Automatic Classification of Dialog Acts in Conversational Speech? , 1998, Language and speech.

[56]  Elizabeth Shriberg,et al.  Meeting Recorder Project: Dialog Act Labeling Guide , 2004 .

[57]  Christian Boitet,et al.  Speech translation for French within the c-STAR II consortium and future perspectives , 2000, INTERSPEECH.

[58]  Stephen Cox,et al.  Some statistical issues in the comparison of speech recognition algorithms , 1989, International Conference on Acoustics, Speech, and Signal Processing,.

[59]  Csr Young,et al.  How to Do Things With Words , 2009 .

[60]  Alex Lascarides,et al.  Edinburgh Research Explorer Using automatically labelled examples to classify rhetorical relations: an assessment , 2022 .

[61]  Jeff Orkin,et al.  Semi-Automated Dialogue Act Classification for Situated Social Agents in Games , 2010, AGS.

[62]  Chengqing Zong,et al.  Dialog-Act Recognition Using Discourse and Sentence Structure Information , 2009, 2009 International Conference on Asian Language Processing.

[63]  Elmar Nöth,et al.  Dialog act classification with the help of prosody , 1996, Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96.