Detecting Uncertainty in Spoken Dialogues An explorative research to the automatic detection of a speakers' uncertainty by using prosodic markers

This paper reports results in automatic detection of speaker uncertainty in spoken dialogues by using prosodic markers. For this purpose a substantial part of the AMI corpus (a multi-modal multi-party meeting corpus) has been selected and converted to a suitable format so its data could be analyzed for a selected set of prosodic features. In the absence of relevant stance annotations on (un)certainty, lexical markers (hedges) have been used to mark utterances as (un)certain. Results show that prosodic features can indeed be used to detect speaker uncertainty in spoken dialogues. The classifiers can tell uncertain from neutral utterances with an accuracy of 75% which is 25% over the baseline.

[1]  William Hirst,et al.  Surface features of utterances, credibility judgments, and memory , 2006, Memory & cognition.

[2]  Paul Boersma,et al.  Praat, a system for doing phonetics by computer , 2002 .

[3]  Paul Boersma,et al.  Praat: doing phonetics by computer , 2003 .

[4]  Emiel Krahmer,et al.  How Children and Adults Produce and Perceive Uncertainty in Audiovisual Speech , 2005, Language and speech.

[5]  Julia Hirschberg,et al.  Detecting certainness in spoken tutorial dialogues , 2005, INTERSPEECH.

[6]  S. Brennan,et al.  THE FEELING OF ANOTHER'S KNOWING : PROSODY AND FILLED PAUSES AS CUES TO LISTENERS ABOUT THE METACOGNITIVE STATES OF SPEAKERS , 1995 .

[7]  Jean Carletta,et al.  The AMI meeting corpus , 2005 .

[8]  Tim Rowland,et al.  Hedges in mathematics talk: Linguistic pointers to uncertainty , 1995 .

[9]  Jean Carletta,et al.  Unleashing the killer corpus: experiences in creating the multi-everything AMI Meeting Corpus , 2007, Lang. Resour. Evaluation.

[10]  S. Argamon,et al.  Hedged Responses and Expressions of Affect in Human/Human and Human/Computer Tutorial Interactions , 2004 .

[11]  H. H. Clark,et al.  On the Course of Answering Questions , 1993 .

[12]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .

[13]  J. Hart,et al.  Memory and the feeling-of-knowing experience. , 1965, Journal of educational psychology.

[14]  Günter Pomaska,et al.  PHP Hypertext Preprocessor , 2012 .