A comparison of addressee detection methods for multiparty conversations

Several algorithms have recently been proposed for recognizing addressees in a group conversational setting. These algorithms can rely on a variety of factors including previous conversational roles, gaze and type of dialogue act. Both statistical supervised machine learning algorithms as well as rule based methods have been developed. In this paper, we compare several algorithms developed for several different genres of muliparty dialogue, and propose a new synthesis algorithm that matches the performance of machine learning algorithms while maintaning the transparancy of semantically meaningfull rule-based algorithms.

[1]  Gene H. Lerner Selecting next speaker: The context-sensitive operation of a context-free organization , 2003, Language in Society.

[2]  Akko Kalma,et al.  Gazing in triads : a powerful signal in floor apportionment , 1992 .

[3]  Roel Vertegaal,et al.  Explaining effects of eye gaze on mediated group conversations:: amount or synchronization? , 2002, CSCW '02.

[4]  David R. Traum,et al.  Evaluation of Multi-party Virtual Reality Dialogue Interaction , 2004, LREC.

[5]  Stanley Peters,et al.  Who is “You”? Combining Linguistic and Gaze Features to Resolve Second-Person References in Dialogue , 2009, EACL.

[6]  Klaus Krippendorff,et al.  Content Analysis: An Introduction to Its Methodology , 1980 .

[7]  A. Kendon Some functions of gaze-direction in social interaction. , 1967, Acta psychologica.

[8]  Julia Hirschberg,et al.  Identifying Agreement and Disagreement in Conversational Speech: Use of Bayesian Networks to Model Pragmatic Dependencies , 2004, ACL.

[9]  Randall W. Hill,et al.  Toward a New Generation of Virtual Humans for Interactive Experiences , 2002, IEEE Intell. Syst..

[10]  Brent Lance,et al.  The Rickel Gaze Model: A Window on the Mind of a Virtual Human , 2007, IVA.

[11]  Randall W. Hill,et al.  Steve Goes to Bosnia: Towards a New Generation of Virtual Humans for Interactive Experiences , 2001 .

[12]  Natasa Jovanovic,et al.  To whom it may concern : adressee identification in face-to-face meetings , 2007 .

[13]  Alistair Knott,et al.  Multi-agent human-machine dialogue: issues in dialogue management and referring expression semantics , 2004, Artif. Intell..

[14]  Surabhi Gupta,et al.  Resolving "You" in Multi-Party Dialog , 2007, SIGdial.

[15]  Jean Carletta,et al.  Unleashing the killer corpus: experiences in creating the multi-everything AMI Meeting Corpus , 2007, Lang. Resour. Evaluation.

[16]  Dirk Heylen,et al.  On the Contextual Analysis of Agreement Scores , 2009, Multimodal Corpora.

[17]  David R. Traum,et al.  Embodied agents for multi-party dialogue in immersive virtual worlds , 2002, AAMAS '02.

[18]  Randall W. Hill,et al.  Controlling the focus of perceptual attention in embodied conversational agents , 2005, AAMAS '05.