On eye-gaze and turn-taking

In this paper we describe our eye-tracking data collection and preliminary experiments concerning the relation between eyegazing and turn-taking in natural human-human conversations, and how these observations can be extended to multimodal human-machine interactions. We confirm the earlier findings that eye-gaze is important in coordinating turn-taking and information flow in dialogues, but note that in multiparty dialogues also head movement seems to pay a crucial role in signalling the person's intention to take, hold, or yield the turn.

[1]  Catherine Pelachaud,et al.  Interacting with Embodied Conversational Agents , 2010 .

[2]  Masafumi Nishida,et al.  Eye-gaze experiments for conversation monitoring , 2009, IUCS.

[3]  Joyce Yue Chai,et al.  The Role of Interactivity in Human-Machine Conversation for Automatic Word Acquisition , 2009, SIGDIAL Conference.

[4]  Kristiina Jokinen,et al.  Constructive Dialogue Modelling - Speech Interaction and Rational Agents , 2009, Wiley series in agent technology.

[5]  Costanza Navarretta,et al.  The MUMIN coding scheme for the annotation of feedback, turn management and sequencing phenomena , 2007, Lang. Resour. Evaluation.

[6]  Toyoaki Nishida,et al.  Attentional Behaviors as Nonverbal Communicative Signals in Situated Interactions with Conversational Agents , 2007 .

[7]  Brent Lance,et al.  The Rickel Gaze Model: A Window on the Mind of a Virtual Human , 2007, IVA.

[8]  Candace L. Sidner,et al.  Explorations in engagement for humans and robots , 2005, Artif. Intell..

[9]  Janet Beavin Bavelas.  Appreciating face-to-face dialogue , 2005, AVSP.

[10]  Roel Vertegaal,et al.  GAZE-2: conveying eye contact in group video conferencing using eye-controlled camera direction , 2003, CHI '03.

[11]  Roel Vertegaal,et al.  Attentive User Interfaces , 2003 .

[12]  Jean Carletta,et al.  Nonverbal behaviours improving a simulation of small group discussion , 2003 .

[13]  Päivi Majaranta,et al.  Twenty years of eye typing: systems and design issues , 2002, ETRA.

[14]  Michael Kipp,et al.  ANVIL - a generic annotation tool for multimodal dialogue , 2001, INTERSPEECH.

[15]  C. Goodwin.  Action and embodiment within situated human interaction , 2000 .

[16]  Ian Witten,et al.  Data Mining , 2000 .

[17]  M. Argyle,et al.  Gaze and Mutual Gaze , 1994, British Journal of Psychiatry.

[18]  Toni Rietveld,et al.  Statistical Techniques for the Study of Language and Language Behaviour , 1993 .

[19]  M. Weiser.  The Computer for the Twenty-First Century , 1991 .

[20]  A. Kendon.  Some functions of gaze-direction in social interaction. , 1967, Acta psychologica.