The Role of Eye Gaze in Avatar Mediated Conversational Interfaces

As we begin to create synthetic characters (avatars) for computer users, it is important to pay attention to both the look and the behavior of the avatar’s eyes. In this paper we present behavior models of eye gaze patterns in the context of real-time verbal communication. We apply these eye gaze models to simulate eye movements in a computer-generated avatar in a number of task settings. We also report the results of an experiment that we conducted to assess whether our eye gaze model induces changes in the eye gaze behavior of an individual who is conversing with an avatar.

[1]  A. Kendon.  Some functions of gaze-direction in social interaction. , 1967, Acta psychologica.

[2]  M. Argyle,et al.  Gaze and Mutual Gaze , 1994, British Journal of Psychiatry.

[3]  G. Beattie,et al.  Contextual constraints on the floor‐apportionment function of speaker‐gaze in dyadic conversations , 1979 .

[4]  G. Beattie,et al.  A further investigation of the cognitive interference hypothesis of gaze patterns during conversation , 1981 .

[5]  David Jones,et al.  Catching the eye , 1990, Nature.

[6]  Jonathan Grudin,et al.  Integration of Inter-Personal Space and Shared Workspace: ClearBoard Design and Experiments , 1992, CSCW.

[7]  John L. Arnott,et al.  Using spatial cues to improve videoconferencing , 1992, CHI.

[8]  Yutaka Matsushita,et al.  Multiparty videoconferencing at virtual social distance: MAJIC design , 1994, CSCW '94.

[9]  Mark Steedman,et al.  Animated conversation: rule-based generation of facial expression, gesture & spoken intonation for multiple conversational agents , 1994, SIGGRAPH.

[10]  B. Velichkovsky.  Communicating attention: Gaze position transfer in cooperative problem solving , 1995 .

[11]  Lothar Mühlbach,et al.  Telepresence in Videocommunications: A Study on Stereoscopy and Individual Eye Contact , 1995, Hum. Factors.

[12]  Steve Whittaker,et al.  Rethinking video as a technology for interpersonal communications: theory and design implications , 1995, Int. J. Hum. Comput. Stud..

[13]  J. Rieser,et al.  Attention and communication: Eye-movement-based research paradigms , 1996 .

[14]  C. Freksa,et al.  Visual Attention and Cognition , 1996 .

[15]  David G. Novick,et al.  Coordinating turn-taking with gaze , 1996, Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96.

[16]  David Salesin,et al.  The virtual cinematographer: a paradigm for automatic real-time camera control and directing , 1996, SIGGRAPH.

[17]  Mark Steedman,et al.  Generating Facial Expressions for Speech , 1996, Cogn. Sci..

[18]  John Paulin Hansen,et al.  New technological windows into mind: there is more in eyes and brains for human-computer interaction , 1996, CHI.

[19]  Matthew Christopher Bull,et al.  Timing and coordination of turn-taking , 1998 .

[20]  Lynne Coventry,et al.  The effects of visual proxemic information in video mediated communication , 1998, SGCH.

[21]  Gloria Mark,et al.  Social Conventions in Collaborative Virtual Environments , 1998 .

[22]  J. Cassell,et al.  Turn taking vs. Discourse Structure: How Best to Model Multimodal Conversation , 1998 .

[23]  Takanori Maesako,et al.  HyperMirror: toward pleasant-to-use video mediated communication system , 1998, CSCW '98.

[24]  J. Cassell,et al.  Modeling Gaze Behavior as a Function of Discourse Structure , 1998 .

[25]  Yorick Wilks.  Machine Conversations , 1999 .

[26]  Norman I. Badler,et al.  Where to Look? Automating Attending Behaviors of Virtual Human Characters , 1999, Agents.

[27]  Kristinn R. Thórisson,et al.  The Power of a Nod and a Glance: Envelope Vs. Emotional Feedback in Animated Conversational Agents , 1999, Appl. Artif. Intell..

[28]  Steven M. Drucker,et al.  The social life of small graphical chat spaces , 2000, CHI.

[29]  UniteWork.  Ultima Online“技巧”大公开 , 2000 .