An Eye Gaze Model for Dyadic Interaction in an Immersive Virtual Environment: Practice and Experience

This paper describes a behavioural model used to simulate realistic eye‐gaze behaviour and body animations for avatars representing participants in a shared immersive virtual environment (IVE). The model was used in a study designed to explore the impact of avatar realism on the perceived quality of communication within a negotiation scenario. Our eye‐gaze model was based on data and studies carried out on the behaviour of eye‐gaze during face‐to‐face communication. The technical features of the model are reported here. Information about the motivation behind the study, experimental procedures and a full analysis of the results obtained are given in [ 17 ].

[1]  Mel Slater,et al.  Small group behaviour in a virtual and real environment , 1998 .

[2]  Mel Slater,et al.  Collaboration in Tele-Immersive Environments , 2002, EGVE.

[3]  Anthony Steed,et al.  An Overview of the COVEN Platform , 2001, Presence: Teleoperators & Virtual Environments.

[4]  Paul Dourish,et al.  Re-place-ing space: the roles of place and space in collaborative systems , 1996, CSCW '96.

[5]  Carolina Cruz-Neira,et al.  Surround-Screen Projection-Based Virtual Reality: The Design and Implementation of the CAVE , 2023 .

[6]  K. Chang,et al.  Embodiment in conversational interfaces: Rea , 1999, CHI '99.

[7]  Mel Slater,et al.  Small Group Behavior Experiments in the Coven Project , 1998, IEEE Computer Graphics and Applications.

[8]  Stacy Marsella,et al.  Interactive pedagogical drama , 2000, AGENTS '00.

[9]  Chris Barker,et al.  An Experiment on Public Speaking Anxiety in Response to Three Different Types of Virtual Audience , 2002, Presence: Teleoperators & Virtual Environments.

[10]  Justine Cassell,et al.  Relational agents: a model and implementation of building user trust , 2001, CHI.

[11]  Mel Slater,et al.  The impact of eye gaze on communication using humanoid avatars , 2001, CHI.

[12]  Sumedha Kshirsagar,et al.  A multilayer personality model , 2002, SMARTGRAPH '02.

[13]  Steve Benford,et al.  User embodiment in collaborative virtual environments , 1995, CHI '95.

[14]  Ralph Schroeder,et al.  The social life of avatars: presence and interaction in shared virtual environments , 2002 .

[15]  M. Argyle,et al.  Gaze, Mutual Gaze, and Proximity , 1972 .

[16]  Justine Cassell,et al.  BodyChat: autonomous communicative behaviors in avatars , 1998, AGENTS '98.

[17]  Justine Cassell,et al.  Requirements for an Architecture for Embodied Conversational Characters , 1999, Computer Animation and Simulation.

[18]  Juan David Velásquez,et al.  Modeling Emotions and Other Motivations in Synthetic Agents , 1997, AAAI/IAAI.

[19]  Mel Slater,et al.  The impact of avatar realism and eye gaze control on perceived quality of communication in a shared immersive virtual environment , 2003, CHI '03.

[20]  Ralph Schroeder,et al.  Small-Group Behavior in a Virtual and Real Environment: A Comparative Study , 2000, Presence: Teleoperators & Virtual Environments.

[21]  W. Scott Neal Reilly,et al.  An Architecture for Action, Emotion, and Social Behavior , 1992, MAAMAW.

[22]  Justine Cassell,et al.  BEAT: the Behavior Expression Animation Toolkit , 2001, Life-like characters.

[23]  M. Argyle,et al.  The meaning of five patterns of gaze , 1974 .

[24]  Norman I. Badler,et al.  Facial animation system with realistic eye movement based on a cognitive model for virtual agents , 2002 .

[25]  M. Argyle,et al.  Gaze and Mutual Gaze , 1994, British Journal of Psychiatry.

[26]  Norman I. Badler,et al.  Real-Time Control of a Virtual Human Using Minimal Sensors , 1993, Presence: Teleoperators & Virtual Environments.

[27]  M. Slater,et al.  Can Virtual Reality be Used to Investigate Persecutory Ideation? , 2003, The Journal of nervous and mental disease.

[28]  N. Badler,et al.  Eyes Alive Eyes Alive Eyes Alive Figure 1: Sample Images of an Animated Face with Eye Movements , 2022 .

[29]  Philippe Codognet,et al.  The InViWo Toolkit: Describing Autonomous Virtual Agents and Avatars , 2001, IVA.

[30]  F. Thomas,et al.  Disney Animation: The Illusion of Life , 1981 .

[31]  Sally Hong,et al.  The Social Life of Avatars: Presence and Interaction in Shared Virtual Environments , 2002, J. Educ. Technol. Soc..

[32]  Ken Perlin,et al.  Improv: a system for scripting interactive actors in virtual worlds , 1996, SIGGRAPH.

[33]  Simone Strippgen,et al.  INSIGHT: a virtual laboratory for looking into behavior-based autonomous agents , 1997, AGENTS '97.

[34]  Simone Strippgen,et al.  INSIGHT, A Virtual Liboratory for Design, Test and Evaluation of Autonomous Agents , 1998, ESM.

[35]  Jesper Mortensen,et al.  Spelunking: Experiences using the DIVE System on CAVE-like Platforms , 2001, EGVE/IPT.

[36]  Kristinn R. Thórisson,et al.  The Power of a Nod and a Glance: Envelope Vs. Emotional Feedback in Animated Conversational Agents , 1999, Appl. Artif. Intell..

[37]  Mel Slater,et al.  Meeting people vitually: experiments in shared virtual environments , 2002 .

[38]  L. Stark,et al.  Most naturally occurring human saccades have magnitudes of 15 degrees or less. , 1975, Investigative ophthalmology.

[39]  Themis Panayiotopoulos,et al.  SimHuman: A Platform for Real-Time Virtual Agents with Planning Capabilities , 2001, IVA.