The Royal Corgi: Exploring Social Gaze Interaction for Immersive Gameplay

The eyes are a rich channel for non-verbal communication in our daily interactions. We propose social gaze interaction as a game mechanic to enhance user interactions with virtual characters. We develop a game from the ground-up in which characters are designed to be reactive to the player's gaze in social ways, such as getting annoyed when the player seems distracted or changing their dialogue depending on the player's apparent focus of attention. Results from a qualitative user study provide insights about how social gaze interaction is intuitive for users, elicits deep feelings of immersion, and highlight the players' self-consciousness of their own eye movements through their strong reactions to the characters.

[1]  U. Castiello Understanding other people's actions: intention and attention. , 2003, Journal of experimental psychology. Human perception and performance.

[2]  Mitsuru Ishizuka,et al.  Attentive Presentation Agents , 2007, IVA.

[3]  Toyoaki Nishida,et al.  Gaze awareness in conversational agents: Estimating a user's conversational engagement from eye gaze , 2013, TIIS.

[4]  Andreas Paepcke,et al.  EyePoint: practical pointing and selection using gaze and keyboard , 2007, CHI.

[5]  Roel Vertegaal,et al.  GAZE-2: conveying eye contact in group video conferencing using eye-controlled camera direction , 2003, CHI '03.

[6]  Constantine Stephanidis,et al.  Universal access in the information society , 1999, HCI.

[7]  N. Emery,et al.  The eyes have it: the neuroethology, function and evolution of social gaze , 2000, Neuroscience & Biobehavioral Reviews.

[8]  Araceli Sanchis,et al.  Towards gaze-controlled platform games , 2011, 2011 IEEE Conference on Computational Intelligence and Games (CIG'11).

[9]  Marc Cavazza,et al.  Discovering eye gaze behavior during human-agent conversation in an interactive storytelling application , 2010, ICMI-MLMI '10.

[10]  John Paulin Hansen,et al.  Eye Movements in Gaze Interaction , 2013 .

[11]  Steve Benford,et al.  Ambiguity as a resource for design , 2003, CHI '03.

[12]  Regan L. Mandryk,et al.  Biofeedback game design: using direct and indirect physiological control to enhance game interaction , 2011, CHI.

[13]  T. C. Nicholas Graham,et al.  Use of eye movements for video game control , 2006, ACE '06.

[14]  Sven Bertel,et al.  Dynamically adapting an AI game engine based on players' eye movements and strategies , 2014, EICS.

[15]  N. Sarkar,et al.  Design of a Gaze-Sensitive Virtual Social Interactive System for Children With Autism , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[16]  Steven P. Tipper,et al.  Visual Attention, Social Cognition, and Individual Differences , 2007 .

[17]  Delores Saddler,et al.  Research Review , 2012 .

[18]  Oleg Spakov,et al.  Gaze controlled games , 2009, Universal Access in the Information Society.

[19]  Md. Golam Rashed,et al.  Recognizing Gaze Pattern for Human Robot Interaction , 2014, 2014 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[20]  Raimund Dachselt,et al.  Designing gaze-based user interfaces for steering in virtual environments , 2012, ETRA.

[21]  M. Argyle,et al.  Gaze and Mutual Gaze , 1994, British Journal of Psychiatry.

[22]  Peta Wyeth,et al.  GameFlow: a model for evaluating player enjoyment in games , 2005, CIE.

[23]  Raimund Dachselt,et al.  Investigating gaze-supported multimodal pan and zoom , 2012, ETRA '12.

[24]  Hans-Werner Gellersen,et al.  Cross-device gaze-supported point-to-point content transfer , 2014, ETRA.

[25]  J. Nadel,et al.  Investigating social gaze as an action-perception online performance , 2012, Front. Hum. Neurosci..

[26]  C. Kleinke Gaze and eye contact: a research review. , 1986, Psychological bulletin.

[27]  J. Gerring A case study , 2011, Technology and Society.

[28]  Yoshinori Kobayashi,et al.  Choosing answerers by observing gaze responses for museum guide robots , 2010, 2010 5th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[29]  Thomas Martinetz,et al.  Gaze beats mouse: A case study , 2007 .

[30]  Norman I. Badler,et al.  Look me in the Eyes: A Survey of Eye and Gaze Animation for Virtual Agents and Artificial Systems , 2014, Eurographics.

[31]  Ruigang Yang,et al.  Eye gaze correction with stereovision for video-teleconferencing , 2002, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  S. Tipper,et al.  Gaze cueing of attention: visual attention, social cognition, and individual differences. , 2007, Psychological bulletin.

[33]  Anatole Lécuyer,et al.  Using an Eye-Tracking System to Improve Camera Motions and Depth-of-Field Blur Effects in Virtual Environments , 2008, 2008 IEEE Virtual Reality Conference.

[34]  Howell O. Istance,et al.  For Your Eyes Only: Controlling 3D Online Games by Eye-Gaze , 2009, INTERACT.