Eye Caramba: Gaze-based Assistance for Virtual Reality Aiming and Throwing Tasks in Games

Gaze-based interaction in Virtual Reality (VR) has been attracting attention recently due to rapid advances in eye tracking technology in head-mounted displays. Since gazes are a natural and intuitive interaction modality for human beings, gaze-based interaction could enhance player experience in immersive VR games. Aiming assistance is a common feature in games to balance difficulty for different player skills. Previous work has investigated different aim assistance approaches and identified various shortcomings. We hypothesize that “bullet magnetism” is a promising technique for VR and could be enhanced by extending its functionality through players’ gazes. In this paper, we present a gaze-based aiming assistance approach and propose a study design to evaluate its performance and player experience in a “Mexican-style” VR first-person shooter game.

[1]  Robert J. K. Jacob,et al.  Interacting with eye movements in virtual environments , 2000, CHI.

[2]  Marcus Carter,et al.  The Emergence of EyePlay: A Survey of Eye Interaction in Games , 2016, CHI PLAY.

[3]  Manfred Tscheligi,et al.  Where the eyes meet: Lessons learned from shared gaze-based interactions in cooperative and competitive online games , 2018, Entertain. Comput..

[4]  E. Deci,et al.  Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. , 2000, The American psychologist.

[5]  Robert W. Lindeman,et al.  Exploring natural eye-gaze-based interaction for immersive virtual reality , 2017, 2017 IEEE Symposium on 3D User Interfaces (3DUI).

[6]  Valentin Schwind,et al.  Touch with foreign hands: the effect of virtual hand appearance on visual-haptic integration , 2018, SAP.

[7]  I. Scott MacKenzie,et al.  A Fitts' law study of click and dwell interaction by gaze, head and mouse with a head-mounted display , 2018, COGAIN@ETRA.

[8]  Andrew T. Duchowski,et al.  Gaze- vs. hand-based pointing in virtual environments , 2003, CHI Extended Abstracts.

[9]  Mel Slater,et al.  The impact of avatar realism and eye gaze control on perceived quality of communication in a shared immersive virtual environment , 2003, CHI '03.

[10]  Niels Henze,et al.  Understanding Visual-Haptic Integration of Avatar Hands Using a Fitts' Law Task in Virtual Reality , 2019, MuC.

[11]  Henny van der Meijden,et al.  Effects of constructing versus playing an educational game on student motivation and deep learning strategy use , 2011, Comput. Educ..

[12]  Carl Gutwin,et al.  Now You Can Compete With Anyone: Balancing Players of Different Skill Levels in a First-Person Shooter Game , 2015, CHI.

[13]  Hans-Werner Gellersen,et al.  Gaze + pinch interaction in virtual reality , 2017, SUI.

[14]  Marc Erich Latoschik,et al.  The Impact of Avatar Personalization and Immersion on Virtual Body Ownership, Presence, and Emotional Response , 2018, IEEE Transactions on Visualization and Computer Graphics.

[15]  Feng Tian,et al.  Gesture interaction in virtual reality , 2019, Virtual Real. Intell. Hardw..

[16]  Mel Slater,et al.  An Eye Gaze Model for Dyadic Interaction in an Immersive Virtual Environment: Practice and Experience , 2004, Comput. Graph. Forum.

[17]  Florian Alt,et al.  VRpursuits: interaction in virtual reality using smooth pursuit eye movements , 2018, AVI.

[18]  KongFatt Wong-Lin,et al.  A multimodal interface to resolve the Midas-Touch problem in gaze controlled wheelchair , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[19]  Thies Pfeiffer,et al.  Advantages of eye-gaze over head-gaze-based selection in virtual and augmented reality under varying field of views , 2018, COGAIN@ETRA.

[20]  Mel Slater,et al.  Virtually Being Einstein Results in an Improvement in Cognitive Task Performance and a Decrease in Age Bias , 2018, Front. Psychol..

[21]  Bernhard Maurer,et al.  An Eye for an Eye: Gaze Input in Competitive Online Games and its Effects on Social Presence , 2016, ACE.

[22]  André de Lima Salgado,et al.  Evaluation of the user experience and intrinsic motivation with educational and mainstream digital games , 2015, CLIHC.

[23]  Carl Gutwin,et al.  The effectiveness (or lack thereof) of aim-assist techniques in first-person shooter games , 2014, CHI.

[24]  Regan L. Mandryk,et al.  Empirical Evaluation of Hybrid Gaze-Controller Selection Techniques in a Gaming Context , 2018, CHI PLAY.

[25]  Roman Bednarik,et al.  The potentials for hands-free interaction in micro-neurosurgery , 2014, NordiCHI.

[26]  Hans-Werner Gellersen,et al.  EyePlay: applications for gaze in games , 2014, CHI PLAY.

[27]  Charalambos Poullis,et al.  Navigation in virtual reality: Comparison of gaze-directed and pointing motion control , 2016, 2016 18th Mediterranean Electrotechnical Conference (MELECON).

[28]  Felix Hülsmann,et al.  Comparing gaze-based and manual interaction in a fast-paced gaming task in Virtual Reality , 2011 .

[29]  Carl Gutwin,et al.  Does Helping Hurt?: Aiming Assistance and Skill Development in a First-Person Shooter Game , 2016, CHI PLAY.

[30]  Kai Kunze,et al.  Assessing hands-free interactions for VR using eye gaze and electromyography , 2018, Virtual Reality.

[31]  Oleg Spakov,et al.  Gaze controlled games , 2009, Universal Access in the Information Society.

[32]  Veronica Sundstedt,et al.  A comparative study of eye tracking and hand controller for aiming tasks in virtual reality , 2019, ETRA.

[33]  Carl Gutwin,et al.  Target assistance for subtly balancing competitive play , 2011, CHI.

[34]  Peter J. Beek,et al.  Gaze Behavior in Basketball Shooting , 2008, Research quarterly for exercise and sport.

[35]  Hans-Werner Gellersen,et al.  EyePlay Revisited: Past, Present and Future Challenges for Eye-Based Interaction in Games , 2018, CHI PLAY.