VRpursuits: interaction in virtual reality using smooth pursuit eye movements

Gaze-based interaction using smooth pursuit eye movements (Pursuits) is attractive given that it is intuitive and overcomes the Midas touch problem. At the same time, eye tracking is becoming increasingly popular for VR applications. While Pursuits was shown to be effective in several interaction contexts, it was never explored in-depth for VR before. In a user study (N=26), we investigated how parameters that are specific to VR settings influence the performance of Pursuits. For example, we found that Pursuits is robust against different sizes of virtual 3D targets. However performance improves when the trajectory size (e.g., radius) is larger, particularly if the user is walking while interacting. While walking, selecting moving targets via Pursuits is generally feasible albeit less accurate than when stationary. Finally, we discuss the implications of these findings and the potential of smooth pursuits for interaction in VR by demonstrating two sample use cases: 1) gaze-based authentication in VR, and 2) a space meteors shooting game.

[1]  Carl Gutwin,et al.  The Effects of Feedback on Targeting with Multiple Moving Targets , 2004, Graphics Interface.

[2]  Andreas Bulling,et al.  Pupil: an open source platform for pervasive eye tracking and mobile gaze-based interaction , 2014, UbiComp Adjunct.

[3]  Kai Kunze,et al.  GazeSphere: navigating 360-degree-video environments in VR using head rotation and eye gaze , 2017, SIGGRAPH Posters.

[4]  Hans-Werner Gellersen,et al.  Orbits: Gaze Interaction for Smart Watches using Smooth Pursuit Eye Movements , 2015, UIST.

[5]  Sean Andrist,et al.  Looking Coordinated: Bidirectional Gaze Mechanisms for Collaborative Interaction with Virtual Characters , 2017, CHI.

[6]  Martin S. Moran,et al.  A Test of Fitts' Law with Moving Targets , 1980, Human factors.

[7]  Dinesh Manocha,et al.  PedVR: simulating gaze-based interactions between a real user and virtual crowds , 2016, VRST.

[8]  Florian Alt,et al.  Seamless and Secure VR: Adapting and Evaluating Established Authentication Systems for Virtual Reality , 2017 .

[9]  H. Hussmann,et al.  Seamless and Secure VR: Adapting and Evaluating Established Authentication Systems for Virtual Reality , 2017 .

[10]  Konrad Hinsen The molecular modeling toolkit: A new approach to molecular simulations , 2000 .

[11]  Albrecht Schmidt,et al.  Eye-gaze interaction for mobile phones , 2007, Mobility '07.

[12]  Ian Oakley,et al.  SmoothMoves: Smooth Pursuits Head Movements for Augmented Reality , 2017, UIST.

[13]  Marc Erich Latoschik,et al.  Evaluation of Binocular Eye Trackers and Algorithms for 3D Gaze Interaction in Virtual Reality Environments , 2008, J. Virtual Real. Broadcast..

[14]  Bartholomäus Wissmath,et al.  The illusion of being located in dynamic virtual environments. Can eye movement parameters predict spatial presence , 2010 .

[15]  Florian Alt,et al.  TextPursuits: using text for pursuits-based interaction and calibration on public displays , 2016, UbiComp.

[16]  Sai-Keung Wong,et al.  Animating agents based on radial view in crowd simulation , 2016, VRST.

[17]  Xucong Zhang,et al.  Combining eye tracking with optimizations for lens astigmatism in modern wide-angle HMDs , 2016, 2016 IEEE Virtual Reality (VR).

[18]  Martin Schrepp,et al.  Design and Evaluation of a Short Version of the User Experience Questionnaire (UEQ-S) , 2017, Int. J. Interact. Multim. Artif. Intell..

[19]  Thies Pfeiffer,et al.  Psycholinguistic experiments on spatial relations using stereoscopic presentation , 2006 .

[20]  Florian Alt,et al.  EyeVote in the wild: do users bother correcting system errors on public displays? , 2016, MUM.

[21]  Hans-Werner Gellersen,et al.  Pursuits: spontaneous interaction with displays based on smooth pursuit eye movement and moving targets , 2013, UbiComp.

[22]  Michael Ortega,et al.  Hook: Heuristics for selecting 3D moving objects in dense target environments , 2013, 2013 IEEE Symposium on 3D User Interfaces (3DUI).

[23]  Hans-Werner Gellersen,et al.  AmbiGaze: Direct Control of Ambient Devices by Gaze , 2016, Conference on Designing Interactive Systems.

[24]  Otto Hans-Martin Lutz,et al.  SMOOVS: Towards calibration-free text entry by gaze using smooth pursuit movements , 2015 .

[25]  Robert W. Lindeman,et al.  Exploring natural eye-gaze-based interaction for immersive virtual reality , 2017, 2017 IEEE Symposium on 3D User Interfaces (3DUI).

[26]  Enrico Rukzio,et al.  EyeVR: low-cost VR eye-based interaction , 2016, UbiComp Adjunct.

[27]  Joohwan Kim,et al.  Towards foveated rendering for gaze-tracked virtual reality , 2016, ACM Trans. Graph..

[28]  Raimund Dachselt,et al.  Designing gaze-based user interfaces for steering in virtual environments , 2012, ETRA.

[29]  Marcus Carter,et al.  Motion Correlation , 2017, ACM Trans. Comput. Hum. Interact..

[30]  Nathalie Guyader,et al.  Does color influence eye movements while exploring videos , 2015 .

[31]  Hans-Werner Gellersen,et al.  The Royal Corgi: Exploring Social Gaze Interaction for Immersive Gameplay , 2015, CHI.

[32]  Kai Kunze,et al.  Smooth eye movement interaction using EOG glasses , 2016, ICMI.

[33]  Subarna Tripathi,et al.  A Statistical Approach to Continuous Self-Calibrating Eye Gaze Tracking for Head-Mounted Virtual Reality Systems , 2016, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV).

[34]  Florian Alt,et al.  EyeScout: Active Eye Tracking for Position and Movement Independent Gaze Interaction with Large Public Displays , 2017, UIST.

[35]  Jan-Louis Kruger,et al.  Attention distribution and cognitive load in a subtitled academic lecture: L1 vs. L2 , 2014 .

[36]  Florian Alt,et al.  A field study on spontaneous gaze-based interaction with a public display using pursuits , 2015, UbiComp/ISWC Adjunct.

[37]  Eelke Folmer,et al.  VR-STEP: Walking-in-Place using Inertial Sensing for Hands Free Navigation in Mobile VR Environments , 2016, CHI.

[38]  Tovi Grossman,et al.  Comet and target ghost: techniques for selecting moving targets , 2011, CHI.

[39]  Matthias Roetting,et al.  Entering PIN codes by smooth pursuit eye movements , 2014 .

[40]  Sharif Razzaque,et al.  Redirected Walking , 2001, Eurographics.