Pursuits: spontaneous interaction with displays based on smooth pursuit eye movement and moving targets

Although gaze is an attractive modality for pervasive interactions, the real-world implementation of eye-based interfaces poses significant challenges, such as calibration. We present Pursuits, an innovative interaction technique that enables truly spontaneous interaction with eye-based interfaces. A user can simply walk up to the screen and readily interact with moving targets. Instead of being based on gaze location, Pursuits correlates eye pursuit movements with objects dynamically moving on the interface. We evaluate the influence of target speed, number and trajectory and develop guidelines for designing Pursuits-based interfaces. We then describe six realistic usage scenarios and implement three of them to evaluate the method in a usability study and a field study. Our results show that Pursuits is a versatile and robust technique and that users can interact with Pursuits-based interfaces without prior knowledge or preparation phase.

[1]  Raimund Dachselt,et al.  Look & touch: gaze-supported target acquisition , 2012, CHI.

[2]  Kenton O'Hara,et al.  Exploring the potential for touchless interaction in image-guided interventional radiology , 2011, CHI.

[3]  Keith Cheverst,et al.  Exploring bluetooth based mobile phone interaction with the hermes photo display , 2005, Mobile HCI.

[4]  Robert J. K. Jacob,et al.  What you look at is what you get: eye movement-based interaction techniques , 1990, CHI '90.

[5]  Carl Gutwin,et al.  The Effects of Feedback on Targeting with Multiple Moving Targets , 2004, Graphics Interface.

[6]  Roel Vertegaal,et al.  Attentive User Interfaces , 2003 .

[7]  Howell O. Istance,et al.  Gaze gestures or dwell-based interaction? , 2012, ETRA '12.

[8]  K. Rayner Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[9]  Roel Vertegaal,et al.  EyeWindows: evaluation of eye-controlled zooming windows for focus selection , 2005, CHI.

[10]  Michael Rohs,et al.  Sweep and point and shoot: phonecam-based interactions for large public displays , 2005, CHI Extended Abstracts.

[11]  Shumin Zhai,et al.  Gaze and Speech in Attentive User Interfaces , 2000, ICMI.

[12]  Shumin Zhai,et al.  Manual and gaze input cascaded (MAGIC) pointing , 1999, CHI '99.

[13]  Albrecht Schmidt,et al.  Interacting with the Computer Using Gaze Gestures , 2007, INTERACT.

[14]  Jeffrey S. Shell,et al.  EyePliances: attention-seeking devices that respond to visual attention , 2003, CHI Extended Abstracts.

[15]  Gregory D. Abowd,et al.  Perceptual user interfaces using vision-based eye tracking , 2003, ICMI '03.

[16]  D. Robinson The mechanics of human smooth pursuit eye movement. , 1965, The Journal of physiology.

[17]  Brian H Scott,et al.  A comparison of pursuit eye movement and perceptual performance in speed discrimination. , 2003, Journal of vision.

[18]  John Paulin Hansen,et al.  Noise tolerant selection by gaze-controlled pan and zoom in 3D , 2008, ETRA.

[19]  Robert J. K. Jacob,et al.  Evaluation of eye gaze interaction , 2000, CHI.

[20]  Poika Isokoski,et al.  Now Dasher! Dash away!: longitudinal study of fast text entry by Eye Gaze , 2008, ETRA.

[21]  Daniel Vogel,et al.  Interactive public ambient displays: transitioning from implicit to explicit, public to personal, interaction with multiple users , 2004, UIST '04.

[22]  Albrecht Schmidt,et al.  Increasing the security of gaze-based cued-recall graphical passwords using saliency masks , 2012, CHI.

[23]  Päivi Majaranta,et al.  From Gaze Control to Attentive Interfaces , 2005 .

[24]  John Anderson,et al.  An evaluation of techniques for selecting moving targets , 2009, CHI Extended Abstracts.

[25]  Andriy Pavlovych,et al.  Target following performance in the presence of latency, jitter, and signal dropouts , 2011, Graphics Interface.

[26]  Yanxia Zhang,et al.  SideWays: a gaze interface for spontaneous interaction with situated displays , 2013, CHI.

[27]  I. Scott MacKenzie,et al.  Eye gaze interaction with expanding targets , 2004, CHI EA '04.

[28]  Jean-Daniel Fekete,et al.  Motion-pointing: target selection using elliptical motions , 2009, CHI.

[29]  Antti Oulasvirta,et al.  It's Mine, Don't Touch!: interactions at a large multi-touch display in a city centre , 2008, CHI.