Gaze and mouse coordination in everyday work

Gaze tracking technology is increasingly common in desktop, laptop and mobile scenarios. Most previous research on eye gaze patterns during human-computer interaction has been confined to controlled laboratory studies. In this paper we present an in situ study of gaze and mouse coordination as participants went about their normal activities. We analyze the coordination between gaze and mouse, showing that gaze often leads the mouse, but not as much as previously reported, and in ways that depend on the type of target. Characterizing the relationship between the eyes and mouse in realistic multi-task settings highlights some new challenges we face in designing robust gaze-enhanced interaction techniques.

[1]  Fernando Diaz,et al.  Robust models of mouse movement on dynamic web search results pages , 2013, CIKM.

[2]  Andrew T. Duchowski,et al.  Eye Tracking Methodology: Theory and Practice , 2003, Springer London.

[3]  Shumin Zhai,et al.  Hand eye coordination patterns in target selection , 2000, ETRA.

[4]  Kerry Rodden,et al.  Eye-mouse coordination patterns on web search results pages , 2008, CHI Extended Abstracts.

[5]  John R. Anderson,et al.  Eye tracking the visual search of click-down menus , 1999, CHI '99.

[6]  W. Helsen,et al.  Temporal and spatial coupling of point of gaze and hand movements in aiming. , 1998, Journal of motor behavior.

[7]  Marc Levoy,et al.  Gaze-directed volume rendering , 1990, I3D '90.

[8]  Robert J. K. Jacob,et al.  What you look at is what you get: eye movement-based interaction techniques , 1990, CHI '90.

[9]  John R. Anderson,et al.  What can a mouse cursor tell us more?: correlation of eye/mouse movements on web browsing , 2001, CHI Extended Abstracts.

[10]  Tovi Grossman,et al.  Patina: dynamic heatmaps for visualizing application usage , 2013, CHI.

[11]  Kenneth Holmqvist,et al.  Eye tracking: a comprehensive guide to methods and measures , 2011 .

[12]  Aulikki Hyrskykari,et al.  101 spots, or how do users read menus? , 1998, CHI.

[13]  Tim Halverson,et al.  Cleaning up systematic error in eye-tracking data by using required fixation locations , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[14]  Heinrich H. Bülthoff,et al.  Eye and pointer coordination in search and selection tasks , 2010, ETRA '10.

[15]  Ryen W. White,et al.  User see, user point: gaze and cursor alignment in web search , 2012, CHI.

[16]  Terry Winograd,et al.  Gaze-enhanced scrolling techniques , 2007, UIST.

[17]  Roman Bednarik,et al.  That's not norma(n/l): a detailed analysis of midas touch in gaze-based problem-solving , 2013, CHI Extended Abstracts.

[18]  Dave M. Stampe,et al.  Heuristic filtering and reliable calibration methods for video-based pupil-tracking systems , 1993 .

[19]  D. S. Wooding,et al.  Fixation maps: quantifying eye-movement traces , 2002, ETRA.

[20]  Hana Vrzakova.  EyeCloud : Cloud Computing for Pervasive Eye-Tracking , 2013 .

[21]  Shumin Zhai,et al.  Manual and gaze input cascaded (MAGIC) pointing , 1999, CHI '99.