Course 05: eye-based interaction in graphical systems: theory & practice

This course covers interactive techniques associated with the use of an eye tracker, an input device delivering real-time coordinates of the user’s gaze. While eye tracking technology is itself not new and eye trackers have been successfully incorporated in virtual environments (mainly by the military) over 20 years ago, eye trackers have not been easily accessible to the general graphics community. Moreover, eye trackers have traditionally been considered “unwieldy”. Currently available off-the-shelf video eye trackers have greatly improved in their accuracy and ease of use and integration. Interest in the use of eye tracking devices is currently re-surging, as the devices are being applied in areas of interface usability studies, training simulators, and as interaction devices.

[1]  J. Findlay.  Programming of Stimulus-Elicited Saccadic Eye Movements , 1992 .

[2]  Andrew T. Duchowski,et al.  A Platform for Gaze-Contingent Virtual Environments , 2000 .

[3]  Kenneth R. Boff,et al.  Engineering data compendium : human perception and performance , 1988 .

[4]  Wa James Tam,et al.  Processing image sequences based on eye movements , 1994, Electronic Imaging.

[5]  Anthony M. Norcia,et al.  Directional selectivity in the cortex , 1998 .

[6]  Robert J. K. Jacob,et al.  What you look at is what you get: eye movement-based interaction techniques , 1990, CHI '90.

[7]  Hugues Hoppe,et al.  View-dependent refinement of progressive meshes , 1997, SIGGRAPH.

[8]  E D Megaw,et al.  Eye movements and industrial inspection. , 1979, Applied ergonomics.

[9]  D. Sparks.  The brainstem control of saccadic eye movements , 2002, Nature Reviews Neuroscience.

[10]  Jacqueline Grennon.  , 2nd Ed. , 2002, The Journal of nervous and mental disease.

[11]  K. Rayner.  Eye movements and visual cognition : scene perception and reading , 1992 .

[12]  Norimichi Tsumura,et al.  Image compression and decompression based on gazing area , 1996, Electronic Imaging.

[13]  Tony DeRose,et al.  Multiresolution analysis of arbitrary meshes , 1995, SIGGRAPH.

[14]  D. Taylor.  Eye Movements and Psychological Processes , 1977 .

[15]  D. F. Fisher,et al.  Eye movements : cognition and visual perception , 1982 .

[16]  A. H. C. van der Heijden,et al.  Selective Attention in Vision , 1991 .

[17]  Hugues Hoppe,et al.  Progressive meshes , 1996, SIGGRAPH.

[18]  J. Anliker,et al.  Eye movements - On-line measurement, analysis, and control , 1976 .

[19]  H. Barlow.  Vision: A computational investigation into the human representation and processing of visual information: David Marr. San Francisco: W. H. Freeman, 1982. pp. xvi + 397 , 1983 .

[20]  S. Cannon.  The Neurology of Eye Movements (Contemporary Neurology Series) , 1992 .

[21]  Andrew T. Duchowski.  Acuity-matching resolution degradation through wavelet coefficient scaling , 2000, IEEE Trans. Image Process..

[22]  L. Optican,et al.  Slow saccades in spinocerebellar degeneration. , 1976, Archives of neurology.

[23]  Gerald L. Lohse,et al.  Consumer Eye Movement Patterns on Yellow Pages Advertising , 1997 .

[24]  D. Noton,et al.  Eye movements and visual perception. , 1971, Scientific American.

[25]  J. Senders,et al.  Eye Movements and Psychological Processes , 1976 .

[26]  J D Gould,et al.  Studies of Visual Inspection. , 1973, Ergonomics.

[27]  David Salesin,et al.  Interactive multiresolution surface viewing , 1996, SIGGRAPH.

[28]  Theodore J. Doll,et al.  Preattentive Processing in Visual Search , 1993 .

[29]  Cornell Juliano,et al.  The hunt for usability: tracking eye movements , 1999, CHI Extended Abstracts.

[30]  Joseph H. Goldberg,et al.  Computer interface evaluation using eye movements: methods and constructs , 1999 .

[31]  Evelyne Sernagor,et al.  Directional selectivity in the retina , 1998 .

[32]  J. S. Lund,et al.  Visual cortex cell types and connections , 1998 .

[33]  Dario D. Salvucci.  Inferring intent in eye-based interfaces: tracing eye movements with process models , 1999, CHI '99.

[34]  A. L. I︠A︡rbus.  Eye Movements and Vision , 1967 .

[35]  David Robinson,et al.  The oculomotor control system: A review , 1968 .

[36]  E. Ancman.  Peripherally located CRTs: color perception limitations , 1991, Proceedings of the IEEE 1991 National Aerospace and Electronics Conference NAECON 1991.

[37]  Ron Brinkmann,et al.  The Art and Science of Digital Compositing , 1999 .

[38]  Richard A. Bolt,et al.  A gaze-responsive self-disclosing display , 1990, CHI '90.

[39]  Shumin Zhai,et al.  Manual and gaze input cascaded (MAGIC) pointing , 1999, CHI '99.

[40]  J. Deutsch,et al.  Attention: Some theoretical considerations. , 1963 .

[41]  Hugues Hoppe.  Smooth view-dependent level-of-detail control and its application to terrain rendering , 1998, Proceedings Visualization '98 (Cat. No.98CB36276).

[42]  François Molnar,et al.  About the Role of Visual Exploration in Aesthetics , 1981 .

[43]  Jean-Marc Odobez,et al.  A ROI approach for hybrid image sequence coding , 1994, Proceedings of 1st International Conference on Image Processing.

[44]  Michael A. Arbib,et al.  The handbook of brain theory and neural networks , 1995, A Bradford book.

[45]  John R. Anderson,et al.  Eye tracking the visual search of click-down menus , 1999, CHI '99.

[46]  M. Posner,et al.  Attention and the detection of signals. , 1980, Journal of experimental psychology.

[47]  D. Robinson,et al.  The vestibulo‐ocular reflex during human saccadic eye movements. , 1986, The Journal of physiology.

[48]  L. Stark,et al.  Scanpaths in saccadic eye movements while viewing and recognizing patterns. , 1971, Vision research.

[49]  D. Broadbent.  Perception and communication , 1958 .

[50]  Joseph C. Hickox,et al.  Eye Scan Patterns of Experienced and Novice Pilots during Visual Flight Rules (VFR) Navigation , 1999 .

[51]  William E. Schroeder.  Head-mounted computer interface based on eye tracking , 1993, Other Conferences.

[52]  William E. Schroeder.  Replacing mouse and trackball with tracked line of gaze , 1993, Other Conferences.

[53]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[54]  Peter Schröder,et al.  Interactive multiresolution mesh editing , 1997, SIGGRAPH.

[55]  R. Carpenter,et al.  Movements of the Eyes , 1978 .

[56]  J. Deutsch,et al.  Militarized youths in western Côte d’Ivoire: local processes of mobilization, demobilization, and related humanitarian interventions (2002-2007) , 2011 .

[57]  Gregory K. Wallace,et al.  The JPEG still picture compression standard , 1991, CACM.

[58]  Bruce H. McCormick,et al.  A virtual Environment: Exploring the Brain Forest , 1997 .

[59]  Arthur F. Kramer,et al.  Attentional Guidance in Visual Attention , 1993 .

[60]  Robert J. K. Jacob,et al.  Evaluation of eye gaze interaction , 2000, CHI.

[61]  Andrew S. Glassner,et al.  An introduction to ray tracing , 1989 .

[62]  L E Mays,et al.  Signal transformations required for the generation of saccadic eye movements. , 1990, Annual review of neuroscience.

[63]  William Ribarsky,et al.  Real-time, continuous level of detail rendering of height fields , 1996, SIGGRAPH.

[64]  R. Gregory.  Eye and Brain: The Psychology of Seeing , 1969 .

[65]  Verzekeren Naar Sparen,et al.  Cambridge , 1969, Humphrey Burton: In My Own Time.

[66]  R. Haber,et al.  The psychology of visual perception , 1973 .

[67]  Anne Treisman,et al.  Features and objects in visual processing , 1986 .

[68]  G. A. Miller.  THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[69]  Theodore J. Doll,et al.  Simulation of Human Visual Search in Cluttered Backgrounds , 1993 .

[70]  Kenneth I. Joy,et al.  Free-form deformations with lattices of arbitrary topology , 1996, SIGGRAPH.

[71]  Jeremy M. Wolfe,et al.  Guided Search 2.0: The Upgrade , 1993 .

[72]  R. Groner.  Eye Movements and Psychological Functions: International Views , 1983 .

[73]  Roel Vertegaal,et al.  The GAZE groupware system: mediating joint attention in multiparty communication and collaboration , 1999, CHI '99.

[74]  Dieter Schmalstieg,et al.  Smooth levels of detail , 1997, Proceedings of IEEE 1997 Annual International Symposium on Virtual Reality.

[75]  J. Koenderink,et al.  Spatial and temporal parameters of motion detection in the peripheral visual field. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[76]  A. Duchowski.  Gaze-contingent visual communication , 1998 .

[77]  L. Young,et al.  Survey of eye movement recording methods , 1975 .

[78]  T. Papathomas.  Early vision and beyond , 1995 .

[79]  R. Finke,et al.  Principles of mental imagery , 1989 .

[80]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[81]  H D Crane,et al.  Generation-V dual-Purkinje-image eyetracker. , 1985, Applied optics.

[82]  D. E. Irwin,et al.  Visual Memory Within and Across Fixations , 1992 .

[83]  H. Hughes,et al.  Global Precedence, Spatial Frequency Channels, and the Statistics of Natural Images , 1996, Journal of Cognitive Neuroscience.

[84]  D. Ballard,et al.  Memory Representations in Natural Tasks , 1995, Journal of Cognitive Neuroscience.

[85]  Eileen Kowler,et al.  The role of location probability in the programming of saccades: Implications for “center-of-gravity” tendencies , 1989, Vision Research.

[86]  E. Marg.  A VISION OF THE BRAIN , 1994 .

[87]  Peter Schröder,et al.  Interpolating Subdivision for meshes with arbitrary topology , 1996, SIGGRAPH.