Generic Gaze Interaction Events for Web Browsers Using the Eye Tracker as Input Device

In the last decade much research has been conducted on analyzing human eye and gaze movements using eye tracking technology, not only in the fields of neuroscience, psychology and marketing, but also in the field of human computer interaction. However, no flexbile framework exists to integrate eye tracking directly into web applications to easily create and test new interaction concepts. We have created a JavaScript library based on the latest HTML5 Web technology and the jQuery library to close this gap. Facilitated by HTML5 WebSocket, the browser directly receives gaze input samples from an eye tracker, generating events that are similar to those of a mouse input device. Events like gazeOver/-Out or fixationStart/-End can be attached to any HTML element in the DOM tree. New custom events derived from the eye tracking data, e.g. blink or read, can easily be added. Using this library we have successfully implemented a number of Web applications, allowing the users to interact with their eyes. This paper also describes our gaze enabled Web-based eLearning environment. Our JavaScript library is used within the eLearning environment to capture and interpret eye gaze events for the purpose to support users in the acquisition of new knowledge.

[1]  Frank Salim,et al.  The WebSocket API , 2013 .

[2]  Antonio Krüger,et al.  Multi-touch is Dead, Long live Multi-touch , 2009 .

[3]  C. Ware,et al.  An evaluation of an eye tracker as a device for computer input2 , 1987, CHI '87.

[4]  John R. Anderson,et al.  Tracing Eye Movement Protocols with Cognitive Process Models , 1998 .

[5]  Joseph H. Goldberg,et al.  Identifying fixations and saccades in eye-tracking protocols , 2000, ETRA.

[6]  K. Rayner Eye Movements and Cognitive Processes in Reading, Visual Search, and Scene Perception , 1995 .

[7]  L. Stark,et al.  Scanpaths in saccadic eye movements while viewing and recognizing patterns. , 1971, Vision research.

[8]  Heiko Drewes,et al.  Eye gaze tracking for human computer interaction , 2010 .

[9]  M A Just,et al.  A theory of reading: from eye fixations to comprehension. , 1980, Psychological review.

[10]  David N. Lee,et al.  Where we look when we steer , 1994, Nature.

[11]  Eyal M. Reingold,et al.  Selection By Looking: A Novel Computer Interface And Its Application To Psychological Research , 1995 .

[12]  John R. Anderson,et al.  Mapping eye movements to cognitive processes , 1999 .

[13]  Albrecht Schmidt,et al.  Detailed Monitoring of User's Gaze and Interaction to Improve Future E-Learning , 2007, HCI.

[14]  Worthy N. Martin,et al.  Human-computer interaction using eye-gaze input , 1989, IEEE Trans. Syst. Man Cybern..

[15]  John Paulin Hansen,et al.  Evaluation of a low-cost open-source gaze tracker , 2010, ETRA.

[16]  P Suppes,et al.  Eye-movement models for arithmetic and reading performance. , 1990, Reviews of oculomotor research.