It's in Your Eyes-Towards Context-Awareness and Mobile HCI Using Wearable EOG Goggles

In this work we describe the design, implementation and evaluation of a novel eye tracker for context-awareness and mobile HCI applications. In contrast to common systems using video cameras, this compact device relies on Electrooculography (EOG). It consists of goggles with dry electrodes integrated into the frame and a small pocket-worn component with a DSP for real-time EOG signal processing. The device is intended for wearable and standalone use: It can store data locally for long-term recordings or stream processed EOG signals to a remote device over Bluetooth. We describe how eye gestures can be efficiently recognised from EOG signals for HCI purposes. In an experiment conducted with 11 subjects playing a computer game we show that 8 eye gestures of varying complexity can be continuously recognised with equal performance to a state-of-theart video-based system. Physical activity leads to artefacts in the EOG signal. We describe how these artefacts can be removed using an adaptive filtering scheme and characterise this approach on a 5-subject dataset. In addition to HCI, we discuss how this paves the way for EOG-based context-awareness, and eventually to the assessment of cognitive processes.

[1]  Robert J. K. Jacob,et al.  What you look at is what you get: eye movement-based interaction techniques , 1990, CHI '90.

[2]  John G. Webster,et al.  Medical Instrumentation: Application and Design , 1997 .

[3]  R. Benjamin Knapp,et al.  Towards an EOG-based eye tracker for computer control , 1998, Assets '98.

[4]  Shumin Zhai,et al.  Manual and gaze input cascaded (MAGIC) pointing , 1999, CHI '99.

[5]  S. Liversedge,et al.  Saccadic eye movements and cognition , 2000, Trends in Cognitive Sciences.

[6]  M. Chun,et al.  Contextual cueing of visual attention , 2022 .

[7]  M. Hayhoe,et al.  The coordination of eye, head, and hand movements in a natural task , 2001, Experimental Brain Research.

[8]  Eileen Kowler,et al.  Visual scene memory and the guidance of saccadic eye movements , 2001, Vision Research.

[9]  J. Henderson.  Human gaze control during real-world scene perception , 2003, Trends in Cognitive Sciences.

[10]  Shigeo Wada,et al.  Development of hands-free operation interface for wearable computer-Hyper Hospital at home , 2003, Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No.03CH37439).

[11]  Wyatt S. Newman,et al.  A human-robot interface based on electrooculography , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[12]  D. Ballard,et al.  Eye movements in natural behavior , 2005, Trends in Cognitive Sciences.

[13]  A.T. Vehkaoja,et al.  Wireless Head Cap for EOG and Facial EMG Measurements , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[14]  W. Sardha Wijesoma,et al.  EOG based control of mobile assistive platforms for the severely disabled , 2005, 2005 IEEE International Conference on Robotics and Biomimetics - ROBIO.

[15]  Shumin Zhai,et al.  Conversing with the user based on eye-gaze patterns , 2005, CHI.

[16]  M. Land.  Eye movements and the control of actions in everyday life , 2006, Progress in Retinal and Eye Research.

[17]  Vaegan,et al.  ISCEV Standard for Clinical Electro-oculography (EOG) 2006 , 2006, Documenta Ophthalmologica.

[18]  Masaaki Fukumoto,et al.  Full-time wearable headphone-type gaze detector , 2006, CHI Extended Abstracts.

[19]  Grant Schindler,et al.  A Wearable Interface for Topological Mapping and Localization in Indoor Environments , 2006, LoCA.

[20]  Albrecht Schmidt,et al.  Interacting with the Computer Using Gaze Gestures , 2007, INTERACT.

[21]  Jennifer Healey,et al.  A Long-Term Evaluation of Sensing Modalities for Activity Recognition , 2007, UbiComp.

[22]  Gerhard Tröster,et al.  Robust Recognition of Reading Activity in Transit Using Wearable Electrooculography , 2009, Pervasive.