Robust Recognition of Reading Activity in Transit Using Wearable Electrooculography

In this work we analyse the eye movements of people in transit in an everyday environment using a wearable electrooculographic (EOG) system. We compare three approaches for continuous recognition of reading activities: a string matching algorithm which exploits typical characteristics of reading signals, such as saccades and fixations; and two variants of Hidden Markov Models (HMMs) - mixed Gaussian and discrete. The recognition algorithms are evaluated in an experiment performed with eight subjects reading freely chosen text without pictures while sitting at a desk, standing, walking indoors and outdoors, and riding a tram. A total dataset of roughly 6 hours was collected with reading activity accounting for about half of the time. We were able to detect reading activities over all subjects with a top recognition rate of 80.2% (71.0% recall, 11.6% false positives) using string matching. We show that EOG is a potentially robust technique for reading recognition across a number of typical daily situations.

[1]  Masaaki Fukumoto,et al.  Full-time wearable headphone-type gaze detector , 2006, CHI Extended Abstracts.

[2]  Paul Lukowicz,et al.  Activity Recognition of Assembly Tasks Using Body-Worn Microphones and Accelerometers , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  D. Ballard,et al.  Eye movements in natural behavior , 2005, Trends in Cognitive Sciences.

[4]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[5]  John L. Sibert,et al.  The reading assistant: eye gaze triggered auditory prompting for reading remediation , 2000, UIST '00.

[6]  Jennifer Healey,et al.  A Long-Term Evaluation of Sensing Modalities for Activity Recognition , 2007, UbiComp.

[7]  Mohammad Ali Tinati,et al.  A Wavelet Packets Approach to Electrocardiograph Baseline Drift Cancellation , 2006, Int. J. Biomed. Imaging.

[8]  Kristof Van Laerhoven,et al.  Long term activity monitoring with a wearable sensor node , 2006, International Workshop on Wearable and Implantable Body Sensor Networks (BSN'06).

[9]  A.T. Vehkaoja,et al.  Wireless Head Cap for EOG and Facial EMG Measurements , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[10]  Paul P. Maglio,et al.  A robust algorithm for reading detection , 2001, PUI '01.

[11]  W. Sardha Wijesoma,et al.  EOG based control of mobile assistive platforms for the severely disabled , 2005, 2005 IEEE International Conference on Robotics and Biomimetics - ROBIO.

[12]  Manuel Mazo,et al.  EOG guidance of a wheelchair using neural networks , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[13]  Shumin Zhai,et al.  Gaze and Speech in Attentive User Interfaces , 2000, ICMI.

[14]  Y. V. Venkatesh,et al.  Eye gaze based reading detection , 2003, TENCON 2003. Conference on Convergent Technologies for Asia-Pacific Region.

[15]  Sarabjeet Singh Mehta,et al.  Total Removal of Baseline Drift from ECG Signal , 2007, 2007 International Conference on Computing: Theory and Applications (ICCTA'07).

[16]  L. Rabiner,et al.  An introduction to hidden Markov models , 1986, IEEE ASSP Magazine.

[17]  Shumin Zhai,et al.  Conversing with the user based on eye-gaze patterns , 2005, CHI.

[18]  Paul Lukowicz,et al.  Distributed Modular Toolbox for Multi-modal Context Recognition , 2006, ARCS.

[19]  Paul Lukowicz,et al.  Evaluating Performance in Continuous Context Recognition Using Event-Driven Error Characterisation , 2006, LoCA.

[20]  S. Venkataramanan,et al.  Biomedical instrumentation based on electrooculogram (EOG) signal processing and application to a hospital alarm system , 2005, Proceedings of 2005 International Conference on Intelligent Sensing and Information Processing, 2005..

[21]  Jason Jianjun Gu,et al.  A study of natural eye movement detection and ocular implant movement control using processed EOG signals , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[22]  Wyatt S. Newman,et al.  A human-robot interface based on electrooculography , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[23]  Guang Li,et al.  Development of an EOG (Electro-Oculography) Based Human-Computer Interface , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.