An Approach to Track Reading Progression Using Eye-Gaze Fixation Points

In this paper, we consider the problem of tracking the eye-gaze of individuals while they engage in reading. Particularly, we develop ways to accurately track the line being read by an individual using commercially available eye tracking devices. Such an approach will enable futuristic functionalities such as comprehension evaluation, interest level detection, and user-assisting applications like hands-free navigation and automatic scrolling. Existing commercial eye trackers provide an estimated location of the eye-gaze fixations every few milliseconds. However, this estimated data is found to be very noisy. As such, commercial eye-trackers are unable to accurately track lines while reading. In this paper we propose several statistical models to bridge the commercial gaze tracker outputs and eye-gaze patterns while reading. We then employ hidden Markov models to parametrize these statistical models and to accurately detect the line being read. The proposed approach is shown to yield an improvement of over 20% in line detection accuracy.

[1]  Aulikki Hyrskykari,et al.  Utilizing eye movements: Overcoming inaccuracy while tracking the focus of attention during reading , 2006, Comput. Hum. Behav..

[2]  Margaret Floy Washburn,et al.  The Psychology And Pedagogy Of Reading , 1908 .

[3]  Pedro J. Rosa,et al.  Beyond Traditional Clinical Measurements for Screening Fears and Phobias , 2015, IEEE Transactions on Instrumentation and Measurement.

[4]  Howell O. Istance,et al.  Snap clutch, a moded approach to solving the Midas touch problem , 2008, ETRA.

[5]  Keith Rayner,et al.  Understanding Eye Movements in Reading. , 1997 .

[6]  Thorsten Joachims,et al.  Eye-tracking analysis of user behavior in WWW search , 2004, SIGIR '04.

[7]  Bryan Reimer,et al.  Glance analysis of driver eye movements to evaluate distraction , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[8]  Boris M. Velichkovsky,et al.  Towards gaze-mediated interaction: Collecting solutions of the "Midas touch problem" , 1997, INTERACT.

[9]  Linden J. Ball,et al.  Eye tracking in HCI and usability research. , 2006 .

[10]  K. Rayner Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[11]  Krishna R. Pattipati,et al.  Performance Evaluation of the Gazepoint GP3 Eye Tracking Device Based on Pupil Dilation , 2017, HCI.

[12]  Joseph T. Coyne,et al.  Applying Real Time Physiological Measures of Cognitive Load to Improve Training , 2009, HCI.

[13]  Christian P. Robert,et al.  Machine Learning, a Probabilistic Perspective , 2014 .

[14]  J. Joormann,et al.  Attentional disengagement predicts stress recovery in depression: an eye-tracking study. , 2013, Journal of abnormal psychology.

[15]  Wolfgang Birk,et al.  A driver-distraction-based lane-keeping assistance system , 2007 .

[16]  F. Volkmar,et al.  Visual fixation patterns during viewing of naturalistic social situations as predictors of social competence in individuals with autism. , 2002, Archives of general psychiatry.

[17]  Tamás D. Gedeon,et al.  Automatic clustering of eye gaze data for machine learning , 2016, 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[18]  Roberts Paeglis,et al.  Maximizing reading: pattern analysis to describe points of gaze , 2006, SPIE Optics + Photonics.

[19]  Joseph T. Coyne,et al.  Cognitive context detection in UAS operators using eye-gaze patterns on computer screens , 2016, SPIE Defense + Security.

[20]  Chabane Djeraba,et al.  Analyzing eye fixations and gaze orientations on films and pictures , 2008, ACM Multimedia.

[21]  J. Piven,et al.  Looking you in the mouth: abnormal gaze in autism resulting from impaired top-down modulation of visual attention. , 2006, Social cognitive and affective neuroscience.

[22]  Xue-Bai Zhang,et al.  Eye Tracking Based Control System for Natural Human-Computer Interaction , 2017, Comput. Intell. Neurosci..

[23]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[24]  Thomas Armstrong,et al.  Eye tracking of attention in the affective disorders: a meta-analytic review and synthesis. , 2012, Clinical psychology review.

[25]  Alexander Pollatsek,et al.  Eye movements and word skipping during reading revisited. , 2005, Journal of experimental psychology. Human perception and performance.

[26]  Qian Zhao,et al.  Gaze Prediction for Recommender Systems , 2016, RecSys.

[27]  Yuan-Hsiang Lin,et al.  Contactless Monitoring of Pulse Rate and Eye Movement for Uveal Melanoma Patients Undergoing Radiation Therapy , 2019, IEEE Transactions on Instrumentation and Measurement.

[28]  Hao Jiang,et al.  Personalized online document, image and video recommendation via commodity eye-tracking , 2008, RecSys '08.

[29]  Laura Florea Future trends in early diagnosis for cognition impairments in children based on eye measurements [Trends in Future I&M] , 2018, IEEE Instrumentation & Measurement Magazine.

[30]  Nitish V. Thakor,et al.  Demonstration of a Semi-Autonomous Hybrid Brain–Machine Interface Using Human Intracranial EEG, Eye Tracking, and Computer Vision to Control a Robotic Upper Limb Prosthetic , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[31]  Amine Naït-Ali,et al.  An Adaptive Algorithm for Eye-Gaze-Tracking-Device Calibration , 2008, IEEE Transactions on Instrumentation and Measurement.

[32]  John Paulin Hansen,et al.  Eye-gaze control of multimedia systems , 1995 .

[33]  Samuel Kaski,et al.  Combining eye movements and collaborative filtering for proactive information retrieval , 2005, SIGIR '05.