Automatic detection of saccadic eye movements using EOG for analysing effects of cognitive distraction during driving

Driver distraction is a relevant driving safety issue and an ongoing field of research. A particular distraction is cognitive distraction, which refers to when the driver is mentally engaged in a task unrelated to driving, e.g. talking to a passenger. Eye movements can be analyzed to study effects of cognitive distraction during driving, and are typically recorded using video-based eye tracker systems. An alternative technique that might be suitable for eye movements measurements during driving is the electro-oculography (EOG). EOG is a method for recording the electrical signal of the eyes as they move. One interesting eye movement in cognitive distraction studies is the saccade, the rapid movement of the eye from one point of interest to another. The primary purpose of this thesis is to develop an algorithm for automatic detection of saccades using EOG. The resulting algorithm is a combination of two modified existing eye detection algorithms, namely Continuous Wavelet Transform Saccade Detection (CWT-SD) and Shape Features. It is found that the developed algorithm can be used in driving environments if good signal quality can be assured. The secondary purpose of this thesis is to investigate how cognitive distraction affects saccadic rate and amplitude during driving. The findings suggest a statistically significant decrease in saccadic rate during cognitive load but not in saccade amplitude. However, further research on bigger datasets and different driving scenarios is needed to verify the results.

[1]  A. T. Smith,et al.  An efficient technique for determining characteristics of saccadic eye movements using a mini computer. , 1981, Journal of biomedical engineering.

[2]  J. May,et al.  Eye movement indices of mental workload. , 1990, Acta psychologica.

[3]  K. Bötzel,et al.  Saccadic dynamic overshoot in normals and patients , 1993 .

[4]  Robert Plonsey,et al.  Bioelectromagnetism: Principles and Applications of Bioelectric and Biomagnetic Fields , 1995 .

[5]  S Lebedev,et al.  Square-root relations between main saccadic parameters. , 1996, Investigative ophthalmology & visual science.

[6]  Joseph H. Goldberg,et al.  Identifying fixations and saccades in eye-tracking protocols , 2000, ETRA.

[7]  M. A. Recarte,et al.  Effects of verbal and spatial-imagery tasks on eye fixations while driving. , 2000, Journal of experimental psychology. Applied.

[8]  The Actions and Innervation of Extraocular Muscles , 2001 .

[9]  Moshe Eizenman,et al.  THE IMPACT OF COGNITIVE DISTRACTION ON DRIVER VISUAL BEHAVIOUR AND VEHICLE CONTROL , 2002 .

[10]  Alessandro B. Romeo,et al.  N-body simulations with two-orders-of-magnitude higher performance using wavelets , 2003 .

[11]  Andrew T. Duchowski.  Taxonomy and Models of Eye Movements , 2003 .

[12]  Alessandro B. Romeo,et al.  ReadMe: JOFILUREN - A wavelet add-on code for new-generation N-body simulations and data de-noising , 2004 .

[13]  H. Nazeran,et al.  Wavelet Transform-Based ECG Baseline Drift Removal for Body Surface Potential Mapping , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[14]  Mohammad Ali Tinati,et al.  A Wavelet Packets Approach to Electrocardiograph Baseline Drift Cancellation , 2006, Int. J. Biomed. Imaging.

[15]  R. Leigh,et al.  The neurology of eye movements , 2006 .

[16]  Li Wei,et al.  Experiencing SAX: a novel symbolic representation of time series , 2007, Data Mining and Knowledge Discovery.

[17]  C. Helmchen,et al.  The eyelid and its contribution to eye movements. , 2007, Developments in ophthalmology.

[18]  Ulrich Büttner,et al.  Smooth pursuit eye movements and optokinetic nystagmus. , 2007, Developments in ophthalmology.

[19]  Thomas Eggert,et al.  Eye movement recordings: methods. , 2007, Developments in ophthalmology.

[20]  Pun Sio Hang,et al.  Accurate Removal of Baseline Wander in ECG Using Empirical Mode Decomposition , 2007, 2007 Joint Meeting of the 6th International Symposium on Noninvasive Functional Source Imaging of the Brain and Heart and the International Conference on Functional Biomedical Imaging.

[21]  Sarabjeet Singh Mehta,et al.  Total Removal of Baseline Drift from ECG Signal , 2007, 2007 International Conference on Computing: Theory and Applications (ICCTA'07).

[22]  Long-term eye movement recordings with a scleral search coil-eyelid protection device , 2008 .

[23]  Michelle L. Reyes,et al.  Effects of cognitive load presence and duration on driver eye movements and event detection performance , 2008 .

[24]  Riad I. Hammoud,et al.  Passive Eye Monitoring: Algorithms, Applications and Experiments , 2008 .

[25]  Pekka-Henrik Niemenlehto,et al.  Constant false alarm rate detection of saccadic eye movements in electro-oculography , 2009, Comput. Methods Programs Biomed..

[26]  John D. Enderle,et al.  Models of Horizontal Eye Movements, Part I: Early Models of Saccades and Smooth Pursuit , 2010, Models of Horizontal Eye Movements, Part I.

[27]  F. Behrens,et al.  An improved algorithm for automatic detection of saccades in eye movement data and for calculating saccade parameters , 2010, Behavior research methods.

[28]  Andreas Bulling,et al.  Eye movement analysis for context inference and cognitive-awareness: wearable sensing and activity recognition using electrooculography , 2010 .

[29]  Gerhard Tröster,et al.  Eye Movement Analysis for Activity Recognition Using Electrooculography , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Andreas Bulling,et al.  Wearable eye tracking for mental health monitoring , 2012, Comput. Commun..

[31]  Yuan Li,et al.  Rotation-invariant similarity in time series using bag-of-patterns representation , 2012, Journal of Intelligent Information Systems.

[32]  Hans-Werner Gellersen,et al.  Detection of smooth pursuits using eye movement shape features , 2012, ETRA.

[33]  Hans-Werner Gellersen,et al.  Multimodal recognition of reading activity in transit using body-worn sensors , 2012, TAP.

[34]  Kayvan Najarian,et al.  A Hierarchical Method for Removal of Baseline Drift from Biomedical Signals: Application in ECG Analysis , 2013, TheScientificWorldJournal.

[35]  Kati Pettersson,et al.  Algorithm for automatic analysis of electro-oculographic data , 2013, BioMedical Engineering OnLine.

[36]  David L. Strayer,et al.  Measuring Cognitive Distraction in the Automobile , 2013 .

[37]  D. Zee,et al.  Revisiting corrective saccades: Role of visual feedback , 2013, Vision Research.

[38]  Thomas Burger,et al.  An EOG-based, head-mounted eye tracker with 1 kHz sampling rate , 2015, 2015 IEEE Biomedical Circuits and Systems Conference (BioCAS).

[39]  Kamalesh Kumar Sharma,et al.  Baseline wander removal of ECG signals using Hilbert vibration decomposition , 2015 .

[40]  Andreas Bulling,et al.  End-to-End Eye Movement Detection Using Convolutional Neural Networks , 2016, ArXiv.

[41]  Michele Rucci,et al.  Fixational eye movements and perception , 2016, Vision Research.

[42]  Natasha Merat,et al.  Effects of Cognitive Load on Driving Performance: The Cognitive Control Hypothesis , 2017, Hum. Factors.

[43]  M. Bach,et al.  ISCEV standard for clinical electro-oculography (2010 update) , 2017, Documenta ophthalmologica. Advances in ophthalmology.