Automatic Visual Behavior Analysis

This work explores the possibilities of robust, noise adaptive and automatic segmentation of driver eye movements into comparable quantities as defined in the ISO 15007 and SAE J2396 standards for in-vehicle visual demand measurements. Driver eye movements have many potential applications, from the detection of driver distraction, drowsiness and mental workload, to the optimization of in-vehicle HMIs. This work focuses on SeeingMachines head and eye-tracking system SleepyHead (or FaceLAB), but is applicable to data from other similar eye-tracking systems. A robust and noise adaptive hybrid algorithm, based on two different change detection protocols and facts about eye-physiology, has been developed. The algorithm has been validated against data, video transcribed according to the ISO/SAE standards. This approach was highly successful, revealing correlations in the region of 0.999 between analysis types i.e. video transcription and the analysis developed in this work. Also, a real-time segmentation algorithm, with a unique initialization fefature, has been developed and validated based on the same approach.This work enables real-time in-vehicle systems, based on driver eye-movements, to be developed and tested in real driving conditions. Furthermore, it has augmented FaceLAB by providing a tool that can easily be used when analysis of eye movements are of interest e.g. HMI and ergonomics studies, analysis of warnings, driver workload estimation etc.

[1]  M Juhola,et al.  Detection of saccadic eye movements using a non-recursive adaptive digital filter. , 1985, Computer methods and programs in biomedicine.

[2]  Lingyu Chen,et al.  Identification of fixations in reading eye movements by a multi-layer neural network , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[3]  Guillaume S. Masson,et al.  Motion perception during saccadic eye movements , 2000, Nature Neuroscience.

[4]  Joseph H. Goldberg,et al.  Identifying fixations and saccades in eye-tracking protocols , 2000, ETRA.

[5]  David Brie,et al.  On-line Separation Of Smooth Pursuit And Saccadic Eye Movements , 1990, [1990] Proceedings of the Twelfth Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[6]  V. Jäntti,et al.  Analysis of saccadic eye movements with a microcomputer. , 1986, Journal of biomedical engineering.

[7]  Michael J. Goodman,et al.  The role of driver inattention in crashes: new statistics from the 1995 crashworthiness data system , 1996 .

[8]  A. Bahill,et al.  Block-processing adaptive filter for human eye movements , 1989 .

[9]  Jason Jianjun Gu,et al.  Analysis of eye tracking movements using FIR median hybrid filters , 2000, ETRA.

[10]  T. Uemura,et al.  Eye-head coordination during lateral gaze in normal subjects. , 1980, Acta oto-laryngologica.

[11]  Alexander Zelinsky,et al.  An algorithm for real-time stereo vision implementation of head pose and gaze direction measurement , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[12]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[13]  Andrew Liu.  Chapter 20 – What the Driver's Eye Tells the Car's Brain , 1998 .

[14]  A Värri,et al.  Nonlinear eye movement detection method for drowsiness studies. , 1996, International journal of bio-medical computing.

[15]  Moshe Eizenman,et al.  THE IMPACT OF COGNITIVE DISTRACTION ON DRIVER VISUAL BEHAVIOUR AND VEHICLE CONTROL , 2002 .

[16]  R. Hastings-James,et al.  A Comparison of Digital Algorithms Used in Computing the Derivative of Left Ventricular Pressure , 1981, IEEE Transactions on Biomedical Engineering.

[17]  M Juhola,et al.  Median filtering is appropriate to signals of saccadic eye movements. , 1991, Computers in biology and medicine.

[18]  J R Treat,et al.  TRI-LEVEL STUDY OF THE CAUSES OF TRAFFIC ACCIDENTS: FINAL REPORT , 1979 .

[19]  M. A. Recarte,et al.  Effects of verbal and spatial-imagery tasks on eye fixations while driving. , 2000, Journal of experimental psychology. Applied.