Dynamic Visual Measurement of Driver Eye Movements

Vibrations often cause visual fatigue for drivers, and measuring the relative motion between the driver and the display is important for evaluating this visual fatigue. This paper proposes a non-contact videometric measurement method for studying the three-dimensional trajectories of the driver’s eyes based on stereo vision. The feasibility of this method is demonstrated by dynamic calibration. A high-speed dual-camera image acquisition system is used to obtain high-definition images of the face, and the relative trajectories between the eyes and the display are obtained by a set of robust algorithms. The trajectories of the eyes in three-dimensional space are then reconstructed during the vehicle driving process. This new approach provides three-dimensional information and is effective for assessing how vibration affects human visual performance.

[1]  Wolfgang Rosenstiel,et al.  Eyes wide open? eyelid location and eye aperture estimation for pervasive eye tracking in real-world scenarios , 2016, UbiComp Adjunct.

[2]  Michael J. Griffin,et al.  Predicting the effects of vertical vibration frequency, combinations of frequencies and viewing distance on the reading of numeric displays , 1980 .

[3]  Chi-Ting Horng,et al.  Effects of Horizontal Acceleration on Human Visual Acuity and Stereopsis , 2015, International journal of environmental research and public health.

[4]  Jin Zhang,et al.  High-accuracy three-dimensional reconstruction of vibration based on stereo vision , 2016 .

[5]  Rainer Lienhart,et al.  An extended set of Haar-like features for rapid object detection , 2002, Proceedings. International Conference on Image Processing.

[6]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[7]  Miguel Torres-Torriti,et al.  Face salient points and eyes tracking for robust drowsiness detection , 2012, Robotica.

[8]  Yun Yuan,et al.  Application of videometric technique to deformation measurement for large-scale composite wind turbine blade , 2012 .

[9]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Nilamani Bhoi,et al.  Template Matching based Eye Detection in Facial Image , 2010 .

[11]  Wolfgang Rosenstiel,et al.  Evaluation of state-of-the-art pupil detection algorithms on remote eye images , 2016, UbiComp Adjunct.

[12]  Tomaso A. Poggio,et al.  A general framework for object detection , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[13]  Chiuhsiang Joe Lin,et al.  Visual performance and fatigue in reading vibrating numeric displays , 2008, Displays.

[14]  Miguel Ángel Sotelo,et al.  Real-time system for monitoring driver vigilance , 2004, Proceedings of the IEEE International Symposium on Industrial Electronics, 2005. ISIE 2005..

[15]  Anil K. Jain,et al.  Face Detection in Color Images , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Frans C. T. van der Helm,et al.  Accurate Gaze Direction Measurements With Free Head Movement for Strabismus Angle Estimation , 2013, IEEE Transactions on Biomedical Engineering.

[17]  Peng Zhang,et al.  Three-Dimensional Identification for Unbalanced Mass of Rotor Systems in Operation , 2018 .

[18]  Michael J. Griffin,et al.  Predicting the effects of vibration frequency and axis, and seating conditions on the reading of numeric displays , 1980 .

[19]  John Daugman,et al.  How iris recognition works , 2002, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  Arturo de la Escalera,et al.  Real-Time Warning System for Driver Drowsiness Detection Using Visual Information , 2010, J. Intell. Robotic Syst..

[21]  Qiang Ji,et al.  Real-Time Eye, Gaze, and Face Pose Tracking for Monitoring Driver Vigilance , 2002, Real Time Imaging.

[22]  Mohan M. Trivedi,et al.  Head Pose Estimation and Augmented Reality Tracking: An Integrated System and Evaluation for Monitoring Driver Awareness , 2010, IEEE Transactions on Intelligent Transportation Systems.

[23]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[24]  Alexandrina Rogozan,et al.  Driver head pose estimation using efficient descriptor fusion , 2016, EURASIP J. Image Video Process..

[25]  M J Griffin,et al.  Effects of display vibration and whole-body vibration on visual performance. , 1986, Ergonomics.

[26]  Roziati Zainuddin,et al.  Pixel-based skin color detection technique , 2005 .

[27]  Mahboubeh Shamsi,et al.  Fast Algorithm for Iris Localization Using Daugman Circular Integro Differential Operator , 2009, 2009 International Conference of Soft Computing and Pattern Recognition.

[28]  Patrick J. Flynn,et al.  Experiments with an improved iris segmentation algorithm , 2005, Fourth IEEE Workshop on Automatic Identification Advanced Technologies (AutoID'05).

[29]  Shengjiang Chang,et al.  Eye gaze estimation from the elliptical features of one iris , 2011 .

[30]  Peter Avitabile,et al.  Full-field dynamic strain prediction on a wind turbine using displacements of optical targets measured by stereophotogrammetry , 2015 .

[31]  Alan C. Bovik,et al.  The Essential Guide to Image Processing , 2009, J. Electronic Imaging.