A Fast, Robust, Automatic Blink Detector

Introduction “Blink” is defined as closing and opening of the eyes in a small duration of time. In this study, we aimed to introduce a fast, robust, vision-based approach for blink detection. Materials and Methods This approach consists of two steps. In the first step, the subject’s face is localized every second and with the first blink, the system detects the eye’s location and creates an open-eye template image. In the second step, the eye is tracked, using sum of squared differences (SSD). This system can classify the state of the eyes as open, closed, or lost, using the SSD-based classifier. If the eyes are closed as in usual blinking, the blink will be detected. To classify eyes as closed or open, two adaptive thresholds were proposed; therefore, factors such as the subject’s distance from the camera or environment illumination did not affect the system performance. In addition, in order to improve system performance, a new feature, called "peak-to-neighbors ratio", was proposed. Results The accuracy of this system was 96.03%, based on the evaluation on Zhejiang University (ZJU) dataset, and 98.59% in our own dataset. Conclusion The present system was faster than other systems, which use normalized correlation coefficient (NCC) for eye tracking, since time complexity of SSD is lower than that of NCC. The achieved processing rate for ZJU dataset was 35 fps.

[1]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[2]  Silvia Conforto,et al.  An adaptive blink detector to initialize and update a view-basedremote eye gaze tracking system in a natural scenario , 2009, Pattern Recognit. Lett..

[3]  Chabane Djeraba,et al.  Drowsy driver detection system using eye blink patterns , 2010, 2010 International Conference on Machine and Web Intelligence.

[4]  Yaoru Sun,et al.  Blink Detection Using 3D Cross Model , 2012, 2012 Fifth International Symposium on Computational Intelligence and Design.

[5]  Paul Blenkhorn,et al.  Blink detection for real-time eye tracking , 2002, J. Netw. Comput. Appl..

[6]  Lin Sun,et al.  Eyeblink-based Anti-Spoofing in Face Recognition from a Generic Webcamera , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[7]  Kwanghoon Sohn,et al.  Visual fatigue monitoring system based on eye-movement and eye-blink detection , 2011, Electronic Imaging.

[8]  Fabio Lo Castro,et al.  Class I infrared eye blinking detector , 2008 .

[9]  Horst Bischof,et al.  Eye Blink Based Fatigue Detection for Prevention of Computer Vision Syndrome , 2009, MVA.

[10]  C. Blehm,et al.  Computer vision syndrome: a review. , 2005, Survey of ophthalmology.

[11]  Margrit Betke,et al.  Communication via eye blinks and eyebrow raises: video-based human-computer interfaces , 2003, Universal Access in the Information Society.

[12]  Margrit Betke,et al.  Communication via eye blinks - detection and duration analysis in real time , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[13]  Atif Bin Mansoor,et al.  Real Time Eyes Tracking and Classification for Driver Fatigue Detection , 2008, ICIAR.

[14]  Pawel Strumillo,et al.  Eye-blink detection system for human–computer interaction , 2011, Universal Access in the Information Society.

[15]  Y. V. Venkatesh,et al.  Blink detection and eye tracking for eye localization , 2003, TENCON 2003. Conference on Convergent Technologies for Asia-Pacific Region.

[16]  Muzammil Khan,et al.  Suitable Length of Text Line on the Bases of Eye Blink for Reducing Maximum Focus Losses , 2012 .

[17]  Zoran Duric,et al.  Using Image Flow to Detect Eye Blinks in Color Videos , 2007, 2007 IEEE Workshop on Applications of Computer Vision (WACV '07).

[18]  Takeo Kanade,et al.  Dual-state parametric eye tracking , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[19]  Aleksandra KrolakPaweø Strumiøøo Eye-blink detection system for human-computer interaction , 2012 .