A novel method for eye tracking and blink detection in video frames

This paper presents a novel method for eye tracking and blink detection in the video frames obtained from low resolution consumer grade web cameras. It uses a method involving Haar based cascade classifier for eye tracking and a combination of HOG features with SVM classifier for eye blink detection. The presented method is non intrusive and hence provides a comfortable user interaction. The eye tracking method has an accuracy of 92.3% and the blink detection method has an accuracy of 92.5% when tested using standard databases and a combined accuracy of 86% when tested under real world conditions of a normal room.

[1]  Yoav Freund,et al.  A Short Introduction to Boosting , 1999 .

[2]  Zhiwei Zhu,et al.  Real-time nonintrusive monitoring and prediction of driver fatigue , 2004, IEEE Transactions on Vehicular Technology.

[3]  Pawel Strumillo,et al.  Eye-blink detection system for human–computer interaction , 2011, Universal Access in the Information Society.

[4]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[5]  Rainer Lienhart,et al.  An extended set of Haar-like features for rapid object detection , 2002, Proceedings. International Conference on Image Processing.

[6]  Dongheng Li,et al.  Starburst: A hybrid algorithm for video-based eye tracking combining feature-based and model-based approaches , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[7]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[8]  Margrit Betke,et al.  Real Time Eye Tracking and Blink Detection with USB Cameras , 2005 .

[9]  Ö Oguz,et al.  The proportion of the face in younger adults using the thumb rule of leonardo da vinci , 2005, Surgical and Radiologic Anatomy.

[10]  Normand Teasdale,et al.  Real-time eye blink detection with GPU-based SIFT tracking , 2007, Fourth Canadian Conference on Computer and Robot Vision (CRV '07).

[11]  Andy Harter,et al.  Parameterisation of a stochastic model for human face identification , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[12]  Amarnag Subramanya,et al.  Real time eye tracking for human computer interfaces , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[13]  Maja Pantic,et al.  Hierarchical On-line Appearance-Based Tracking for 3D head pose, eyebrows, lips, eyelids and irises , 2013, Image Vis. Comput..

[14]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .

[15]  Xiaoyang Tan,et al.  Eyes closeness detection from still images with multi-scale histograms of principal oriented gradients , 2014, Pattern Recognit..

[16]  Hai DINH,et al.  EYE BLINK DETECTION USING INTENSITY VERTICAL PROJECTION , 2012 .

[17]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[18]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[19]  David J. Kriegman,et al.  The yale face database , 1997 .

[20]  Aleksandra KrolakPaweø Strumiøøo.  Eye-blink detection system for human-computer interaction , 2012 .

[21]  Lin Sun,et al.  Eyeblink-based Anti-Spoofing in Face Recognition from a Generic Webcamera , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[22]  Hema Pavithra.S,et al.  Real-Time Nonintrusive Monitoring And Prediction Of Driver Fatigue , 2016 .

[23]  Peter M. Corcoran,et al.  Statistical models of appearance for eye tracking and eye-blink detection and measurement , 2008, IEEE Transactions on Consumer Electronics.