An hierarchical approach for human computer interaction using eyelid movements

This work proposes a method to achieve real-time Human-Computer interaction with the movements of the eyelids in low-resolution video. Classification of left and right eye states as closed or open are performed by an hierarchical approach of tracking by detection. After the initial detection of the face area, an efficient face tracking algorithm is used to reduce the search space for detection of eye region. By separating the eye region into two overlapping pieces, left and right eyes are detected and classified as closed or open. The proposed method is robust against mimics and multiple faces in the frame, while being unaffected by the negative effects of aliasing and resizing. Thus, people who suffer from medical conditions limiting their physical movement capabilities can interact with computers with their eyelid movements.

[1]  Hongbin Zha,et al.  A new method of detecting human eyelids based on deformable templates , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[2]  Rainer Lienhart,et al.  An extended set of Haar-like features for rapid object detection , 2002, Proceedings. International Conference on Image Processing.

[3]  Takeo Kanade,et al.  Dual-state parametric eye tracking , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[4]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[5]  Jörgen Ahlberg,et al.  An Active Model for Facial Feature Tracking , 2002, EURASIP J. Adv. Signal Process..

[6]  Huachun Tan,et al.  Detecting eye blink states by tracking iris and eyelids , 2006, Pattern Recognit. Lett..

[7]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[8]  Maja Pantic,et al.  Hierarchical On-line Appearance-Based Tracking for 3D head pose, eyebrows, lips, eyelids and irises , 2013, Image Vis. Comput..

[9]  Rui Caseiro,et al.  Exploiting the Circulant Structure of Tracking-by-Detection with Kernels , 2012, ECCV.

[10]  Robert J. K. Jacob,et al.  Eye Movement-Based Human-Computer Interaction Techniques: Toward Non-Command Interfaces , 2003 .