Eye state detection from color facial image sequence

In this paper, an automatic and real time method for detecting eye states is proposed. The method is based on the fact that the regions of iris and white regions of an eyeball can be detected when it is open. In this case, color images contain more information helpful for detecting irises than intensity images. The saturation of color is used to detect whether the eye is open or closed, then the edge map of the eye image is used to detect the irises. Using the color information to detect the locations of irises is more accurate than using only the edge image. The image sequences are nearly frontal-view color facial image sequences. In the paper, some eye sequences, which are detected by this method, are shown.

[1]  Takeo Kanade,et al.  Recognizing Action Units for Facial Expression Analysis , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Takeo Kanade,et al.  Dual-state parametric eye tracking , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[3]  Lijun Yin,et al.  Eye tracking and animation for MPEG-4 coding , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[4]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[5]  Alan L. Yuille,et al.  Feature extraction from faces using deformable templates , 2004, International Journal of Computer Vision.

[6]  E. R. Davies,et al.  A modified Hough scheme for general circle location , 1988, Pattern Recognit. Lett..

[7]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  King-Sun Fu,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence Publication Information , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Steven A. Shafer Optical Phenomena in Computer Vision , 1984 .

[10]  Azriel Rosenfeld,et al.  Image Smoothing and Segmentation by Multiresolution Pixel Linking: Further Experiments and Extensions , 1982, IEEE Transactions on Systems, Man, and Cybernetics.

[11]  Feipei Lai,et al.  Region-based template deformation and masking for eye-feature extraction and description , 1997, Pattern Recognit..