Meticulously detailed eye model and its application to analysis of facial image

We propose a system that is capable of detailed analysis of eye region images including position of the iris, degree of eyelid opening, and shape and texture of the eyelid. The system is based on a generative eye model that defines fine structures and motions of eye. The structure parameters represent structural individuality of the eye, including size and color of the iris, width and boldness of the double-fold eyelid, width of the bulge below the eye and width of the illumination reflection on the bulge. The motion parameters represent movements of the eye, including up-down position of the upper and lower eyelids and 2D position of the iris. The system first registers the eye model to the input in a particular frame and individualizes the model by adjusting the structure parameters. Then, it tracks motion of the eye by estimating the motion parameters across the entire image sequence. Combined with image stabilization to compensate the head motion, the registration and motion recovery of the eye are guaranteed to be robust.

[1]  Takeo Kanade,et al.  Recognizing Action Units for Facial Expression Analysis , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Yiannis Aloimonos,et al.  Active vision , 2004, International Journal of Computer Vision.

[3]  Jing Xiao,et al.  Robust full‐motion recovery of head by dynamic templates and re‐registration techniques , 2003 .

[4]  Alex Pentland,et al.  Face recognition using eigenfaces , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Hanqi Zhuang,et al.  On improving eye feature extraction using deformable templates , 1994, Pattern Recognit..

[6]  Maja Pantic,et al.  Automatic Analysis of Facial Expressions: The State of the Art , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Alan L. Yuille,et al.  Feature extraction from faces using deformable templates , 2004, International Journal of Computer Vision.

[8]  Thomas Vetter,et al.  A morphable model for the synthesis of 3D faces , 1999, SIGGRAPH.

[9]  Jian-Gang Wang,et al.  Study on eye gaze estimation , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[10]  Xiaobo Li,et al.  Towards a system for automatic facial feature detection , 1993, Pattern Recognit..

[11]  Ilse Ravyse,et al.  Eye activity detection and recognition using morphological scale-space decomposition , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[12]  Rainer Herpers,et al.  Edge and keypoint detection in facial regions , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[13]  Takeo Kanade,et al.  Comprehensive database for facial expression analysis , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[14]  Alexander Zelinsky,et al.  Behavior recognition based on head pose and gaze direction measurement , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[15]  Bernd Girod,et al.  Model-based face tracking for view-independent facial expression recognition , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[16]  Yuan Qi,et al.  Fully automatic upper facial action recognition , 2003, 2003 IEEE International SOI Conference. Proceedings (Cat. No.03CH37443).

[17]  L Sirovich,et al.  Low-dimensional procedure for the characterization of human faces. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[18]  Maja Pantic,et al.  Expert system for automatic analysis of facial expressions , 2000, Image Vis. Comput..

[19]  Norman I. Badler,et al.  Eyes alive , 2002, ACM Trans. Graph..

[20]  Jie Zhu,et al.  Subpixel eye gaze tracking , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[21]  G. Cottrell,et al.  Categorical Perception in Facial Emotion Classification , 1996 .

[22]  K. Fukuda,et al.  Eye blinks: new indices for the detection of deception. , 2001, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[23]  J. Cohn,et al.  Automatic recognition of eye blinking in spontaneously occurring behavior , 2002 .

[24]  P. Ekman,et al.  The ability to detect deceit generalizes across different types of high-stake lies. , 1997, Journal of personality and social psychology.

[25]  K. H. Kim,et al.  Dynamic and quantitative evaluation of eyelid motion using image analysis , 2006, Medical and Biological Engineering and Computing.

[26]  Nanning Zheng,et al.  Example-based facial sketch generation with non-parametric sampling , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[27]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.