Extraction and tracking of the eyelids

Facial analysis is used in a number of applications like face recognition systems, human-computer interaction through head movements or facial expressions, or model based coding. In all these applications a very precise extraction of the feature points corresponding to the eyes is necessary. In this paper we present a method for automatic extraction and tracking of the eyelids. First the images are filtered in order to enhance the interesting features. Then a dynamic programming algorithm is applied to extract the precise shape of the eyelids. Although restrictions are applied on the possible shapes, they are not modeled as ellipse arcs. This allows extracting the corner of the eyes with higher precision. Once the eyelids are extracted for the first image, a new robust tracking algorithm based on snakes is applied to track them along the sequence, which allows large motion of the eyes and rotation and zooming of the head.

[1]  Alok Gupta,et al.  Dynamic Programming for Detecting, Tracking, and Matching Deformable Contours , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Frederic Fol Leymarie,et al.  Tracking Deformable Objects in the Plane Using an Active Contour Model , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  L YuilleAlan,et al.  Feature extraction from faces using deformable templates , 1992 .

[4]  Alberto Del Bimbo,et al.  Real-time head tracking from the deformation of eye contours using a piecewise affine camera , 1999, Pattern Recognit. Lett..

[5]  Luc Vincent,et al.  Minimal path algorithms for the robust detection of linear features in gray images , 1998 .

[6]  Jean Serra,et al.  Image Analysis and Mathematical Morphology , 1983 .

[7]  Ramesh C. Jain,et al.  Using Dynamic Programming for Solving Variational Problems in Vision , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Larry S. Davis,et al.  Computing 3-D head orientation from a monocular image sequence , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[9]  Montse Pardàs,et al.  A new approach to tracking with active contours , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[10]  Roberto Brunelli,et al.  Face Recognition: Features Versus Templates , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Aljoscha Smolic,et al.  Real-time estimation of long-term 3-D motion parameters for SNHC face animation and model-based coding applications , 1999, IEEE Trans. Circuits Syst. Video Technol..

[12]  Larry S. Davis,et al.  Computing 3-D head orientation from a monocular image sequence , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[13]  J. Ahlberg.  Extraction and Coding of Face Model Parameters , 1999 .

[14]  Verónica Vilaplana,et al.  Region-based segmentation and tracking of human faces , 1998, 9th European Signal Processing Conference (EUSIPCO 1998).

[15]  Alex Pentland,et al.  Coding, Analysis, Interpretation, and Recognition of Facial Expressions , 1997, IEEE Trans. Pattern Anal. Mach. Intell..