Facial Feature Extraction and Change Analysis Using Photometric Stereo

This paper presents a new technique for three-dimensional face analysis aimed towards improving the robustness of face recognition. All of the 3D data used in the paper are obtained from a high-speed photometric stereo arrangement. First, a nose detection algorithm is presented, which is largely based on existing work, before a novel method for finding the nasion is described. Both of these methods rely solely on the 3D data. A new eye detection method is then described that uses a combination of 3D and 2D information with adaptive thresholding applied to the region of the image surrounding the eyes. The next main contribution of the paper is an analysis of the effects of makeup and facial hair on the success of the reconstruction and feature detection. We found that our method is very robust to such complications and can also handle spectacles and pose variation in many cases.

[1]  Takeo Kanade,et al.  Rotation Invariant Neural Network-Based Face Detection , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[2]  Azriel Rosenfeld,et al.  Eye detection in a face image using linear and nonlinear filters , 2001, Pattern Recognit..

[3]  Andrew Zisserman,et al.  Regression and classification approaches to eye localization in face images , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[4]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[5]  Mohammed Bennamoun,et al.  An Efficient Multimodal 2D-3D Hybrid Approach to Automatic Face Recognition , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Wai-kuen Cham,et al.  Extracting eyebrow contour and chin contour for face recognition , 2007, Pattern Recognit..

[7]  Irfan A. Essa,et al.  Detecting and tracking eyes by using their physiological properties, dynamics, and appearance , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[8]  Rama Chellappa,et al.  A Method for Enforcing Integrability in Shape from Shading Algorithms , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Rogério Schmidt Feris,et al.  Hierarchical wavelet networks for facial feature localization , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[10]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[11]  Robert J. Woodham,et al.  Photometric method for determining surface orientation from multiple images , 1980 .

[12]  Jim R. Parker,et al.  Algorithms for image processing and computer vision , 1996 .

[13]  Vijayan K. Asari,et al.  Pose Angle Determination by Face, Eyes and Nose Localization , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[14]  Rama Chellappa,et al.  Face Processing: Advanced Modeling and Methods , 2006, J. Electronic Imaging.

[15]  A. Yuille Deformable Templates for Face Recognition , 1991, Journal of Cognitive Neuroscience.

[16]  Qiang Ji,et al.  Multi-view face and eye detection using discriminant features , 2007, Comput. Vis. Image Underst..

[17]  Ioannis A. Kakadiaris,et al.  Three-Dimensional Face Recognition in the Presence of Facial Expressions: An Annotated Deformable Model Approach , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.