Gappy PCA Classification for Occlusion Tolerant 3D Face Detection

This paper presents an innovative approach for the detection of faces in three dimensional scenes. The method is tolerant against partial occlusions produced by the presence of any kind of object. The detection algorithm uses invariant properties of the surfaces to segment salient facial features, namely the eyes and the nose. At least two facial features must be clearly visible in order to perform face detection. Candidate faces are then registered using an ICP (Iterative Correspondent Point) based approach aimed to avoid those samples which belong to the occluding objects. The final face versus non-face discrimination is computed by a Gappy PCA (GPCA) classifier which is able to classify candidate faces using only those regions of the surface which are considered to be non-occluded. The algorithm has been tested using the UND database obtaining 100% of correct detection and only one false alarm. The database has been then processed with an artificial occlusions generator producing realistic acquisitions that emulate unconstrained scenarios. A rate of 89.8% of correct detections shows that 3D data is particularly suited for handling occluding objects. The results have been also verified on a small test set containing real world occlusions obtaining 90.4% of correctly detected faces. The proposed approach can be used to improve the robustness of all those systems requiring a face detection stage in non-controlled scenarios.

[1]  Shiguang Shan,et al.  Face relighting for face recognition under generic illumination , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[2]  Lawrence Sirovich,et al.  Karhunen–Loève procedure for gappy data , 1995 .

[3]  Kazuhiro Hotta.  A robust face detector under partial occlusion , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[4]  Kari Pulli,et al.  Multiview registration for large data sets , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[5]  Tom E. Bishop,et al.  Blind Image Restoration Using a Block-Stationary Signal Model , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[6]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[7]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using unit quaternions , 1987 .

[8]  Aleix M. Martínez,et al.  Recognition of partially occluded and/or imprecisely localized faces using a probabilistic approach , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[9]  K.W. Bowyer,et al.  Using a Multi-Instance Enrollment Representation to Improve 3D Face Recognition , 2007, 2007 First IEEE International Conference on Biometrics: Theory, Applications, and Systems.

[10]  Aleix M. Martínez,et al.  Recognizing Imprecisely Localized, Partially Occluded, and Expression Variant Faces from a Single Sample per Class , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Jun Wang,et al.  A 3D facial expression database for facial behavior research , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[12]  L. Akarun,et al.  A 3D Face Recognition System for Expression and Occlusion Invariance , 2008, 2008 IEEE Second International Conference on Biometrics: Theory, Applications and Systems.

[13]  Sang Chul Ahn,et al.  Glasses removal from facial image using recursive error compensation , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  R. Schettini,et al.  A 3D face recognition system using curvature-based detection and holistic multimodal classification , 2005, ISPA 2005. Proceedings of the 4th International Symposium on Image and Signal Processing and Analysis, 2005..

[15]  Gaile G. Gordon,et al.  Face recognition based on depth maps and surface curvature , 1991, Optics & Photonics.

[16]  Alan Watt,et al.  3D Computer Graphics , 1993 .

[17]  Patrick J. Flynn,et al.  Face Recognition Using 2D and 3D Facial Data , 2003 .

[18]  Anil K. Jain,et al.  Matching 2.5D face scans to 3D models , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Chiou-Shann Fuh,et al.  Fast Object Detection with Occlusions , 2004, ECCV.

[20]  Luc Van Gool,et al.  A Generalized EM Approach for 3D Model Based Face Recognition under Occlusions , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[21]  F. Tarres,et al.  A novel method for face recognition under partial occlusion or facial expression variations , 2005, 47th International Symposium ELMAR, 2005..

[22]  Jongsun Kim,et al.  Effective representation using ICA for face recognition robust to local distortion and partial occlusion , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Anil K. Jain,et al.  Deformation Analysis for 3D Face Matching , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[24]  Chin-Seng Chua,et al.  Face recognition from 2D and 3D images using 3D Gabor filters , 2005, Image Vis. Comput..

[25]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[27]  Song Zhang,et al.  A fast three-step phase-shifting algorithm , 2005, SPIE Optics East.

[28]  Ralph Gross,et al.  Active appearance models with occlusion , 2006, Image Vis. Comput..

[29]  Alexander M. Bronstein,et al.  Expression-Invariant 3D Face Recognition , 2003, AVBPA.

[30]  Raimondo Schettini,et al.  3D face detection using curvature analysis , 2006, Pattern Recognit..

[31]  V. Rovenski,et al.  Differential Geometry of Curves and Surfaces , 1952, Nature.

[32]  H. Piaggio.  Differential Geometry of Curves and Surfaces , 1952, Nature.

[33]  José F. Vélez,et al.  Face recognition using 3D surface extracted descriptors , 2003 .