Reconstruction of Partially Occluded Face by Fast Recursive PCA

This paper proposes a fast recursive PCA (principal component analysis) algorithm to remove face occlusions. In training phase, all faces are normalized by two eye centers and two mouth corners, and eigenvectors (eigenfaces) were obtained by PCA analysis. In test phase, face occlusion is removed by iteratively perform two steps of analysis and synthesis. New damaged face is first normalized by clicking four feature points, and PCA coefficients are obtained in analysis step. In synthesis step, reconstructed face is obtained by linear combining eigenfaces, and coefficients error between two successive analyses is used for fast PCA compensation. Experimental results on training and test faces show that the proposed algorithm convergences faster than classical PCA compensation and reconstructed faces are natural.

[1]  Seong-Whan Lee,et al.  Reconstruction of Partially Damaged Face Images Based on a Morphable Face Model , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  A. Martínez,et al.  The AR face databasae , 1998 .

[3]  Mohan M. Trivedi,et al.  A Regression Model in TensorPCA Subspace for Face Image Super-resolution Reconstruction , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[4]  Aleix M. Martinez,et al.  The AR face database , 1998 .

[5]  Raimondo Schettini,et al.  Detection and Restoration of Occlusions for 3D Face Recognition , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[6]  Takio Kurita,et al.  Recognition and detection of occluded faces by a neural network classifier with recursive data reconstruction , 2003, Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, 2003..

[7]  Harry Shum,et al.  Automatic eyeglasses removal from face images , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Klaus J. Kirchberg,et al.  Robust Face Detection Using the Hausdorff Distance , 2001, AVBPA.

[9]  Guangda Su,et al.  Eyeglasses removal from facial images , 2005, Pattern Recognit. Lett..

[10]  Sang Chul Ahn,et al.  Glasses removal from facial image using recursive error compensation , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Yasuyuki Saito,et al.  Estimation of eyeglassless facial images using principal component analysis , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[12]  Ieee Xplore,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence Information for Authors , 2022, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Luc Van Gool,et al.  A Generalized EM Approach for 3D Model Based Face Recognition under Occlusions , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).