Automatic Denoising of 2D Color Face Images Using Recursive PCA Reconstruction

In this paper, we propose a denoising method based on PCA reconstruction for removing complex color noise components on human faces, which is not easy to remove by using vectorial color filters. The proposed method is composed of the following six steps: training of canonical eigenface space using PCA, automatic extraction of facial features using active appearance model and alignment of the input face to mean shape, reconstruction of an initial noise free face, relighting of reconstructed face using a bilateral filter, extraction of noise regions using the variances of skin color of training data, and reconstruction using partial information of input images (except the noise regions) and blending of the reconstructed image with the original image. Experimental results show that the proposed denoising method maintains the structural characteristics of input faces, while efficiently removing noise components with complex colors.

[1]  Seong-Whan Lee,et al.  Reconstruction of Partially Damaged Face Images Based on a Morphable Face Model , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Gonzalo R. Arce,et al.  Nonlinear Signal Processing - A Statistical Approach , 2004 .

[3]  E. Oja,et al.  Sparse code shrinkage for image denoising , 1998, 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227).

[4]  Timothy F. Cootes,et al.  Combining Elastic and Statistical Models of Appearance Variation , 2000, ECCV.

[5]  T. Vetter,et al.  A statistical method for robust 3D surface reconstruction from sparse data , 2004 .

[6]  Richard Szeliski,et al.  Digital photography with flash and no-flash image pairs , 2004, ACM Trans. Graph..

[7]  Gunther Wyszecki,et al.  Color Science: Concepts and Methods, Quantitative Data and Formulae, 2nd Edition , 2000 .

[8]  K. Martin,et al.  Vector filtering for color imaging , 2005, IEEE Signal Processing Magazine.

[9]  Xi Li,et al.  Robust 3D Reconstruction with Outliers Using Ransac Based Singular Value Decomposition , 2005, IEICE Trans. Inf. Syst..

[10]  Ohad Ben-Shahar,et al.  The Perceptual Organization of Texture Flow: A Contextual Inference Approach , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Rastislav Lukac,et al.  A Taxonomy of Color Image Filtering and Enhancement Solutions , 2006 .

[12]  Frédo Durand,et al.  Flash photography enhancement via intrinsic relighting , 2004, SIGGRAPH 2004.

[13]  Alan C. Bovik,et al.  Handbook of Image and Video Processing (Communications, Networking and Multimedia) , 2005 .

[14]  Bjarne K. Ersbøll,et al.  FAME-a flexible appearance modeling environment , 2003, IEEE Transactions on Medical Imaging.

[15]  Takio Kurita,et al.  Robust De-noising by Kernel PCA , 2002, ICANN.