An Automatic Framework for Segmentation and Digital Inpainting of 2D Frontal Face Images

Nowadays applications that use face images as input for people identification have been very common. In general, the input image must be preprocessed in order to fit some normalization and quality criteria. In this paper, we propose a computational framework composed of digital image quality computation, segmentation of the damaged regions on face images by statistical decision, morphological operators and image restoration by inpainting techniques. Additionally, in this work we propose a new method for digital inpainting that considers as relevant information for such restoration the neighboring pixel intensities as well as prior information extracted from an image database. To assess the efficiency of the computational framework proposed, we have used 2D face images from public databases. The results show that our inpainting method performs similarly to the traditional ones on quasi-homogeneous regions and gives better results when the damaged areas includes complex image patterns.

[1]  Stefan Jeschke,et al.  A GPU Laplacian solver for diffusion curves and Poisson image editing , 2009, ACM Trans. Graph..

[2]  Guillermo Sapiro,et al.  A Unifying Framework for Image Inpainting , 2009 .

[3]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[4]  J. Sethian Level set methods : evolving interfaces in geometry, fluid mechanics, computer vision, and materials science , 1996 .

[5]  Tony F. Chan,et al.  Image processing and analysis - variational, PDE, wavelet, and stochastic methods , 2005 .

[6]  Alexandru Telea,et al.  An Image Inpainting Technique Based on the Fast Marching Method , 2004, J. Graphics, GPU, & Game Tools.

[7]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[8]  Tony F. Chan,et al.  Nontexture Inpainting by Curvature-Driven Diffusions , 2001, J. Vis. Commun. Image Represent..

[9]  Kohtaro Kohtaro The Tsallis entropy and the Shannon entropy of a universal probability , 2008, 2008 IEEE International Symposium on Information Theory.

[10]  Aurélie Bugeau,et al.  Combining Texture Synthesis and Diffusion for Image Inpainting , 2009, VISAPP.

[11]  Jia-Kai Chou,et al.  Face-off: automatic alteration of facial features , 2012, Multimedia Tools and Applications.

[12]  Manuel Menezes de Oliveira Neto,et al.  Fast Digital Image Inpainting , 2001, VIIP.

[13]  Shahrin Azuan Nazeer,et al.  Image Quality Assessments and Restoration for Face Detection and Recognition System Images , 2008, 2008 Second Asia International Conference on Modelling & Simulation (AMS).

[14]  C. Thomaz,et al.  A new ranking method for principal components analysis and its application to face image analysis , 2010, Image Vis. Comput..

[15]  F. K. Inaba,et al.  Face Recognition Based on Sparse Representation and Joint Sparsity Model with Matrix Completion , 2012, IEEE Latin America Transactions.

[16]  Anil C. Kokaram,et al.  Interpolation of missing data in image sequences , 1995, IEEE Trans. Image Process..

[17]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[18]  Zhou Wang,et al.  Video quality assessment based on structural distortion measurement , 2004, Signal Process. Image Commun..

[19]  C. Thomaz,et al.  Extração e Comparação de Características Locais e Globais para o Reconhecimento Automático de Imagens de Faces , 2012 .

[20]  D. Martinez Torres,et al.  Combination of faces recognition techniques in infrared images by using genetic algorithms , 2008, IEEE Latin America Transactions.

[21]  Rama Chellappa,et al.  Human and machine recognition of faces: a survey , 1995, Proc. IEEE.

[22]  Narendra Ahuja,et al.  Detecting Faces in Images: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Lawrence Sirovich,et al.  Application of the Karhunen-Loeve Procedure for the Characterization of Human Faces , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Vagner do Amaral,et al.  A Multi-Linear Statistical Method for Discriminant Analysis of 2D Frontal Face Images , 2012 .

[25]  Song Wang,et al.  Image inpainting based on scene transform and color transfer , 2010, Pattern Recognit. Lett..

[26]  Tony F. Chan,et al.  Non-texture inpainting by curvature-driven diffusions (CDD) , 2001 .

[27]  Principal Component Analysis for Symmetric Key Generation , 2004, IEEE Latin America Transactions.

[28]  Igor Chueshov,et al.  Navier-Stokes, Fluid Dynamics, and Image and Video Inpainting , 2001 .

[29]  Guillermo Sapiro,et al.  Navier-stokes, fluid dynamics, and image and video inpainting , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[30]  José Alberto Quintanilha Processamento de imagens digitais , 1990 .

[31]  Anneli Folkesson,et al.  Numerical methods for engineers , 2007 .

[32]  Sabah Jassim,et al.  Image-Quality-Based Adaptive Face Recognition , 2010, IEEE Transactions on Instrumentation and Measurement.