Low-cost Automatic Inpainting for Artifact Suppression in Facial Images

Facial images are often used in applications that need to recognize or identify persons. Many existing facial recognition tools have limitations with respect to facial image quality attributes such as resolution, face position, and artifacts present in the image. In this paper we describe a new low-cost framework for preprocessing low-quality facial images in order to render them suitable for automatic recognition. For this, we first detect artifacts based on the statistical difference between the target image and a set of pre-processed images in the database. Next, we eliminate artifacts by an inpainting method which combines information from the target image and similar images in our database. Our method has low computational cost and is simple to implement, which makes it attractive for usage in low-budget environments. We illustrate our method on several images taken from public surveillance databases, and compare our results with existing inpainting techniques.

[1]  Yee-Hong Yang,et al.  Face recognition approach based on rank correlation of Gabor-filtered images , 2002, Pattern Recognit..

[2]  Alexandru Telea,et al.  An Image Inpainting Technique Based on the Fast Marching Method , 2004, J. Graphics, GPU, & Game Tools.

[3]  Zhou Wang,et al.  Video quality assessment based on structural distortion measurement , 2004, Signal Process. Image Commun..

[4]  James A. Sethian,et al.  Level Set Methods and Fast Marching Methods , 1999 .

[5]  Guillermo Sapiro,et al.  A Unifying Framework for Image Inpainting , 2009 .

[6]  C. Thomaz,et al.  A new ranking method for principal components analysis and its application to face image analysis , 2010, Image Vis. Comput..

[7]  Hyeonjoon Moon,et al.  The FERET Evaluation Methodology for Face-Recognition Algorithms , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Michael J. Lyons,et al.  Coding facial expressions with Gabor wavelets , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[9]  Manuel Menezes de Oliveira Neto,et al.  Fast Digital Image Inpainting , 2001, VIIP.

[10]  Song Wang,et al.  Image inpainting based on scene transform and color transfer , 2010, Pattern Recognit. Lett..

[11]  Tony F. Chan,et al.  Non-texture inpainting by curvature-driven diffusions (CDD) , 2001 .

[12]  Igor Chueshov,et al.  Navier-Stokes, Fluid Dynamics, and Image and Video Inpainting , 2001 .

[13]  Guillermo Sapiro,et al.  Navier-stokes, fluid dynamics, and image and video inpainting , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[14]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[15]  Larry J. Stephens,et al.  Statistics : Schaum's outlines , 2014 .

[16]  Shahrin Azuan Nazeer,et al.  Image Quality Assessments and Restoration for Face Detection and Recognition System Images , 2008, 2008 Second Asia International Conference on Modelling & Simulation (AMS).

[17]  Marcelo Bertalmío,et al.  FLUID DYNAMICS, AND IMAGE AND VIDEO INPAINTING , 2001 .

[18]  Sébastien Lefèvre,et al.  A comparative study on multivariate mathematical morphology , 2007, Pattern Recognit..

[19]  Peter Wonka,et al.  A GPU Laplacian solver for diffusion curves and Poisson image editing , 2009, ACM Transactions on Graphics.

[20]  Sabah Jassim,et al.  Image-Quality-Based Adaptive Face Recognition , 2010, IEEE Transactions on Instrumentation and Measurement.

[21]  Erik Hjelmås,et al.  Face Detection: A Survey , 2001, Comput. Vis. Image Underst..

[22]  Aurélie Bugeau,et al.  Combining Texture Synthesis and Diffusion for Image Inpainting , 2009, VISAPP.

[23]  Jia-Kai Chou,et al.  Face-off: automatic alteration of facial features , 2012, Multimedia Tools and Applications.

[24]  Edward H. Adelson,et al.  Personal photo enhancement using example images , 2010, TOGS.

[25]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[26]  Zeev Farbman,et al.  Coordinates for instant image cloning , 2009, ACM Trans. Graph..

[27]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..