Illumination preprocessing for face images based on empirical mode decomposition

The Empirical Mode Decomposition (EMD) can adaptively decompose a complex signal into Intrinsic Mode Functions (IMFs) that are relevant to intrinsic physical significances, therefore is a powerful tool for multi-scale analysis of non-stationary signals. Towards restoring a frontal-illuminated face from a single image, in this paper we study the usage of EMD for manipulating the illumination issue on face images. We propose an EMD-based algorithm to extract the illumination-insensitive facial features. We also come up with an EMD-based scheme to detect the shadows and to reduce the effects of shadows on face images. By preserving the intrinsic facial features as well as lessening the shadows, it is more likely to restore the frontal-illuminated face image with good visual quality from a single image. Experiments verify the effectiveness of the proposed methods. The Logarithmic Empirical Mode Decomposition (EMD) algorithm is proposed to obtain an illumination-insensitive facial representation.An EMD based preprocessing method is proposed to reduce the effect of shadows on face images.Existing methods for restoring the frontal-illuminated face images are enhanced.

[1]  Marian Stewart Bartlett,et al.  Face recognition by independent component analysis , 2002, IEEE Trans. Neural Networks.

[2]  Nanning Zheng,et al.  Illumination transition image: Parameter-based illumination estimation and re-rendering , 2008, 2008 19th International Conference on Pattern Recognition.

[3]  H. Barrow,et al.  RECOVERING INTRINSIC SCENE CHARACTERISTICS FROM IMAGES , 1978 .

[4]  Christophe Garcia,et al.  A Wavelet-based Framework for Face Recognition , 1998 .

[5]  Hai Huang,et al.  Speech pitch determination based on Hilbert-Huang transform , 2006, Signal Process..

[6]  Anna Linderhed,et al.  2D empirical mode decompositions in the spirit of image compression , 2002, SPIE Defense + Commercial Sensing.

[7]  Jian-Huang Lai,et al.  Face recognition using holistic Fourier invariant features , 2001, Pattern Recognit..

[8]  Martin D. Levine,et al.  Face Recognition Using the Discrete Cosine Transform , 2001, International Journal of Computer Vision.

[9]  Jean Claude Nunes,et al.  Image analysis by bidimensional empirical mode decomposition , 2003, Image Vis. Comput..

[10]  Amnon Shashua,et al.  The Quotient Image: Class-Based Re-Rendering and Recognition with Varying Illuminations , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Hyeonjoon Moon,et al.  The FERET Evaluation Methodology for Face-Recognition Algorithms , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  David J. Kriegman,et al.  From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Dorin Comaniciu,et al.  Total variation models for variable lighting face recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Jian-Huang Lai,et al.  Extraction of illumination invariant facial features from a single image using nonsubsampled contourlet transform , 2010, Pattern Recognit..

[15]  Daniel N. Rockmore,et al.  Empirical Mode Decomposition Analysis for Visual Stylometry , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Christophe Damerval,et al.  A fast algorithm for bidimensional EMD , 2005, IEEE Signal Processing Letters.

[17]  N. Huang,et al.  The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[18]  Marios Savvides,et al.  Analyzing Facial Images using Empirical Mode Decomposition for Illumination Artifact Removal and Improved Face Recognition , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[19]  Sun Yuehui,et al.  Robust face recognition for illumination removal using DT-CWT and EMD , 2008, 2008 11th IEEE Singapore International Conference on Communication Systems.

[20]  Yuan Yan Tang,et al.  Illumination invariant face recognition based on the new phase features , 2010, 2010 IEEE International Conference on Systems, Man and Cybernetics.

[21]  Stan Z. Li,et al.  Generalized quotient image , 2004, CVPR 2004.

[22]  Lotfi Senhadji,et al.  Multivariate empirical mode decomposition and application to multichannel filtering , 2011, Signal Process..

[23]  Lei Zhang,et al.  Face synthesis and recognition from a single image under arbitrary unknown lighting using a spherical harmonic basis morphable model , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[24]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[25]  Yuan Yan Tang,et al.  Multiscale facial structure representation for face recognition under varying illumination , 2009, Pattern Recognit..

[26]  Hartmut Neven,et al.  The Bochum/USC Face Recognition System And How it Fared in the FERET Phase III Test , 1998 .

[27]  Haitao Wang,et al.  Face recognition under varying lighting conditions using self quotient image , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[28]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Yuan Yan Tang,et al.  Extraction of Illumination-Invariant Features in Face Recognition by Empirical Mode Decomposition , 2009, ICB.