A Deep Reconstruction CNN for Illumination-robust Face Image Recovery and Recognition

We propose a deep reconstruction convolution neural network approach for illumination-robust face image recovery and recognition. Our reconstruction approach learns an end-to-end mapping between non-uniform illumination and uniform illumination face images. The architecture of the network is functional divided into four stages, i.e., feature decomposition, multi-scale feature mapping and fusion, nonlinear mapping and reconstruction. We illustrate that the incorporating of multiscale feature mapping and fusion stage in the network significantly remove the unwanted illumination information of face images. Besides, a gradient constraint is also added to the overall loss function of the proposed approach to preserve detailed texture information of face images. Face reconstruction and face recognition experiments are conducted in two typical illumination-sensitive data sets, extended YaieB and eMU-PIE. The reconstructed results demonstrate that the proposed approach can efficiently separate out the unwanted illumination information while keeping the discriminant details of face images. Meanwhile, the proposed approach can significantly enhance the face recognition performances of traditional feature descriptors.

[1]  Yunsong Li,et al.  Hyperspectral image reconstruction by deep convolutional neural network for classification , 2017, Pattern Recognit..

[2]  Dorin Comaniciu,et al.  Total variation models for variable lighting face recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Terence Sim,et al.  The CMU Pose, Illumination, and Expression Database , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Chin-Chuan Han,et al.  Color Image Enhancement Using Multiscale Retinex and Image Fusion Techniques , 2014 .

[5]  Yuan Yan Tang,et al.  Multiscale facial structure representation for face recognition under varying illumination , 2009, Pattern Recognit..

[6]  Marko Heikkilä,et al.  Description of interest regions with local binary patterns , 2009, Pattern Recognit..

[7]  Earnest Paul Ijjina,et al.  Illumination invariant face recognition using convolutional neural networks , 2015, 2015 IEEE International Conference on Signal Processing, Informatics, Communication and Energy Systems (SPICES).

[8]  Dacheng Tao,et al.  DehazeNet: An End-to-End System for Single Image Haze Removal , 2016, IEEE Transactions on Image Processing.

[9]  Christian Ledig,et al.  Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Yuan Yan Tang,et al.  Face Recognition Under Varying Illumination Using Gradientfaces , 2009, IEEE Transactions on Image Processing.

[11]  Wen Gao,et al.  Illumination normalization for robust face recognition against varying lighting conditions , 2003, 2003 IEEE International SOI Conference. Proceedings (Cat. No.03CH37443).

[12]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[13]  B. V. K. Vijaya Kumar,et al.  Illumination Normalization Using Logarithm Transforms for Face Authentication , 2003, AVBPA.

[14]  Jian Sun,et al.  Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  John D. Austin,et al.  Adaptive histogram equalization and its variations , 1987 .

[16]  Alice Caplier,et al.  Face recognition using the POEM descriptor , 2012, Pattern Recognit..

[17]  David J. Kriegman,et al.  Acquiring linear subspaces for face recognition under variable lighting , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  杨利平 Yang Li-ping,et al.  Relative gradient histogram features for face recognition , 2014 .

[19]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Jian-Huang Lai,et al.  Extraction of illumination invariant facial features from a single image using nonsubsampled contourlet transform , 2010, Pattern Recognit..