Deep Auto-Encoder Based on Supervised Learning for Damaged Face Reconstruction

Based on the reconstruction idea of auto-encoder (AE) and image reconstruction, we present a new idea that the classical auto-encoder can be polished up by supervised learning. We also present a novel supervised deep learning framework for damaged face reconstruction after analyzing the deep model structure. The proposed model is unlike the classical auto-encoder which is unsupervised learning. In this paper, the deep supervised auto-encoder model is illustrated, which has a set of “progressive” and “interrelated” learning strategies by multiple groups of supervised single-layer AE. In this structure, we define a Deep Supervised Network with the supervised auto-encoder which is trained to extract characteristic features from damaged images and reconstruct the corresponding similar facial images, and it improves the ability to express the feature code. Extensive experiment on AR database demonstrates that the proposed method can significantly improve the smoothness of the damaged face reconstruction under enormous illumination, expression change. Experiments show that the proposed method has good contribution and adaptability to the damaged face reconstruction.

[1]  Soumith Chintala,et al.  Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks , 2015, ICLR.

[2]  Minh N. Do,et al.  Semantic Image Inpainting with Perceptual and Contextual Losses , 2016, ArXiv.

[3]  Rob Fergus,et al.  Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networks , 2015, NIPS.

[4]  Alexei A. Efros,et al.  Context Encoders: Feature Learning by Inpainting , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Qionghai Dai,et al.  Partially occluded face completion and recognition , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[6]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[7]  Meng Wang,et al.  Multi-View Object Retrieval via Multi-Scale Topic Models , 2016, IEEE Transactions on Image Processing.

[8]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[9]  Minh N. Do,et al.  Semantic Image Inpainting with Deep Generative Models , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Zhengyou Zhang,et al.  Improving multiview face detection with multi-task deep convolutional neural networks , 2014, IEEE Winter Conference on Applications of Computer Vision.

[11]  K. Pearson Mathematical Contributions to the Theory of Evolution. III. Regression, Heredity, and Panmixia , 1896 .

[12]  Amy Loutfi,et al.  A review of unsupervised feature learning and deep learning for time-series modeling , 2014, Pattern Recognit. Lett..

[13]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[14]  Hao Li,et al.  High-Resolution Image Inpainting Using Multi-scale Neural Patch Synthesis , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Roger Zimmermann,et al.  Flickr Circles: Aesthetic Tendency Discovery by Multi-View Regularized Topic Modeling , 2016, IEEE Transactions on Multimedia.

[16]  Qionghai Dai,et al.  Graph Laplace for Occluded Face Completion and Recognition , 2011, IEEE Transactions on Image Processing.

[17]  Chang Liu,et al.  Adaptive Deep Supervised Autoencoder Based Image Reconstruction for Face Recognition , 2016 .

[18]  Meng Wang,et al.  Learning Visual Semantic Relationships for Efficient Visual Retrieval , 2015, IEEE Transactions on Big Data.