Multi-view face hallucination using SVD and a mapping model

Abstract Multi-view face hallucination (MFH) presents a challenge issue in face recognition domain. In this paper, an efficient method based on singular value decomposition (SVD) and a mapping model is proposed for multi-view face hallucination. Based on an approximately same linear mapping relationship across different views, two corresponding matrices obtained from the SVD of the low resolution (LR) image for the high-resolution (HR) multi-view face images can be constructed via the mapping model using global reconstruction. Experiments show that our proposed multi-view face-hallucination scheme is effective and produces promising super-resolved results.

[1]  Yuan Yan Tang,et al.  Robust Face Hallucination via Locality-Constrained Bi-Layer Representation , 2018, IEEE Transactions on Cybernetics.

[2]  Li-Jia Li,et al.  Multi-view Face Detection Using Deep Convolutional Neural Networks , 2015, ICMR.

[3]  Harry Wechsler,et al.  The FERET database and evaluation procedure for face-recognition algorithms , 1998, Image Vis. Comput..

[4]  Xin Yu,et al.  Ultra-Resolving Face Images by Discriminative Generative Networks , 2016, ECCV.

[5]  Yang Li,et al.  Face hallucination with pose variation , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[6]  Shiguang Shan,et al.  Aligning Coupled Manifolds for Face Hallucination , 2009, IEEE Signal Processing Letters.

[7]  Jie Li,et al.  Image super-resolution: The techniques, applications, and future , 2016, Signal Process..

[8]  Takeo Kanade,et al.  Hallucinating faces , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[9]  Guohui Zhang,et al.  A Novel Image Tag Completion Method Based on Convolutional Neural Transformation , 2017, ICANN.

[10]  Ognjen Arandjelovic,et al.  Hallucinating optimal high-dimensional subspaces , 2014, Pattern Recognit..

[11]  Kiyoharu Aizawa,et al.  Context-Patch Face Hallucination Based on Thresholding Locality-Constrained Representation and Reproducing Learning , 2018, IEEE Transactions on Cybernetics.

[12]  Guoying Zhao,et al.  Hallucinating Face Image by Regularization Models in High-Resolution Feature Space , 2018, IEEE Transactions on Image Processing.

[13]  Chun Qi,et al.  Hallucinating face by position-patch , 2010, Pattern Recognit..

[14]  Harry Shum,et al.  Face Hallucination: Theory and Practice , 2007, International Journal of Computer Vision.

[15]  Muhittin Gökmen,et al.  Super-resolution reconstruction of faces by enhanced global models of shape and texture , 2012, Pattern Recognit..

[16]  Xiaogang Wang,et al.  Multi-View Perceptron: a Deep Model for Learning Face Identity and View Representations , 2014, NIPS.

[17]  Shaopeng Wang,et al.  A Simple Approach to Multiview Face Hallucination , 2010, IEEE Signal Processing Letters.

[18]  Christos-Savvas Bouganis,et al.  Robust multi-image based blind face hallucination , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Yi Yu,et al.  Context-patch based face hallucination via thresholding locality-constrained representation and reproducing learning , 2017, 2017 IEEE International Conference on Multimedia and Expo (ICME).

[20]  Kin-Man Lam,et al.  Face-image retrieval based on singular values and potential-field representation , 2014, Signal Process..

[21]  Ruimin Hu,et al.  Face image super-resolution through locality-induced support regression , 2014, Signal Process..

[22]  Reuben A. Farrugia,et al.  Face Hallucination Using Linear Models of Coupled Sparse Support , 2015, IEEE Transactions on Image Processing.

[23]  Roberto Cipolla,et al.  A manifold approach to face recognition from low quality video across illumination and pose using implicit super-resolution , 2007, ICCV 2007.

[24]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[25]  Yu Hu,et al.  From Local Pixel Structure to Global Image Super-Resolution: A New Face Hallucination Framework , 2011, IEEE Transactions on Image Processing.

[26]  Ling Shao,et al.  Face recognition with a small occluded training set using spatial and statistical pooling , 2018, Inf. Sci..

[27]  Konstantinos Kamnitsas,et al.  Multi-input Cardiac Image Super-Resolution Using Convolutional Neural Networks , 2016, MICCAI.

[28]  Xiaogang Wang,et al.  Hallucinating face by eigentransformation , 2005, IEEE Trans. Syst. Man Cybern. Part C.

[29]  Jian Yang,et al.  FSRNet: End-to-End Learning Face Super-Resolution with Facial Priors , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[30]  Guohui Zhang,et al.  Learning Convolutional Ranking-Score Function by Query Preference Regularization , 2017, IDEAL.

[31]  Hongliang Li,et al.  Face Hallucination via Similarity Constraints , 2013, IEEE Signal Processing Letters.

[32]  Ruimin Hu,et al.  Face Super-Resolution via Multilayer Locality-Constrained Iterative Neighbor Embedding and Intermediate Dictionary Learning , 2014, IEEE Transactions on Image Processing.

[33]  Vibha Vyas,et al.  Component-based face recognition under transfer learning for forensic applications , 2019, Inf. Sci..

[34]  Kin-Man Lam,et al.  A novel face-hallucination scheme based on singular value decomposition , 2013, Pattern Recognit..

[35]  Yueting Zhuang,et al.  Hallucinating faces: LPH super-resolution and neighbor reconstruction for residue compensation , 2007, Pattern Recognit..

[36]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Shaogang Gong,et al.  Generalized Face Super-Resolution , 2008, IEEE Transactions on Image Processing.

[38]  Kin-Man Lam,et al.  Multi-view face hallucination based on sparse representation , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[39]  Seong-Whan Lee,et al.  An Example-Based Face Hallucination Method for Single-Frame, Low-Resolution Facial Images , 2008, IEEE Transactions on Image Processing.

[40]  Ponnuthurai N. Suganthan,et al.  High-quality face image generated with conditional boundary equilibrium generative adversarial networks , 2018, Pattern Recognit. Lett..

[41]  Kiyoharu Aizawa,et al.  Face hallucination through differential evolution parameter map learning with facial structure prior , 2019, Inf. Sci..

[42]  Xiao Zeng,et al.  Super-Resolution Method for Multiview Face Recognition From a Single Image Per Person Using Nonlinear Mappings on Coherent Features , 2012, IEEE Signal Processing Letters.

[43]  Sang-Woong Lee,et al.  Robust face recognition via hierarchical collaborative representation , 2018, Inf. Sci..

[44]  Xinfeng Zhang,et al.  Visual attention analysis and prediction on human faces , 2017, Inf. Sci..