Locality-Constrained Double Low-Rank Representation for Effective Face Hallucination

Recently, position-patch-based face hallucination methods have received much attention, and obtained promising progresses due to their effectiveness and efficiency. A locality-constrained double low-rank representation (LCDLRR) method is proposed for effective face hallucination in this paper. LCDLRR attempts to directly use the image-matrix based regression model to compute the representation coefficients to maintain the essential structural information. On the other hand, LCDLRR imposes a low-rank constraint on the representation coefficients to adaptively select the training samples that belong to the same subspace as the inputs. Moreover, a locality constraint is also enforced to preserve the locality and the sparsity simultaneously. Compared with previous methods, our proposed LCDLRR considers locality manifold structure, cluster constraints, and structure error simultaneously. Extensive experimental results on standard face hallucination databases indicate that our proposed method outperforms some state-of-the-art algorithms in terms of both visual quantity and objective metrics.

[1]  Changyin Sun,et al.  Kernel Low-Rank Representation for face recognition , 2015, Neurocomputing.

[2]  Bin Gu,et al.  Incremental Support Vector Learning for Ordinal Regression , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[3]  Bin Gu,et al.  Incremental learning for ν-Support Vector Regression , 2015, Neural Networks.

[4]  Takeo Kanade,et al.  Hallucinating faces , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[5]  Wen Gao,et al.  The CAS-PEAL Large-Scale Chinese Face Database and Baseline Evaluations , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[6]  Ruimin Hu,et al.  Facial Image Hallucination Through Coupled-Layer Neighbor Embedding , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Wai Keung Wong,et al.  Sparse Alignment for Robust Tensor Learning , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[8]  Ying Tai,et al.  Nuclear Norm Based Matrix Regression with Applications to Face Recognition with Occlusion and Illumination Changes , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[10]  Zheng Wang,et al.  SRLSP: A Face Image Super-Resolution Algorithm Using Smooth Regression With Local Structure Prior , 2017, IEEE Transactions on Multimedia.

[11]  C. Thomaz,et al.  A new ranking method for principal components analysis and its application to face image analysis , 2010, Image Vis. Comput..

[12]  Yun Fu,et al.  Locality-constrained Low Rank Coding for face recognition , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[13]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[14]  Xingming Sun,et al.  Structural Minimax Probability Machine , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[15]  Maoguo Gong,et al.  Position-Patch Based Face Hallucination Using Convex Optimization , 2011, IEEE Signal Processing Letters.

[16]  Junping Zhang,et al.  Super-resolution of human face image using canonical correlation analysis , 2010, Pattern Recognit..

[17]  Zhenmin Tang,et al.  Feature extraction using local structure preserving discriminant analysis , 2014, Neurocomputing.

[18]  D. Donoho.  For most large underdetermined systems of linear equations the minimal 𝓁1‐norm solution is also the sparsest solution , 2006 .

[19]  Jian Yang,et al.  Bayesian sample steered discriminative regression for biometric image classification , 2015, Appl. Soft Comput..

[20]  Jian Yang,et al.  Double Nuclear Norm-Based Matrix Decomposition for Occluded Image Recovery and Background Modeling , 2015, IEEE Transactions on Image Processing.

[21]  Jian Yang,et al.  Matrix Variate Distribution-Induced Sparse Representation for Robust Image Classification , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[22]  Bin Gu,et al.  A Robust Regularization Path Algorithm for $\nu $ -Support Vector Classification , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[23]  LinLin Shen,et al.  Joint representation and pattern learning for robust face recognition , 2015, Neurocomputing.

[24]  Jian Yang,et al.  Integration of multiple orientation and texture information for finger-knuckle-print verification , 2014, Neurocomputing.

[25]  Zhihua Xia,et al.  A Privacy-Preserving and Copy-Deterrence Content-Based Image Retrieval Scheme in Cloud Computing , 2016, IEEE Transactions on Information Forensics and Security.

[26]  Guangwei Gao,et al.  Parameterless reconstructive discriminant analysis for feature extraction , 2016, Neurocomputing.

[27]  Gang Chen,et al.  Color Image Analysis by Quaternion-Type Moments , 2014, Journal of Mathematical Imaging and Vision.

[28]  David Zhang,et al.  Human Gait Recognition via Sparse Discriminant Projection Learning , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[29]  Chengjun Liu,et al.  New image descriptors based on color, texture, shape, and wavelets for object and scene image classification , 2013, Neurocomputing.

[30]  Ruimin Hu,et al.  Face Hallucination Via Weighted Adaptive Sparse Regularization , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[31]  Yu Hu,et al.  A novel kernel-based framework for facial-image hallucination , 2011, Image Vis. Comput..

[32]  Jian Yang,et al.  Approximate Orthogonal Sparse Embedding for Dimensionality Reduction , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[33]  Ruimin Hu,et al.  Face Super-Resolution via Multilayer Locality-Constrained Iterative Neighbor Embedding and Intermediate Dictionary Learning , 2014, IEEE Transactions on Image Processing.

[34]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[35]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[36]  Zhenyu Wang,et al.  A collaborative representation based projections method for feature extraction , 2015, Pattern Recognit..

[37]  Jian Yang,et al.  Nuclear Norm Regularized Sparse Coding , 2014, 2014 22nd International Conference on Pattern Recognition.

[38]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[39]  D. Yeung,et al.  Super-resolution through neighbor embedding , 2004, CVPR 2004.

[40]  Jian Yang,et al.  Robust nuclear norm regularized regression for face recognition with occlusion , 2015, Pattern Recognit..

[41]  Bir Bhanu,et al.  Face image super-resolution using 2D CCA , 2014, Signal Process..

[42]  Jian Yang,et al.  Multilinear Sparse Principal Component Analysis , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[43]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[44]  Xiaogang Wang,et al.  Hallucinating face by eigentransformation , 2005, IEEE Trans. Syst. Man Cybern. Part C.

[45]  Jian-Huang Lai,et al.  Face hallucination based on morphological component analysis , 2013, Signal Process..

[46]  Ling Shao,et al.  A rapid learning algorithm for vehicle classification , 2015, Inf. Sci..

[47]  Junjun Jiang,et al.  Noise Robust Face Image Super-Resolution Through Smooth Sparse Representation , 2017, IEEE Transactions on Cybernetics.

[48]  Wai Keung Wong,et al.  Joint Tensor Feature Analysis For Visual Object Recognition , 2015, IEEE Transactions on Cybernetics.

[49]  Changyin Sun,et al.  A regularized least square based discriminative projections for feature extraction , 2016, Neurocomputing.

[50]  Chun Qi,et al.  Hallucinating face by position-patch , 2010, Pattern Recognit..

[51]  Arun Ross,et al.  An introduction to biometric recognition , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[52]  Takeo Kanade,et al.  Limits on super-resolution and how to break them , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[53]  Ruimin Hu,et al.  Noise robust face hallucination employing Gaussian-Laplacian mixture model , 2014, Neurocomputing.

[54]  Chun Qi,et al.  Low-Rank Neighbor Embedding for Single Image Super-Resolution , 2014, IEEE Signal Processing Letters.

[55]  Ruimin Hu,et al.  Noise Robust Face Hallucination via Locality-Constrained Representation , 2014, IEEE Transactions on Multimedia.