Robust face super-resolution via iterative sparsity and locality-constrained representation

Abstract The performance of image super-resolution (SR) process is highly affected by impulse noise hence, a novel iterative sparsity and locality-constrained representation (ISLcR) based face super-resolution model is proposed here. The proposed model computes data fidelity in high-resolution (HR) and low-resolution (LR) face spaces aiming to compensate the lost information in LR space from the HR space. For this purpose, supporting HR face is computed using the proposed ISLcR model. Further, reconstruction residual of both data fidelity is handled by the locality with sparsity regularization term. The use of both types of data fidelity and locality with sparsity regularization help in reduction of noise, generate a more discriminable outcome, and makes the process computationally viable. The superiority of the proposed ISLcR based face SR model over existing state-of-the-art methods has been established by conducting the experiments on public standard human face datasets and the images from locally recorded surveillance video. The experimental results indicate that the proposed model has outshined all the existing methods.

[1]  Yuan Yan Tang,et al.  Weighted Couple Sparse Representation With Classified Regularization for Impulse Noise Removal , 2015, IEEE Transactions on Image Processing.

[2]  Weiguo Gong,et al.  Combining sparse representation and local rank constraint for single image super resolution , 2015, Inf. Sci..

[3]  Xiang Ma,et al.  Sparse Support Regression for Image Super-Resolution , 2015, IEEE Photonics Journal.

[4]  Richard A. Haddad,et al.  Adaptive median filters: new algorithms and results , 1995, IEEE Trans. Image Process..

[5]  Thomas S. Huang,et al.  Face hallucination VIA sparse coding , 2008, 2008 15th IEEE International Conference on Image Processing.

[6]  D. Yeung,et al.  Super-resolution through neighbor embedding , 2004, CVPR 2004.

[7]  Jian Yang,et al.  Mixed Noise Removal by Weighted Encoding With Sparse Nonlocal Regularization , 2014, IEEE Transactions on Image Processing.

[8]  Thomas S. Huang,et al.  Deep Networks for Image Super-Resolution with Sparse Prior , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[9]  Ling-Yuan Hsu,et al.  Turbulent-PSO-Based Fuzzy Image Filter With No-Reference Measures for High-Density Impulse Noise , 2013, IEEE Transactions on Cybernetics.

[10]  Harry Shum,et al.  A two-step approach to hallucinating faces: global parametric model and local nonparametric model , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[11]  Michael Elad,et al.  Fast and robust multiframe super resolution , 2004, IEEE Transactions on Image Processing.

[12]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Ruimin Hu,et al.  Noise robust position-patch based face super-resolution via Tikhonov regularized neighbor representation , 2016, Inf. Sci..

[14]  Rama Chellappa,et al.  Super-Resolution of Face Images Using Kernel PCA-Based Prior , 2007, IEEE Transactions on Multimedia.

[15]  Ruimin Hu,et al.  Facial Image Hallucination Through Coupled-Layer Neighbor Embedding , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Shyam Singh Rajput,et al.  Noise robust face hallucination algorithm using local content prior based error shrunk nearest neighbors representation , 2018, Signal Process..

[17]  Liang Chen,et al.  A novel face super resolution approach for noisy images using contour feature and standard deviation prior , 2016, Multimedia Tools and Applications.

[18]  Takeo Kanade,et al.  Hallucinating faces , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[19]  Takeo Kanade,et al.  Neural Network-Based Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Andreas K. Maier,et al.  Robust Multiframe Super-Resolution Employing Iteratively Re-Weighted Minimization , 2016, IEEE Transactions on Computational Imaging.

[21]  H. Wu,et al.  Adaptive impulse detection using center-weighted median filters , 2001, IEEE Signal Processing Letters.

[22]  Bir Bhanu,et al.  Face image super-resolution using 2D CCA , 2014, Signal Process..

[23]  Chun Qi,et al.  Hallucinating face by position-patch , 2010, Pattern Recognit..

[24]  Yuan Yan Tang,et al.  Robust Face Hallucination via Locality-Constrained Bi-Layer Representation , 2018, IEEE Transactions on Cybernetics.

[25]  Junjun Jiang,et al.  Noise Robust Face Image Super-Resolution Through Smooth Sparse Representation , 2017, IEEE Transactions on Cybernetics.

[26]  Ruimin Hu,et al.  Noise Robust Face Hallucination via Locality-Constrained Representation , 2014, IEEE Transactions on Multimedia.

[27]  C. L. Philip Chen,et al.  Quaternion Locality-Constrained Coding for Color Face Hallucination , 2018, IEEE Transactions on Cybernetics.

[28]  Junjun Jiang,et al.  L1-L1 norms for face super-resolution with mixed Gaussian-impulse noise , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[29]  Ruimin Hu,et al.  Face Super-Resolution via Multilayer Locality-Constrained Iterative Neighbor Embedding and Intermediate Dictionary Learning , 2014, IEEE Transactions on Image Processing.

[30]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[31]  Junping Zhang,et al.  Super-resolution of human face image using canonical correlation analysis , 2010, Pattern Recognit..

[32]  Michael Elad,et al.  Advances and challenges in super‐resolution , 2004, Int. J. Imaging Syst. Technol..

[33]  Chun Qi,et al.  Global consistency, local sparsity and pixel correlation: A unified framework for face hallucination , 2014, Pattern Recognit..

[34]  Yueting Zhuang,et al.  Hallucinating faces: LPH super-resolution and neighbor reconstruction for residue compensation , 2007, Pattern Recognit..

[35]  William T. Freeman,et al.  Learning Low-Level Vision , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[36]  Wai-kuen Cham,et al.  Hallucinating Face in the DCT Domain , 2011, IEEE Transactions on Image Processing.

[37]  Ruimin Hu,et al.  Face image super-resolution through locality-induced support regression , 2014, Signal Process..

[38]  Xiaogang Wang,et al.  Hallucinating face by eigentransformation , 2005, IEEE Trans. Syst. Man Cybern. Part C.

[39]  Thomas S. Huang,et al.  Robust Single Image Super-Resolution via Deep Networks With Sparse Prior , 2016, IEEE Transactions on Image Processing.

[40]  C. Thomaz,et al.  A new ranking method for principal components analysis and its application to face image analysis , 2010, Image Vis. Comput..

[41]  Maoguo Gong,et al.  Position-Patch Based Face Hallucination Using Convex Optimization , 2011, IEEE Signal Processing Letters.

[42]  Zheng Wang,et al.  SRLSP: A Face Image Super-Resolution Algorithm Using Smooth Regression With Local Structure Prior , 2017, IEEE Transactions on Multimedia.

[43]  Yu Hu,et al.  From Local Pixel Structure to Global Image Super-Resolution: A New Face Hallucination Framework , 2011, IEEE Transactions on Image Processing.

[44]  Yihong Gong,et al.  Locality-constrained Linear Coding for image classification , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.