Patch-based face hallucination with multitask deep neural network

Face hallucination technique generates high-resolution face images from low-resolution ones. In this paper, we propose a patch based multitask deep learning method for face hallucination, which is robust to blurring of images. Our method is based on fully connected feedforward neural network, and the weights of the final layers are fine-tuned separately on different clusters of patches. Experimental results show that our system outperforms the prior state-of-the-art methods by a significant margin, while using less testing computation time.

[1]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Ruimin Hu,et al.  Position-Patch Based Face Hallucination via Locality-Constrained Representation , 2012, 2012 IEEE International Conference on Multimedia and Expo.

[3]  Chun Qi,et al.  Hallucinating face by position-patch , 2010, Pattern Recognit..

[4]  Yuning Jiang,et al.  Learning Face Hallucination in the Wild , 2015, AAAI.

[5]  Chih-Yuan Yang,et al.  Structured Face Hallucination , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Takeo Kanade,et al.  Hallucinating faces , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[7]  Xiaogang Wang,et al.  Hallucinating face by eigentransformation , 2005, IEEE Trans. Syst. Man Cybern. Part C.

[8]  Shao-Yi Chien,et al.  Eigen-patch: Position-patch based face hallucination using eigen transformation , 2014, 2014 IEEE International Conference on Multimedia and Expo (ICME).

[9]  Xiangjian He,et al.  Face hallucination based on nonparametric Bayesian learning , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[10]  Luc Van Gool,et al.  Anchored Neighborhood Regression for Fast Example-Based Super-Resolution , 2013, 2013 IEEE International Conference on Computer Vision.

[11]  Yu Hu,et al.  From Local Pixel Structure to Global Image Super-Resolution: A New Face Hallucination Framework , 2011, IEEE Transactions on Image Processing.

[12]  Maoguo Gong,et al.  Position-Patch Based Face Hallucination Using Convex Optimization , 2011, IEEE Signal Processing Letters.

[13]  Thomas S. Huang,et al.  Deep Networks for Image Super-Resolution with Sparse Prior , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[14]  Harry Shum,et al.  A two-step approach to hallucinating faces: global parametric model and local nonparametric model , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[15]  Shiguang Shan,et al.  Deep Network Cascade for Image Super-resolution , 2014, ECCV.