Single-image super-resolution reconstruction using dark channel regularization network

For single-image super-resolution (SR), deep learning-based approaches have attained superior performance that overshadow all previous approaches. Most recently published deep learning-based single-image SR approaches rely on either deeper or more complex network to achieve further improved results, which are time and space intensive. In this paper, we propose a new method to effectively improve the quality of the final magnified image: a dark channel prior-based network is first designed and then used to regularize the previously existed SR networks. The motivation of this work is an interesting observation that the dark channel of the magnified image contains less dark pixels than that of the original high-resolution image. Since the proposed dark channel prior-based network is a fixed network and does not contain any trainable parameters, the combined hybrid network thus can maintain its original complexity and achieve state-of-the-art results.

[1]  Di Zhang,et al.  Morphable model space based face super-resolution reconstruction and recognition , 2012, Image Vis. Comput..

[2]  Michal Irani,et al.  Super-resolution from a single image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[3]  Thomas S. Huang,et al.  Deep Networks for Image Super-Resolution with Sparse Prior , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[4]  Kyoung Mu Lee,et al.  Enhanced Deep Residual Networks for Single Image Super-Resolution , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[5]  Yun Fu,et al.  Image Super-Resolution Using Very Deep Residual Channel Attention Networks , 2018, ECCV.

[6]  Rafia Rahim,et al.  Improving Super Resolution Methods Via Incremental Residual Learning , 2018, 2019 IEEE International Conference on Image Processing (ICIP).

[7]  Li Fei-Fei,et al.  Perceptual Losses for Real-Time Style Transfer and Super-Resolution , 2016, ECCV.

[8]  Lei Zhang,et al.  Image Deblurring and Super-Resolution by Adaptive Sparse Domain Selection and Adaptive Regularization , 2010, IEEE Transactions on Image Processing.

[9]  Aline Roumy,et al.  Single-Image Super-Resolution via Linear Mapping of Interpolated Self-Examples , 2014, IEEE Transactions on Image Processing.

[10]  Kyoung Mu Lee,et al.  Accurate Image Super-Resolution Using Very Deep Convolutional Networks , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Kin-Man Lam,et al.  Face hallucination based on sparse local-pixel structure , 2014, Pattern Recognit..

[12]  Raanan Fattal,et al.  Image and video upscaling from local self-examples , 2011, TOGS.

[13]  Xudong Sun,et al.  Image Super-Resolution Reconstruction Using Generative Adversarial Networks Based on Wide-Channel Activation , 2020, IEEE Access.

[14]  Luc Van Gool,et al.  A+: Adjusted Anchored Neighborhood Regression for Fast Super-Resolution , 2014, ACCV.

[15]  Xinghao Ding,et al.  Clearing the Skies: A Deep Network Architecture for Single-Image Rain Removal , 2016, IEEE Transactions on Image Processing.

[16]  Yu Qiao,et al.  ESRGAN: Enhanced Super-Resolution Generative Adversarial Networks , 2018, ECCV Workshops.

[17]  Shuicheng Yan,et al.  Deep Edge Guided Recurrent Residual Learning for Image Super-Resolution , 2016, IEEE Transactions on Image Processing.

[18]  Wei Wang,et al.  Video Super-Resolution via Bidirectional Recurrent Convolutional Networks , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Jiazhong He,et al.  Hybrid sparse-representation-based approach to image super-resolution reconstruction , 2017, J. Electronic Imaging.

[20]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Zhe L. Lin,et al.  Fast Image Super-Resolution Based on In-Place Example Regression , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[23]  Luc Van Gool,et al.  Anchored Neighborhood Regression for Fast Example-Based Super-Resolution , 2013, 2013 IEEE International Conference on Computer Vision.

[24]  Jian Sun,et al.  Single image haze removal using dark channel prior , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Shervin Minaee,et al.  Efficient Super Resolution for Large-Scale Images Using Attentional GAN , 2018, 2018 IEEE International Conference on Big Data (Big Data).

[26]  Christian Ledig,et al.  Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Jiashi Feng,et al.  Deep Edge Guided Recurrent Residual Learning for Image Super-Resolution. , 2017, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.