Lightweight Feedback Convolution Neural Network for Remote Sensing Images Super-Resolution

There are lots of image data in the field of remote sensing, most of which have low-resolution due to the limited image sensor. The super-resolution method can effectively restore the low-resolution image to the high-resolution image. However, the existing super-resolution method has both heavy computing burden and number of parameters. For saving costs, we propose the feedback ghost residual dense network (FGRDN), which considers the feedback mechanism as the framework to attain lower features through high-level refining. Further, for feature extraction, we replace the convolution of the residual dense blocks (RDBs) with ghost modules (GMs), which can remove the redundant channels and avoid the increase of parameters along with the network depth. Finally, the spatial and channel attention module (SCM) is employed in the end of the RDB to learn more useful information from features. Compared to other SOTA lightweight algorithms, our proposed algorithm can reach convergences more rapidly with fewer parameters, and the performance of the network can be markedly enhanced on the image texture and object contour reconstruction with better peak signal-to-noise ratio (PSNR) and structural similarity (SSIM).

[1]  L. Pan,et al.  Image Augmentation-Based Food Recognition with Convolutional Neural Networks , 2019, Computers, Materials & Continua.

[2]  Wenbing Wu,et al.  A Probability Preferred Priori Offloading Mechanism in Mobile Edge Computing , 2020, IEEE Access.

[3]  Jin Wang,et al.  LogEvent2vec: LogEvent-to-Vector Based Anomaly Detection for Large-Scale Logs in Internet of Things , 2020, Sensors.

[4]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[5]  Xi Chen,et al.  The improved image inpainting algorithm via encoder and similarity constraint , 2020, The Visual Computer.

[6]  Wangmeng Zuo,et al.  Learning a Single Convolutional Super-Resolution Network for Multiple Degradations , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[7]  Bodo Rosenhahn,et al.  Vehicle detection in aerial images , 2018, IOP Conference Series: Earth and Environmental Science.

[8]  Narendra Ahuja,et al.  Deep Laplacian Pyramid Networks for Fast and Accurate Super-Resolution , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Kiyoharu Aizawa,et al.  Sketch-based manga retrieval using manga109 dataset , 2015, Multimedia Tools and Applications.

[10]  Peng Liu,et al.  Deep Differential Convolutional Network for Single Image Super-Resolution , 2019, IEEE Access.

[11]  Mohammad Reza Kangavari,et al.  A mathematical task dispatching model in wireless sensor actor networks , 2019, Comput. Syst. Sci. Eng..

[12]  Qian Zhang,et al.  Research of improving semantic image segmentation based on a feature fusion model , 2020, Journal of Ambient Intelligence and Humanized Computing.

[13]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[14]  Michael Elad,et al.  On Single Image Scale-Up Using Sparse-Representations , 2010, Curves and Surfaces.

[15]  Lin Sun,et al.  Feedback Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Narendra Ahuja,et al.  Single image super-resolution from transformed self-exemplars , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Aline Roumy,et al.  Low-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding , 2012, BMVC.

[18]  Gwanggil Jeon,et al.  Gated Multiple Feedback Network for Image Super-Resolution , 2019, BMVC.

[19]  Yun Fu,et al.  Residual Dense Network for Image Restoration , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Jianmin Jiang,et al.  Real-Time Image Super-Resolution Using Recursive Depthwise Separable Convolution Network , 2019, IEEE Access.

[21]  Wei Wu,et al.  Feedback Network for Image Super-Resolution , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Jin Wang,et al.  Big Data Service Architecture: A Survey , 2020 .

[23]  Han-Chieh Chao,et al.  Blockchain-based Systems and Applications: A Survey , 2020 .

[24]  Jian Yang,et al.  Image Super-Resolution via Deep Recursive Residual Network , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Xinbo Gao,et al.  Fast and Accurate Single Image Super-Resolution via Information Distillation Network , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[26]  Yun Fu,et al.  Image Super-Resolution Using Very Deep Residual Channel Attention Networks , 2018, ECCV.

[27]  Jin Wang,et al.  A Cascaded R-CNN With Multiscale Attention and Imbalanced Samples for Traffic Sign Detection , 2020, IEEE Access.

[28]  Fangfang Li,et al.  Deep hierarchical encoding model for sentence semantic matching , 2020, J. Vis. Commun. Image Represent..

[29]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Kyoung Mu Lee,et al.  Enhanced Deep Residual Networks for Single Image Super-Resolution , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[31]  Eirikur Agustsson,et al.  NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[32]  Tong Tong,et al.  Image Super-Resolution Using Dense Skip Connections , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[33]  Jianyuan Guo,et al.  GhostNet: More Features From Cheap Operations , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Kyung-Ah Sohn,et al.  Fast, Accurate, and, Lightweight Super-Resolution with Cascading Residual Network , 2018, ECCV.

[37]  Jian Yang,et al.  MemNet: A Persistent Memory Network for Image Restoration , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[38]  Kyoung Mu Lee,et al.  Accurate Image Super-Resolution Using Very Deep Convolutional Networks , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[39]  Kyoung Mu Lee,et al.  Deeply-Recursive Convolutional Network for Image Super-Resolution , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[40]  Qian Zhang,et al.  The face image super-resolution algorithm based on combined representation learning , 2020, Multimedia Tools and Applications.

[41]  Xinbo Gao,et al.  Lightweight Image Super-Resolution with Information Multi-distillation Network , 2019, ACM Multimedia.

[42]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[43]  Heyan Huang,et al.  Concept Representation by Learning Explicit and Implicit Concept Couplings , 2021, IEEE Intelligent Systems.