Convolutional Neural Network Based Models for Improving Super-Resolution Imaging

Many fields, such as remote sensing, medical imaging, and biological detection, pose a technical challenge for achieving super-resolution imaging. Convolutional neural networks (CNNs) are considered one of the potential solutions to realize the super-resolution. In this paper three-layer, CNN-based models are proposed to reconstruct the super-resolution images using four optimization algorithms, i.e., stochastic gradient descent, adaptive gradient (AdaGrad), root mean square prop (RMSprop), and adaptive moment estimation (ADAM). Among these four optimizations, ADAM is considered to have the best performance. To further verify the impact of the number of convolution layers on performance, a selection of CNN-based models with four convolutional layers is then proposed, each of which is named with the convolution parameters. All the four-layer models are optimized with ADAM, and the experimental results indicate that the 9–3–3–5 model achieves the best performance in the super-resolution reconstruction task.

[1]  Fredrik Wallin,et al.  A Comprehensive Review of Smart Energy Meters in Intelligent Energy Networks , 2016, IEEE Internet of Things Journal.

[2]  Zhanyu Ma,et al.  Text-Independent Speaker Identification Using the Histogram Transform Model , 2016, IEEE Access.

[3]  Xiaoqing Han,et al.  Review on the research and practice of deep learning and reinforcement learning in smart grids , 2018, CSEE Journal of Power and Energy Systems.

[4]  D. Yeung,et al.  Super-resolution through neighbor embedding , 2004, CVPR 2004.

[5]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Kyoung Mu Lee,et al.  Deeply-Recursive Convolutional Network for Image Super-Resolution , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Tomio Goto,et al.  Super-resolution method and its application to medical image processing , 2017, 2017 IEEE 6th Global Conference on Consumer Electronics (GCCE).

[8]  Jan Kautz,et al.  Loss Functions for Image Restoration With Neural Networks , 2017, IEEE Transactions on Computational Imaging.

[9]  Guan Gui,et al.  Deep Learning Based Improved Classification System for Designing Tomato Harvesting Robot , 2018, IEEE Access.

[10]  Lamei Zhang,et al.  Polarimetric SAR Terrain Classification Using 3D Convolutional Neural Network , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[11]  Feng Qi,et al.  Single Image Super-Resolution Using Deep CNN with Dense Skip Connections and Inception-ResNet , 2018, 2018 9th International Conference on Information Technology in Medicine and Education (ITME).

[12]  Kyoung Mu Lee,et al.  Enhanced Deep Residual Networks for Single Image Super-Resolution , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[13]  Guan Gui,et al.  Deep Learning-Inspired Message Passing Algorithm for Efficient Resource Allocation in Cognitive Radio Networks , 2019, IEEE Transactions on Vehicular Technology.

[14]  Jun Guo,et al.  The Role of Data Analysis in the Development of Intelligent Energy Networks , 2017, IEEE Network.

[15]  Guan Gui,et al.  Deep Learning for an Effective Nonorthogonal Multiple Access Scheme , 2018, IEEE Transactions on Vehicular Technology.

[16]  Guan Gui,et al.  Deep Learning for Super-Resolution Channel Estimation and DOA Estimation Based Massive MIMO System , 2018, IEEE Transactions on Vehicular Technology.

[17]  Yue Yin,et al.  Deep Learning-Based Unmanned Surveillance Systems for Observing Water Levels , 2018, IEEE Access.

[18]  Jithin Saji Isaac,et al.  Super resolution techniques for medical image processing , 2015, 2015 International Conference on Technologies for Sustainable Development (ICTSD).

[19]  Lei Zhang,et al.  An edge-guided image interpolation algorithm via directional filtering and data fusion , 2006, IEEE Transactions on Image Processing.

[20]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[21]  Badong Chen,et al.  Blocked Maximum Correntropy Criterion Algorithm for Cluster-Sparse System Identifications , 2019, IEEE Transactions on Circuits and Systems II: Express Briefs.

[22]  Lei Guo,et al.  When Deep Learning Meets Metric Learning: Remote Sensing Image Scene Classification via Learning Discriminative CNNs , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Yonina C. Eldar,et al.  Sparsity-Based Super Resolution for SEM Images , 2017, Nano letters.

[24]  Jun Guo,et al.  Short Utterance Based Speech Language Identification in Intelligent Vehicles With Time-Scale Modifications and Deep Bottleneck Features , 2019, IEEE Transactions on Vehicular Technology.

[25]  Fumiyuki Adachi,et al.  Deep-Learning-Based Millimeter-Wave Massive MIMO for Hybrid Precoding , 2019, IEEE Transactions on Vehicular Technology.

[26]  Lei Liu,et al.  Background Subtraction on Depth Videos with Convolutional Neural Networks , 2018, 2018 International Joint Conference on Neural Networks (IJCNN).

[27]  Jun Guo,et al.  Feature selection for neutral vector in EEG signal classification , 2016, Neurocomputing.

[28]  Tareq Abed Mohammed,et al.  Understanding of a convolutional neural network , 2017, 2017 International Conference on Engineering and Technology (ICET).

[29]  Thomas S. Huang,et al.  Image super-resolution as sparse representation of raw image patches , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Christian Ledig,et al.  Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  Jingfeng Lu,et al.  Unsupervised Super-Resolution Framework for Medical Ultrasound Images Using Dilated Convolutional Neural Networks , 2018, 2018 IEEE 3rd International Conference on Image, Vision and Computing (ICIVC).

[32]  Xiuping Jia,et al.  Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Jian Xiong,et al.  Unsupervised Learning-Based Fast Beamforming Design for Downlink MIMO , 2019, IEEE Access.