Classification of Digital Modulated COVID-19 Images in the Presence of Channel Noise Using 2D Convolutional Neural Networks

The wireless environment poses a significant challenge to the propagation of signals. Different effects such as multipath scattering, noise, degradation, distortion, attenuation, and fading affect the distribution of signals adversely. Deep learning techniques can be used to differentiate among different modulated signals for reliable detection in a communication system. This study aims at distinguishing COVID-19 disease images that have been modulated by different digital modulation schemes and are then passed through different noise channels and classified using deep learning models. We proposed a comprehensive evaluation of different 2D Convolutional Neural Network (CNN) architectures for the task of multiclass (24-classes) classification of modulated images in the presence of noise and fading. It is used to differentiate between images modulated through Binary Phase Shift Keying, Quadrature Phase Shift Keying, 16- and 64-Quadrature Amplitude Modulation and passed through Additive White Gaussian Noise, Rayleigh, and Rician channels. We obtained mixed results under different settings such as data augmentation, disharmony between batch normalization (BN), and dropout (DO), as well as lack of BN in the network. In this study, we found that the best performing model is a 2D-CNN model using disharmony between BN and DO techniques trained using 10-fold cross-validation (CV) with a small value of DO before softmax and after every convolution and fully connected layer along with BN layers in the presence of data augmentation, while the least performing model is the 2D-CNN model trained using 5-fold CV without augmentation.

[1]  Xiaofan Li,et al.  A Survey on Deep Learning Techniques in Wireless Signal Recognition , 2019, Wirel. Commun. Mob. Comput..

[2]  Daniel Zoran,et al.  Pooling is neither necessary nor sufficient for appropriate deformation stability in CNNs , 2018, 1804.04438.

[3]  Jie Li,et al.  Deep spatio-spectral Bayesian posterior for hyperspectral image non-i.i.d. noise removal , 2020, ISPRS Journal of Photogrammetry and Remote Sensing.

[4]  Jiaxing Zhang,et al.  Scale-Invariant Convolutional Neural Networks , 2014, ArXiv.

[5]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Stéphane Mallat,et al.  Rotation, Scaling and Deformation Invariant Scattering for Texture Discrimination , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Zhiping Lin,et al.  Automatic Modulation Classification of Cochannel Signals using Deep Learning , 2018, 2018 IEEE 23rd International Conference on Digital Signal Processing (DSP).

[8]  Joan Bruna,et al.  Learning Stable Group Invariant Representations with Convolutional Networks , 2013, ICLR.

[9]  Xiaojun Jing,et al.  Adversarial Transfer Learning for Deep Learning Based Automatic Modulation Classification , 2020, IEEE Signal Processing Letters.

[10]  Jie Li,et al.  Hybrid Noise Removal in Hyperspectral Imagery With a Spatial–Spectral Gradient Network , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[12]  Alam Noor,et al.  Median filters combined with denoising convolutional neural network for Gaussian and impulse noises , 2020, Multimedia Tools and Applications.

[13]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[14]  Lianru Gao,et al.  Graph Convolutional Networks for Hyperspectral Image Classification , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Camille Couprie,et al.  Learning Hierarchical Features for Scene Labeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[17]  Stephan J. Garbin,et al.  Harmonic Networks: Deep Translation and Rotation Equivariance , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Quoc V. Le,et al.  Measuring Invariances in Deep Networks , 2009, NIPS.

[19]  Jean-Paul M. G. Linnartz,et al.  Exact analysis of the outage probability in multiple-user mobile radio , 1992, IEEE Trans. Commun..

[20]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[21]  Jonathon Shlens,et al.  Explaining and Harnessing Adversarial Examples , 2014, ICLR.

[22]  Yair Weiss,et al.  Why do deep convolutional networks generalize so poorly to small image transformations? , 2018, J. Mach. Learn. Res..

[23]  Naoto Yokoya,et al.  More Diverse Means Better: Multimodal Deep Learning Meets Remote-Sensing Imagery Classification , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Richard Zhang,et al.  Making Convolutional Networks Shift-Invariant Again , 2019, ICML.

[25]  Naoto Yokoya,et al.  X-ModalNet: A semi-supervised deep cross-modal network for classification of remote sensing data , 2020, ISPRS journal of photogrammetry and remote sensing : official publication of the International Society for Photogrammetry and Remote Sensing.

[26]  Xiang Li,et al.  Understanding the Disharmony Between Dropout and Batch Normalization by Variance Shift , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Aki Vehtari,et al.  Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC , 2015, Statistics and Computing.

[28]  Max Welling,et al.  Transformation Properties of Learned Visual Representations , 2014, ICLR.

[29]  Jonathan Tompson,et al.  Joint Training of a Convolutional Network and a Graphical Model for Human Pose Estimation , 2014, NIPS.

[30]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[31]  Anis Koubaa,et al.  Automated sheep facial expression classification using deep transfer learning , 2020, Comput. Electron. Agric..

[32]  Jun Fang,et al.  A Deep Learning Approach for Modulation Recognition via Exploiting Temporal Correlations , 2018, 2018 IEEE 19th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC).

[33]  Honglak Lee,et al.  Learning Invariant Representations with Local Transformations , 2012, ICML.

[34]  M. D. Austin,et al.  Exact cochannel interference analysis for log-normal shadowed Rician fading channels , 1994 .

[35]  Nitish Srivastava,et al.  Improving neural networks by preventing co-adaptation of feature detectors , 2012, ArXiv.

[36]  Sander Dieleman,et al.  Rotation-invariant convolutional neural networks for galaxy morphology prediction , 2015, ArXiv.

[37]  Mingyan Liu,et al.  Spatially Transformed Adversarial Examples , 2018, ICLR.

[38]  Wangmeng Zuo,et al.  Toward Convolutional Blind Denoising of Real Photographs , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[39]  Claude E. Shannon,et al.  A mathematical theory of communication , 1948, MOCO.

[40]  Jon Atli Benediktsson,et al.  Feature Extraction for Hyperspectral Imagery: The Evolution From Shallow to Deep: Overview and Toolbox , 2020, IEEE Geoscience and Remote Sensing Magazine.

[41]  S. Valaee,et al.  Survey of Dropout Methods for Deep Neural Networks , 2019, ArXiv.

[42]  Nicholas Kenelm Taylor,et al.  Classification of Communication Signals and Detection of Unknown Formats Using Artificial Neural Networks , 2005 .

[43]  Alexei A. Efros,et al.  Unbiased look at dataset bias , 2011, CVPR 2011.

[44]  Trevor Darrell,et al.  DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition , 2013, ICML.

[45]  Mark D. McDonnell,et al.  Understanding Data Augmentation for Classification: When to Warp? , 2016, 2016 International Conference on Digital Image Computing: Techniques and Applications (DICTA).

[46]  Quanshi Zhang,et al.  Visual interpretability for deep learning: a survey , 2018, Frontiers of Information Technology & Electronic Engineering.

[47]  Jiquan Ngiam,et al.  Sparse Filtering , 2011, NIPS.

[48]  Naoto Yokoya,et al.  An Augmented Linear Mixing Model to Address Spectral Variability for Hyperspectral Unmixing , 2018, IEEE Transactions on Image Processing.

[49]  Ali Emre Pusane,et al.  Deep Learning Based Automatic Modulation Classification in the Case of Carrier Phase Shift , 2020, 2020 43rd International Conference on Telecommunications and Signal Processing (TSP).

[50]  Stéphane Mallat,et al.  Invariant Scattering Convolution Networks , 2012, IEEE transactions on pattern analysis and machine intelligence.