A New Deep Spiking Architecture for Reconstruction of Compressed Data in Cognitive Radio Networks

Cognitive Radio (CR) offers a spectrum sharing solution to handle the massive amount of devices operating in the same spectrum. In this work a sub-Nyquist compressive sensing technique is proposed that allows secondary users to sense and utilize idle spectrum. Reconstruction of compressed sparse data is achieved through a dual stage sophisticated reconstruction algorithm. The reconstruction uses a classical fast Orthogonal Matching Persuit (OMP), followed by a new spiking deep Residual neural Network (ResNet) architecture. The proposed architecture is obtained through a novel distributed conversion technique that is proposed to convert deep architectures to a spiking neural networks. The reconstructed data is compared in terms of Peak Signal-to-Noise Ratio (PSNR), Mean Square Error (MSE) and Structural Similarity (SSIM) to the compressed data and the ground truth. Super Resolution Convolutional Neural Network (SRCNN) and a Deep ResNet are also used for reconstruction. The proposed algorithm outperforms SRCNN and the unconverted ResNet, specially at low Channel SNR (CSNR). In addition, the proposed algorithm results in a 68% reduction in both storage and energy requirements, which makes it suitable for implementation on User Equipment (UE).

[1]  K. Salama,et al.  Neural Coding in Spiking Neural Networks: A Comparative Study for Robust Neuromorphic Systems , 2021, Frontiers in Neuroscience.

[2]  Xiaowei Huang,et al.  A Little Energy Goes a Long Way: Build an Energy-Efficient, Accurate Spiking Neural Network From Convolutional Neural Network , 2021, Frontiers in Neuroscience.

[3]  Zhu Han,et al.  6G Wireless Systems: A Vision, Architectural Elements, and Future Directions , 2020, IEEE Access.

[4]  Kaushik Roy,et al.  Towards Scalable, Efficient and Accurate Deep Spiking Neural Networks with Backward Residual Connections, Stochastic Softmax and Hybridization , 2019, ArXiv.

[5]  Nick Barnes,et al.  Densely Residual Laplacian Super-Resolution , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Timothy Lillicrap,et al.  Deep Compressed Sensing , 2019, ICML.

[7]  Xi Wu,et al.  A structure-time parallel implementation of spike-based deep learning , 2019, Neural Networks.

[8]  Hancheng Lu,et al.  WDLReconNet: Compressive Sensing Reconstruction With Deep Learning Over Wireless Fading Channels , 2019, IEEE Access.

[9]  Yun Fu,et al.  Image Super-Resolution Using Very Deep Residual Channel Attention Networks , 2018, ECCV.

[10]  T. Masquelier,et al.  Deep Learning in Spiking Neural Networks , 2018, Neural Networks.

[11]  Jun Wu,et al.  Energy-efficient cooperative spectrum sensing for hybrid spectrum sharing cognitive radio networks , 2018, 2018 IEEE Wireless Communications and Networking Conference (WCNC).

[12]  P. Venkatesan,et al.  Group Based Multi-Channel Synchronized Spectrum Sensing in Cognitive Radio Network with 5G , 2018, Mobile Networks and Applications.

[13]  Yun Fu,et al.  Residual Dense Network for Image Super-Resolution , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[14]  Fatima Salahdine,et al.  Compressive Spectrum Sensing for Cognitive Radio Networks , 2018, ArXiv.

[15]  Kaushik Roy,et al.  Going Deeper in Spiking Neural Networks: VGG and Residual Architectures , 2018, Front. Neurosci..

[16]  Bing Chen,et al.  Full Spectrum Sharing in Cognitive Radio Networks Toward 5G: A Survey , 2018, IEEE Access.

[17]  Yue Gao,et al.  Sparse Representation for Wireless Communications: A Compressive Sensing Approach , 2018, IEEE Signal Processing Magazine.

[18]  Shih-Chii Liu,et al.  Conversion of Continuous-Valued Deep Networks to Efficient Event-Driven Networks for Image Classification , 2017, Front. Neurosci..

[19]  Xin Liu,et al.  5G-based wideband cognitive radio system design with cooperative spectrum sensing , 2017, Phys. Commun..

[20]  Kyoung Mu Lee,et al.  Enhanced Deep Residual Networks for Single Image Super-Resolution , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[21]  Hui Feng,et al.  Efficient Compressed Sensing for Wireless Neural Recording: A Deep Learning Approach , 2017, IEEE Signal Processing Letters.

[22]  Vivienne Sze,et al.  Efficient Processing of Deep Neural Networks: A Tutorial and Survey , 2017, Proceedings of the IEEE.

[23]  Iulia-Alexandra Lungu,et al.  Theory and Tools for the Conversion of Analog to Spiking Convolutional Neural Networks , 2016, ArXiv.

[24]  Michael Pockley.  The Teaching Assistant , 2016 .

[25]  Symeon Chatzinotas,et al.  Application of Compressive Sensing in Cognitive Radio Communications: A Survey , 2016, IEEE Communications Surveys & Tutorials.

[26]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Kyoung Mu Lee,et al.  Accurate Image Super-Resolution Using Very Deep Convolutional Networks , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Matthew Cook,et al.  Fast-classifying, high-accuracy spiking deep networks through weight and threshold balancing , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[29]  Yongqiang Cao,et al.  Spiking Deep Convolutional Neural Networks for Energy-Efficient Object Recognition , 2015, International Journal of Computer Vision.

[30]  Xiaoou Tang,et al.  Learning a Deep Convolutional Network for Image Super-Resolution , 2014, ECCV.

[31]  Richard G. Baraniuk,et al.  From Denoising to Compressed Sensing , 2014, IEEE Transactions on Information Theory.

[32]  Aline Roumy,et al.  Low-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding , 2012, BMVC.

[33]  Ian F. Akyildiz,et al.  Cooperative spectrum sensing in cognitive radio networks: A survey , 2011, Phys. Commun..

[34]  Shawn D. Newsam,et al.  Bag-of-visual-words and spatial extensions for land-use classification , 2010, GIS '10.

[35]  Deanna Needell,et al.  CoSaMP: Iterative signal recovery from incomplete and inaccurate samples , 2008, ArXiv.

[36]  E.J. Candes,et al.  An Introduction To Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[37]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[38]  Emmanuel J. Candès,et al.  Decoding by linear programming , 2005, IEEE Transactions on Information Theory.

[39]  Alex M. Andrew,et al.  Spiking Neuron Models: Single Neurons, Populations, Plasticity , 2003 .

[40]  Jun Yang,et al.  A Review of Sparse Recovery Algorithms , 2019, IEEE Access.

[41]  Gitta Kutyniok.  Compressed Sensing , 2012 .

[42]  Wulfram Gerstner,et al.  SPIKING NEURON MODELS Single Neurons , Populations , Plasticity , 2002 .