Convolutional Neural Network-Based Multiple-Rate Compressive Sensing for Massive MIMO CSI Feedback: Design, Simulation, and Analysis

Massive multiple-input multiple-output (MIMO) is a promising technology to increase link capacity and energy efficiency. However, these benefits are based on available channel state information (CSI) at the base station (BS). Therefore, user equipment (UE) needs to keep on feeding CSI back to the BS, thereby consuming precious bandwidth resource. Large-scale antennas at the BS for massive MIMO seriously increase this overhead. In this paper, we propose a multiple-rate compressive sensing neural network framework to compress and quantize the CSI. This framework not only improves reconstruction accuracy but also decreases storage space at the UE, thus enhancing the system feasibility. Specifically, we establish two network design principles for CSI feedback, propose a new network architecture, CsiNet+, according to these principles, and develop a novel quantization framework and training strategy. Next, we further introduce two different variable-rate approaches, namely, SM-CsiNet+ and PM-CsiNet+, which decrease the parameter number at the UE by 38.0% and 46.7%, respectively. Experimental results show that CsiNet+ outperforms the state-of-the-art network by a margin but only slightly increases the parameter number. We also investigate the compression and reconstruction mechanism behind deep learning-based CSI feedback methods via parameter visualization, which provides a guideline for subsequent research.

[1]  Pavan K. Turaga,et al.  ReconNet: Non-Iterative Reconstruction of Images from Compressively Sensed Measurements , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Jürgen Schmidhuber,et al.  LSTM: A Search Space Odyssey , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[3]  Pavan K. Turaga,et al.  Rate-Adaptive Neural Networks for Spatial Multiplexers , 2018, ArXiv.

[4]  Guangming Shi,et al.  Full Image Recover for Block-Based Compressive Sensing , 2018, 2018 IEEE International Conference on Multimedia and Expo (ICME).

[5]  Yonina C. Eldar,et al.  Block-sparsity: Coherence and efficient recovery , 2008, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[6]  Robert W. Heath,et al.  Five disruptive technology directions for 5G , 2013, IEEE Communications Magazine.

[7]  Julian Cheng,et al.  Compressed CSI Feedback With Learned Measurement Matrix for mmWave Massive MIMO , 2019, ArXiv.

[8]  Guang Yang,et al.  DAGAN: Deep De-Aliasing Generative Adversarial Networks for Fast Compressed Sensing MRI Reconstruction , 2018, IEEE Transactions on Medical Imaging.

[9]  Hai Lin,et al.  Spatial- and Frequency-Wideband Effects in Millimeter-Wave Massive MIMO Systems , 2017, IEEE Transactions on Signal Processing.

[10]  Erik G. Larsson,et al.  Energy and Spectral Efficiency of Very Large Multiuser MIMO Systems , 2011, IEEE Transactions on Communications.

[11]  Yue Gao,et al.  Sparse Representation for Wireless Communications: A Compressive Sensing Approach , 2018, IEEE Signal Processing Magazine.

[12]  Kezhi Wang,et al.  Bit-Level Optimized Neural Network for Multi-Antenna Channel Quantization , 2019, IEEE Wireless Communications Letters.

[13]  Feng Jiang,et al.  Deep Neural Network Based Sparse Measurement Matrix for Image Compressed Sensing , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[14]  Robert W. Heath,et al.  An overview of limited feedback in wireless communication systems , 2008, IEEE Journal on Selected Areas in Communications.

[15]  Zhi Ding,et al.  Exploiting Bi-Directional Channel Reciprocity in Deep Learning for Low Rate Massive MIMO CSI Feedback , 2019, IEEE Wireless Communications Letters.

[16]  Il-Min Kim,et al.  Deep Autoencoder Based CSI Feedback With Feedback Errors and Feedback Delay in FDD Massive MIMO Systems , 2019, IEEE Wireless Communications Letters.

[17]  Jianyue Zhu,et al.  Relative location prediction in CT scan images using convolutional neural networks , 2018, Comput. Methods Programs Biomed..

[18]  Hui Feng,et al.  A Deep Learning Framework of Quantized Compressed Sensing for Wireless Neural Recording , 2016, IEEE Access.

[19]  Yoshua Bengio,et al.  Extracting and composing robust features with denoising autoencoders , 2008, ICML '08.

[20]  Deniz Gündüz,et al.  Deep Joint Source-channel Coding for Wireless Image Transmission , 2018, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[21]  Shi Jin,et al.  Deep Learning for Massive MIMO CSI Feedback , 2017, IEEE Wireless Communications Letters.

[22]  Timo Aila,et al.  Pruning Convolutional Neural Networks for Resource Efficient Inference , 2016, ICLR.

[23]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[24]  Shi Jin,et al.  An Overview of Low-Rank Channel Estimation for Massive MIMO Systems , 2016, IEEE Access.

[25]  Erik Cambria,et al.  Recent Trends in Deep Learning Based Natural Language Processing , 2017, IEEE Comput. Intell. Mag..

[26]  Geoffrey Ye Li,et al.  An Overview of Massive MIMO: Benefits and Challenges , 2014, IEEE Journal of Selected Topics in Signal Processing.

[27]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[28]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[29]  I. Daubechies,et al.  An iterative thresholding algorithm for linear inverse problems with a sparsity constraint , 2003, math/0307152.

[30]  Thomas L. Marzetta,et al.  Massive MIMO: An Introduction , 2015, Bell Labs Technical Journal.

[31]  Yin Zhang,et al.  An efficient augmented Lagrangian method with applications to total variation minimization , 2013, Computational Optimization and Applications.

[32]  Pangan Ting,et al.  Compressive sensing based channel feedback protocols for spatially-correlated massive antenna arrays , 2012, 2012 IEEE Wireless Communications and Networking Conference (WCNC).

[33]  Kezhi Wang,et al.  MIMO Channel Information Feedback Using Deep Recurrent Network , 2018, IEEE Communications Letters.

[34]  Yongdong Zhang,et al.  DR2-Net: Deep Residual Reconstruction Network for Image Compressive Sensing , 2017, Neurocomputing.

[35]  Vincent K. N. Lau,et al.  Distributed Compressive CSIT Estimation and Feedback for FDD Multi-User Massive MIMO Systems , 2014, IEEE Transactions on Signal Processing.

[36]  Shi Jin,et al.  Channel Estimation for Massive MIMO Using Gaussian-Mixture Bayesian Learning , 2015, IEEE Transactions on Wireless Communications.

[37]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  Lei Zhang,et al.  Deep Image Compression with Iterative Non-Uniform Quantization , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[39]  Zhen Gao,et al.  Compressive Sensing Techniques for Next-Generation Wireless Communications , 2017, IEEE Wireless Communications.

[40]  Geoffrey Ye Li,et al.  Deep Learning-Based CSI Feedback Approach for Time-Varying Massive MIMO Channels , 2018, IEEE Wireless Communications Letters.

[41]  Derrick Wing Kwan Ng,et al.  Key technologies for 5G wireless systems , 2017 .

[42]  Erik G. Larsson,et al.  Massive MIMO for next generation wireless systems , 2013, IEEE Communications Magazine.

[43]  Qiang Wang,et al.  Large receptive field convolutional neural network for image super-resolution , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[44]  Feng Jiang,et al.  An Efficient Deep Quantized Compressed Sensing Coding Framework of Natural Images , 2018, ACM Multimedia.

[45]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[46]  Wei Chen,et al.  Deep Learning Based Fast Multiuser Detection for Massive Machine-Type Communication , 2018, 2019 IEEE 90th Vehicular Technology Conference (VTC2019-Fall).

[47]  Geoffrey Ye Li,et al.  A Novel Quantization Method for Deep Learning-Based Massive MIMO CSI Feedback , 2019, 2019 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[48]  Geoffrey Ye Li,et al.  Compression and Acceleration of Neural Networks for Communications , 2019, IEEE Wireless Communications.

[49]  Claude Oestges,et al.  The COST 2100 MIMO channel model , 2011, IEEE Wirel. Commun..

[50]  Biing-Hwang Juang,et al.  Deep Learning in Physical Layer Communications , 2018, IEEE Wireless Communications.

[51]  Richard G. Baraniuk,et al.  From Denoising to Compressed Sensing , 2014, IEEE Transactions on Information Theory.

[52]  Surya Ganguli,et al.  On the Expressive Power of Deep Neural Networks , 2016, ICML.

[53]  Chan-Byoung Chae,et al.  Compressed channel feedback for correlated massive MIMO systems , 2014, 2014 IEEE Globecom Workshops (GC Wkshps).