Jointly Sparse Signal Recovery via Deep Auto-encoder and Parallel Coordinate Descent Unrolling

In this paper, combining techniques in compressed sensing, parallel optimization and deep learning, an autoencoder-based approach is proposed to jointly design the common measurement matrix and jointly sparse signal recovery method for complex sparse signals. The encoder achieves noisy linear compression for jointly sparse signals, with a common measurement matrix. The decoder realizes jointly sparse signal recovery based on an iterative parallel-coordinate descent algorithm which is proposed to solve GROUP LASSO in a parallel manner. In particular, the decoder consists of an approximation part which unfolds (several iterations of) the proposed iterative algorithm to obtain an approximate solution of GROUP LASSO and a correction part which reduces the difference between the approximate solution and the actual jointly sparse signals. To our knowledge, this is the first time that an optimization-based jointly sparse signal recovery method is implemented using a neural network. The proposed approach achieves higher recovery accuracy with less computation time than the classic GROUP LASSO method, and the gain significantly increases in the presence of extra structures in sparse patterns. The common measurement matrix obtained by the proposed approach is also suitable for the classic GROUP LASSO method. We consider an application example, i.e., channel estimation in Multiple-Input Multiple-Output (MIMO)-based grant-free massive access for massive machine-type communications (mMTC). By numerical results, we demonstrate the substantial gains of the proposed approach over GROUP LASSO and AMP when the number of jointly sparse signals is not very large.

[1]  Richard G. Baraniuk,et al.  DeepCodec: Adaptive sensing and recovery via deep convolutional neural networks , 2017, 2017 55th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[2]  Prabhu Babu,et al.  Majorization-Minimization Algorithms in Signal Processing, Communications, and Machine Learning , 2017, IEEE Transactions on Signal Processing.

[3]  Ying Cui,et al.  Joint Design of Measurement Matrix and Sparse Support Recovery Method via Deep Auto-Encoder , 2019, IEEE Signal Processing Letters.

[4]  Ying Cui,et al.  Optimal Caching Designs for Perfect, Imperfect, and Unknown File Popularity Distributions in Large-Scale Multi-Tier Wireless Networks , 2019, IEEE Transactions on Communications.

[5]  Duc Minh Nguyen,et al.  Deep learning sparse ternary projections for compressed sensing of images , 2017, 2017 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[6]  Erik G. Larsson,et al.  Grant-Free Massive MTC-Enabled Massive MIMO: A Compressive Sensing Approach , 2018, IEEE Transactions on Communications.

[7]  Michael Zibulevsky,et al.  Block-based compressed sensing of images via deep learning , 2017, 2017 IEEE 19th International Workshop on Multimedia Signal Processing (MMSP).

[8]  Michael I. Jordan,et al.  Union support recovery in high-dimensional multivariate regression , 2008, 2008 46th Annual Allerton Conference on Communication, Control, and Computing.

[9]  Feng Yang,et al.  Analysis and Optimization of Successful Symbol Transmission Rate for Grant-free Massive Access With Massive MIMO , 2019, IEEE Communications Letters.

[10]  Katya Scheinberg,et al.  Noname manuscript No. (will be inserted by the editor) Efficient Block-coordinate Descent Algorithms for the Group Lasso , 2022 .

[11]  Wei Yu,et al.  Sparse Activity Detection for Massive Connectivity , 2018, IEEE Transactions on Signal Processing.

[12]  Wei Yu,et al.  Sparse Signal Processing for Grant-Free Massive Connectivity: A Future Paradigm for Random Access Protocols in the Internet of Things , 2018, IEEE Signal Processing Magazine.

[13]  Wuzhen Shi,et al.  Deep networks for compressed image sensing , 2017, 2017 IEEE International Conference on Multimedia and Expo (ICME).

[14]  Giuseppe Caire,et al.  Improved Scaling Law for Activity Detection in Massive MIMO Systems , 2018, 2018 IEEE International Symposium on Information Theory (ISIT).

[15]  Shi Jin,et al.  Deep Learning for Massive MIMO CSI Feedback , 2017, IEEE Wireless Communications Letters.

[16]  Afshin Rostamizadeh,et al.  Learning a Compressed Sensing Measurement Matrix via Gradient Unrolling , 2018, ICML.

[17]  Wei Yu,et al.  Massive Connectivity With Massive MIMO—Part I: Device Activity Detection and Channel Estimation , 2017, IEEE Transactions on Signal Processing.

[18]  Piya Pal,et al.  On Fundamental Limits of Joint Sparse Support Recovery Using Certain Correlation Priors , 2018, IEEE Transactions on Signal Processing.

[19]  Hui Feng,et al.  A Deep Learning Framework of Quantized Compressed Sensing for Wireless Neural Recording , 2016, IEEE Access.