Joint Design of Measurement Matrix and Sparse Support Recovery Method via Deep Auto-Encoder

Sparse support recovery arises in many applications in communications and signal processing. Existing methods tackle sparse support recovery problems for a given measurement matrix, and cannot flexibly exploit the properties of sparsity patterns for improving performance. In this letter, we propose a data-driven approach to jointly design the measurement matrix and support recovery method for complex sparse signals, using auto-encoder in deep learning. The proposed architecture includes two components, an auto-encoder and a hard thresholding module. The proposed auto-encoder successfully handles complex signals using standard auto-encoder for real numbers. The proposed approach can effectively exploit properties of sparsity patterns, and is especially useful when these underlying properties do not have analytic models. In addition, the proposed approach can achieve sparse support recovery with low computational complexity. Experiments are conducted on an application example, device activity detection in grant-free massive access for massive machine type communications (mMTC). Numerical results show that the proposed approach achieves significantly better performance with much less computation time than classic methods, in the presence of extra structures in sparsity patterns.

[1]  Afshin Rostamizadeh,et al.  Learning a Compressed Sensing Measurement Matrix via Gradient Unrolling , 2018, ICML.

[2]  Tarek F. Abdelzaher,et al.  DeepIoT: Compressing Deep Neural Network Structures for Sensing Systems with a Compressor-Critic Framework , 2017, SenSys.

[3]  P. P. Vaidyanathan,et al.  Pushing the Limits of Sparse Support Recovery Using Correlation Information , 2015, IEEE Transactions on Signal Processing.

[4]  M. Yuan,et al.  Model selection and estimation in regression with grouped variables , 2006 .

[5]  Richard G. Baraniuk,et al.  A Data-Driven and Distributed Approach to Sparse Signal Representation and Recovery , 2019, ICLR.

[6]  Wei Yu,et al.  Sparse Activity Detection for Massive Connectivity , 2018, IEEE Transactions on Signal Processing.

[7]  Wei Yu,et al.  Massive Connectivity With Massive MIMO—Part I: Device Activity Detection and Channel Estimation , 2017, IEEE Transactions on Signal Processing.

[8]  Sundeep Rangan,et al.  Necessary and Sufficient Conditions for Sparsity Pattern Recovery , 2008, IEEE Transactions on Information Theory.

[9]  Timothy Lillicrap,et al.  Deep Compressed Sensing , 2019, ICML.

[10]  Ali Mousavi,et al.  Learning to invert: Signal recovery via Deep Convolutional Networks , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[11]  Yoram Bresler,et al.  Subspace Methods for Joint Sparse Recovery , 2010, IEEE Transactions on Information Theory.

[12]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[13]  Shi Jin,et al.  Deep Learning for Massive MIMO CSI Feedback , 2017, IEEE Wireless Communications Letters.

[14]  Martin J. Wainwright,et al.  Information-Theoretic Limits on Sparsity Recovery in the High-Dimensional and Noisy Setting , 2007, IEEE Transactions on Information Theory.

[15]  Noah Simon,et al.  A Sparse-Group Lasso , 2013 .

[16]  Duc Minh Nguyen,et al.  Deep learning sparse ternary projections for compressed sensing of images , 2017, 2017 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[17]  Ahmed Alkhateeb,et al.  Enabling Large Intelligent Surfaces With Compressive Sensing and Deep Learning , 2019, IEEE Access.

[18]  Sundeep Rangan,et al.  A sparsity detection framework for on-off random access channels , 2009, 2009 IEEE International Symposium on Information Theory.

[19]  Yann LeCun,et al.  Learning Fast Approximations of Sparse Coding , 2010, ICML.

[20]  Martin J. Wainwright,et al.  Sharp Thresholds for High-Dimensional and Noisy Sparsity Recovery Using $\ell _{1}$ -Constrained Quadratic Programming (Lasso) , 2009, IEEE Transactions on Information Theory.

[21]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[22]  Richard G. Baraniuk,et al.  DeepCodec: Adaptive sensing and recovery via deep convolutional neural networks , 2017, 2017 55th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[23]  Hui Feng,et al.  A Deep Learning Framework of Quantized Compressed Sensing for Wireless Neural Recording , 2016, IEEE Access.