Quantized Compressed Sensing via Deep Neural Networks

Compressed sensing (CS) is an efficient technique to acquire sparse signals in many wireless applications to, e.g., reduce the amount of data and save low-power sensors' batteries. This paper addresses efficient acquisition of sparse sources through quantized noisy compressive measurements where the encoder and decoder are realized by deep neural networks (DNNs). We devise a DNN based quantized compressed sensing (QCS) method aiming at minimizing the mean-square error of the signal reconstruction. Once trained offline, the proposed method enjoys extremely fast and low complexity decoding in the online communication phase. Simulation results demonstrate the superior rate-distortion performance of the proposed method compared to a polynomial-complexity QCS reconstruction scheme.

[1]  Hui Feng,et al.  A Deep Learning Framework of Quantized Compressed Sensing for Wireless Neural Recording , 2016, IEEE Access.

[2]  Mikael Skoglund,et al.  Joint Source-Channel Vector Quantization for Compressed Sensing , 2014, IEEE Transactions on Signal Processing.

[3]  Richard G. Baraniuk,et al.  A deep learning approach to structured signal recovery , 2015, 2015 53rd Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[4]  R.G. Baraniuk,et al.  Universal distributed sensing via random projections , 2006, 2006 5th International Conference on Information Processing in Sensor Networks.

[5]  Yonina C. Eldar,et al.  Deep Task-Based Quantization † , 2019, Entropy.

[6]  Vivek K. Goyal,et al.  Optimal quantization of random measurements in compressed sensing , 2009, 2009 IEEE International Symposium on Information Theory.

[7]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[8]  Marian Codreanu,et al.  Distributed Distortion-Rate Optimized Compressed Sensing in Wireless Sensor Networks , 2018, IEEE Transactions on Communications.

[9]  Marian Codreanu,et al.  Rate-Distortion Performance of Lossy Compressed Sensing of Sparse Sources , 2018, IEEE Transactions on Communications.

[10]  Marian Codreanu,et al.  Compressed Sensing with Applications in Wireless Networks , 2019, Found. Trends Signal Process..

[11]  Georgios B. Giannakis,et al.  Distributed Spectrum Sensing for Cognitive Radio Networks by Exploiting Sparsity , 2010, IEEE Transactions on Signal Processing.

[12]  Dmitry M. Malioutov,et al.  A sparse signal reconstruction perspective for source localization with sensor arrays , 2005, IEEE Transactions on Signal Processing.

[13]  Marian Codreanu,et al.  Practical Compression Methods for Quantized Compressed Sensing , 2019, IEEE INFOCOM 2019 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[14]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[15]  Michele Zorzi,et al.  Sensing, Compression, and Recovery for WSNs: Sparse Signal Modeling and Monitoring Framework , 2012, IEEE Transactions on Wireless Communications.

[16]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[17]  Yonina C. Eldar,et al.  Hardware-Limited Task-Based Quantization , 2018, 2019 IEEE 20th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC).

[18]  Stephen P. Boyd,et al.  Compressed Sensing With Quantized Measurements , 2010, IEEE Signal Processing Letters.

[19]  V.K. Goyal,et al.  Compressive Sampling and Lossy Compression , 2008, IEEE Signal Processing Magazine.

[20]  Richard G. Baraniuk,et al.  1-Bit compressive sensing , 2008, 2008 42nd Annual Conference on Information Sciences and Systems.

[21]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[22]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..