Sparse Signal Reconstruction With Statistical Prior Information: A Data-Driven Method

Weighted $\ell _{1}$ minimization (WL1M) is a general and powerful framework for reconstructing sparse signals from underdetermined measurements. The performance improvement of WL1M owes to the incorporation of additional structural priors of signals by means of its weights. However, the selection of weights relies on hand-crafted designs in existing works, so that high-order structural priors of signals are hard to be captured. This paper proposes a data-driven method, namely RBM-WL1M, to alleviate this situation. In the RBM-WL1M, restricted Boltzmann machines (RBMs) are employed to learn the prior distribution of the signals from training data; furthermore, utilizing the RBM, high frequency support set and non-zero probabilities for each of the entries in signals can be estimated effectively, which are used to appropriately select the weights. In our experiments, the proposed framework demonstrates superior performance over several state-of-the-art CS methods on the Physikalisch-Technische Bundesanstalt(PTB) Diagnostic ECG Data set.

[1]  Max Welling,et al.  Product of experts , 2007, Scholarpedia.

[2]  Kenneth E. Barner,et al.  Exploiting Restricted Boltzmann Machines and Deep Belief Networks in Compressed Sensing , 2017, IEEE Transactions on Signal Processing.

[3]  Lei Zhang,et al.  Nonlocally Centralized Sparse Representation for Image Restoration , 2013, IEEE Transactions on Image Processing.

[4]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[5]  Stephen P. Boyd,et al.  Enhancing Sparsity by Reweighted ℓ1 Minimization , 2007, 0711.1612.

[6]  Wei Wu,et al.  STRAPS: A Fully Data-Driven Spatio-Temporally Regularized Algorithm for M/EEG Patch Source Imaging , 2015, Int. J. Neural Syst..

[7]  Ralf Bousseljot,et al.  Nutzung der EKG-Signaldatenbank CARDIODAT der PTB über das Internet , 2009 .

[8]  Richard G. Baraniuk,et al.  A deep learning approach to structured signal recovery , 2015, 2015 53rd Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[9]  Geoffrey E. Hinton A Practical Guide to Training Restricted Boltzmann Machines , 2012, Neural Networks: Tricks of the Trade.

[10]  Tzyy-Ping Jung,et al.  Compressed Sensing of EEG for Wireless Telemonitoring With Low Energy Consumption and Inexpensive Hardware , 2012, IEEE Transactions on Biomedical Engineering.

[11]  Luisa F. Polanía,et al.  Compressed sensing ECG using restricted Boltzmann machines , 2018, Biomed. Signal Process. Control..

[12]  Geoffrey E. Hinton Training Products of Experts by Minimizing Contrastive Divergence , 2002, Neural Computation.

[13]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[14]  John Odentrantz,et al.  Markov Chains: Gibbs Fields, Monte Carlo Simulation, and Queues , 2000, Technometrics.

[15]  Arnon D. Cohen,et al.  The weighted diagnostic distortion (WDD) measure for ECG signal compression , 2000, IEEE Transactions on Biomedical Engineering.

[16]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[17]  Namrata Vaswani,et al.  Modified-CS: Modifying compressive sensing for problems with partially known support , 2009, ISIT.

[18]  Emmanuel J. Candès,et al.  Decoding by linear programming , 2005, IEEE Transactions on Information Theory.

[19]  Keqin Li,et al.  Region-Based Compressive Networked Storage with Lazy Encoding , 2019, IEEE Transactions on Parallel and Distributed Systems.

[20]  Wei Wu,et al.  Multimodal BCIs: Target Detection, Multidimensional Control, and Awareness Evaluation in Patients With Disorder of Consciousness , 2016, Proceedings of the IEEE.

[21]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[22]  Hui Feng,et al.  Efficient Compressed Sensing for Wireless Neural Recording: A Deep Learning Approach , 2017, IEEE Signal Processing Letters.

[23]  Urbashi Mitra,et al.  Support Recovery From Noisy Random Measurements via Weighted $\ell _1$ Minimization , 2018, IEEE Transactions on Signal Processing.

[24]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[25]  Urbashi Mitra,et al.  Support recovery from noisy random measurements via weighted ℓ1 minimization , 2016, 2016 IEEE International Symposium on Information Theory (ISIT).

[26]  Jun Zhang,et al.  Compressive Sensing for Joint User Activity and Data Detection in Grant-Free NOMA , 2019, IEEE Wireless Communications Letters.

[27]  Wotao Yin,et al.  Sparse Signal Reconstruction via Iterative Support Detection , 2009, SIAM J. Imaging Sci..

[28]  Christian Igel,et al.  An Introduction to Restricted Boltzmann Machines , 2012, CIARP.

[29]  Yonina C. Eldar,et al.  Exploiting Statistical Dependencies in Sparse Representations for Signal Recovery , 2010, IEEE Transactions on Signal Processing.