A Framework for Clustered and Skewed Sparse Signal Recovery

A novel framework, clustered-skew normal mixture-belief propagation, is developed to solve the reconstruction of undersampled clustered signals, where the magnitudes of signal coefficients in each cluster are distributed asymmetrically w.r.t the cluster mean. To address the skewness feature, a finite skew-normal density mixture is utilized to model the prior distribution, where the marginal posterior of the signal is inferred by an efficient approximate message-passing-based algorithm. An expectation-maximization-based algorithm is developed to estimate the mixture density. The clustered property is then modeled by the Potts model, and a loopy belief propagation algorithm is designed to promote the spatial feature. Experimental results show that our technique is highly effective and efficient in exploiting both the clustered feature and asymmetrical feature of the signals and outperforms many sophisticated techniques.

[1]  Hong Sun,et al.  Bayesian compressive sensing for cluster structured sparse signals , 2012, Signal Process..

[2]  E. Candès.  The restricted isometry property and its implications for compressed sensing , 2008 .

[3]  Nazanin Rahnavard,et al.  CStorage: Distributed Data Storage in Wireless Sensor Networks Employing Compressive Sensing , 2011, 2011 IEEE Global Telecommunications Conference - GLOBECOM 2011.

[4]  William T. Freeman,et al.  Comparison of graph cuts with belief propagation for stereo, using identical MRF parameters , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[5]  Radford M. Neal.  Pattern Recognition and Machine Learning , 2007, Technometrics.

[6]  E.J. Candes.  Compressive Sampling , 2022 .

[7]  Lawrence Carin,et al.  Bayesian Compressive Sensing , 2008, IEEE Transactions on Signal Processing.

[8]  Junzhou Huang,et al.  Learning with structured sparsity , 2009, ICML '09.

[9]  Bhaskar D. Rao,et al.  Extension of SBL Algorithms for the Recovery of Block Sparse Signals With Intra-Block Correlation , 2012, IEEE Transactions on Signal Processing.

[10]  Nazanin Rahnavard,et al.  BCS: Compressive sensing for binary sparse signals , 2012, MILCOM 2012 - 2012 IEEE Military Communications Conference.

[11]  David L. Donoho,et al.  Observed universality of phase transitions in high-dimensional geometry, with implications for modern data analysis and signal processing , 2009, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[12]  Lei Zhang,et al.  Low-Dose X-ray CT Reconstruction via Dictionary Learning , 2012, IEEE Transactions on Medical Imaging.

[13]  Stephen P. Boyd,et al.  Convex piecewise-linear fitting , 2009 .

[14]  Nazanin Rahnavard,et al.  CCS: Energy-efficient data collection in clustered wireless sensor networks utilizing block-wise compressive sensing , 2016, Comput. Networks.

[15]  Singiresu S. Rao.  Engineering Optimization : Theory and Practice , 2010 .

[16]  Philip Schniter,et al.  Compressive Imaging Using Approximate Message Passing and a Markov-Tree Prior , 2010, IEEE Transactions on Signal Processing.

[17]  Zongxu Pan,et al.  Super-Resolution Based on Compressive Sensing and Structural Self-Similarity for Remote Sensing Images , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Sheng Wang,et al.  SRL1: Structured reweighted ℓ1 minimization for compressive sampling of videos , 2013, 2013 IEEE International Symposium on Information Theory.

[19]  Robert T. Collins,et al.  Belief Propagation in a 3D Spatio-temporal MRF for Moving Object Detection , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Richard G. Baraniuk,et al.  Compressive Sensing , 2008, Computer Vision, A Reference Guide.

[21]  R. B. Potts.  Some generalized order-disorder transformations , 1952, Mathematical Proceedings of the Cambridge Philosophical Society.

[22]  Sheng Wang,et al.  A Framework for Compressive Sensing of Asymmetric Signals Using Normal and Skew-Normal Mixture Prior , 2015, IEEE Transactions on Communications.

[23]  Sheng Wang,et al.  Binary Compressive Sensing via Sum of l1-Norm and l(infinity)-Norm Regularization , 2013, MILCOM 2013 - 2013 IEEE Military Communications Conference.

[24]  Nazanin Rahnavard,et al.  Model-Based Nonuniform Compressive Sampling and Recovery of Natural Images Utilizing a Wavelet-Domain Universal Hidden Markov Model , 2017, IEEE Transactions on Signal Processing.

[25]  M. Abramowitz,et al.  Handbook of Mathematical Functions With Formulas, Graphs and Mathematical Tables (National Bureau of Standards Applied Mathematics Series No. 55) , 1965 .

[26]  Tsung-I Lin,et al.  Finite mixture modelling using the skew normal distribution , 2007 .

[27]  Andrea Montanari,et al.  Message passing algorithms for compressed sensing: II. analysis and validation , 2009, 2010 IEEE Information Theory Workshop on Information Theory (ITW 2010, Cairo).

[28]  E. M. Opdam,et al.  The two-dimensional Ising model , 2018, From Quarks to Pions.

[29]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[30]  A. Azzalini.  A class of distributions which includes the normal ones , 1985 .

[31]  Bhaskar D. Rao,et al.  Sparse Bayesian learning for basis selection , 2004, IEEE Transactions on Signal Processing.

[32]  John P. Mills.  TABLE OF THE RATIO: AREA TO BOUNDING ORDINATE, FOR ANY PORTION OF NORMAL CURVE , 1926 .

[33]  Jun Fang,et al.  Two-Dimensional Pattern-Coupled Sparse Bayesian Learning via Generalized Approximate Message Passing , 2015, IEEE Transactions on Image Processing.

[34]  Philip Schniter,et al.  An Empirical-Bayes Approach to Recovering Linearly Constrained Non-Negative Sparse Signals , 2014, IEEE Trans. Signal Process..

[35]  Volkan Cevher,et al.  Sparse Signal Recovery Using Markov Random Fields , 2008, NIPS.

[36]  Michael P. Friedlander,et al.  Probing the Pareto Frontier for Basis Pursuit Solutions , 2008, SIAM J. Sci. Comput..

[37]  Yonina C. Eldar,et al.  Exploiting Statistical Dependencies in Sparse Representations for Signal Recovery , 2010, IEEE Transactions on Signal Processing.

[38]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[39]  Tareq Y. Al-Naffouri,et al.  Compressive sensing for feedback reduction in MIMO broadcast channels , 2009, 2010 17th International Conference on Telecommunications.

[40]  Milton Abramowitz,et al.  Handbook of Mathematical Functions with Formulas, Graphs, and Mathematical Tables , 1964 .

[41]  C. Bocci,et al.  Hadamard Products of Linear Spaces , 2015, 1504.04301.

[42]  William T. Freeman,et al.  Understanding belief propagation and its generalizations , 2003 .

[43]  A. Ravi Kumar,et al.  Compressed-Sensing-Enabled Video Streaming for Wireless Multimedia Sensor Networks , 2014 .

[44]  Xiao-Li Meng,et al.  Maximum likelihood estimation via the ECM algorithm: A general framework , 1993 .

[45]  Andrea Montanari,et al.  Message passing algorithms for compressed sensing: I. motivation and construction , 2009, 2010 IEEE Information Theory Workshop on Information Theory (ITW 2010, Cairo).