An AMP-Based Low Complexity Generalized Sparse Bayesian Learning Algorithm

In this paper, an approximate message passing-based generalized sparse Bayesian learning (AMP-Gr-SBL) algorithm is proposed to reduce the computation complexity of the Gr-SBL algorithm, meanwhile improving the robustness of the GAMP algorithm against the measurement matrix deviated from the independent and identically distributed Gaussian matrix for the generalized linear model (GLM). According to expectation propagation, the original GLM is iteratively decoupled into two sub-modules: the standard linear model (SLM) module and the minimum mean-square-error module. For the SLM module, we apply the SBL algorithm, where the expectation step is replaced by the AMP algorithm to reduce the computation complexity significantly. The numerical results demonstrate the effectiveness of the proposed AMP-Gr-SBL algorithm.

[1]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[2]  Tom Minka,et al.  A family of algorithms for approximate Bayesian inference , 2001 .

[3]  Sundeep Rangan,et al.  Generalized approximate message passing for estimation with random linear mixing , 2010, 2011 IEEE International Symposium on Information Theory Proceedings.

[4]  Rangan Sundeep,et al.  Vector approximate message passing for the generalized linear model , 2016 .

[5]  Bhaskar D. Rao,et al.  A GAMP-Based Low Complexity Sparse Bayesian Learning Algorithm , 2017, IEEE Transactions on Signal Processing.

[6]  Paul A. Wilford,et al.  Lensless imaging by compressive sensing , 2013, 2013 IEEE International Conference on Image Processing.

[7]  Bhaskar D. Rao,et al.  An Empirical Bayesian Strategy for Solving the Simultaneous Sparse Approximation Problem , 2007, IEEE Transactions on Signal Processing.

[8]  Florent Krzakala,et al.  Swept Approximate Message Passing for Sparse Estimation , 2015, ICML.

[9]  Mike E. Davies,et al.  Iterative Hard Thresholding and L0 Regularisation , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[10]  Shi Jin,et al.  Concise Derivation for Generalized Approximate Message Passing Using Expectation Propagation , 2018, IEEE Signal Processing Letters.

[11]  Xiaohu You,et al.  Generalized turbo signal recovery for nonlinear measurements and orthogonal sensing matrices , 2015, 2016 IEEE International Symposium on Information Theory (ISIT).

[12]  Shi Jin,et al.  Generalized expectation consistent signal recovery for nonlinear measurements , 2017, 2017 IEEE International Symposium on Information Theory (ISIT).

[13]  Yimin D. Zhang,et al.  Image Reconstruction in Electrical Impedance Tomography Based on Structure-Aware Sparse Bayesian Learning , 2018, IEEE Transactions on Medical Imaging.

[14]  Manfred Opper,et al.  Expectation Propagation for Approximate Inference: Free Probability Framework , 2018, 2018 IEEE International Symposium on Information Theory (ISIT).

[15]  Jiabin Jia,et al.  Image reconstruction algorithm for electrical impedance tomography based on block sparse Bayesian learning , 2017, 2017 IEEE International Conference on Imaging Systems and Techniques (IST).

[16]  Li Ping,et al.  Orthogonal AMP , 2016, IEEE Access.

[17]  Sheng Wu,et al.  A Unified Bayesian Inference Framework for Generalized Linear Models , 2017, IEEE Signal Processing Letters.

[18]  Ole Winther,et al.  Expectation Consistent Approximate Inference , 2005, J. Mach. Learn. Res..

[19]  Sundeep Rangan,et al.  Vector Approximate Message Passing , 2019, IEEE Transactions on Information Theory.

[20]  Philip Schniter,et al.  Compressive Imaging Using Approximate Message Passing and a Markov-Tree Prior , 2010, IEEE Transactions on Signal Processing.

[21]  Jianhua Lu,et al.  Concise Derivation of Complex Bayesian Approximate Message Passing via Expectation Propagation , 2015, ArXiv.

[22]  R. Tibshirani.  Regression Shrinkage and Selection via the Lasso , 1996 .

[23]  Philip Schniter,et al.  Dynamic Compressive Sensing of Time-Varying Signals Via Approximate Message Passing , 2012, IEEE Transactions on Signal Processing.

[24]  Ran Tao,et al.  Structure-Aware Bayesian Compressive Sensing for Frequency-Hopping Spectrum Estimation With Missing Observations , 2016, IEEE Transactions on Signal Processing.

[25]  Xiangming Meng,et al.  A Generalized Sparse Bayesian Learning Algorithm for 1-bit DOA Estimation , 2018, IEEE Communications Letters.

[26]  Mohammad Hamed Firooz,et al.  Network Tomography via Compressed Sensing , 2010, 2010 IEEE Global Telecommunications Conference GLOBECOM 2010.

[27]  M. Lustig,et al.  Compressed Sensing MRI , 2008, IEEE Signal Processing Magazine.

[28]  Sundeep Rangan,et al.  THE GENERALIZED APPROXIMATE MESSAGE PASSING ALGORITHM , 2015 .

[29]  Andrea Montanari,et al.  Message-passing algorithms for compressed sensing , 2009, Proceedings of the National Academy of Sciences.

[30]  Bhaskar D. Rao,et al.  Sparse Bayesian learning for basis selection , 2004, IEEE Transactions on Signal Processing.

[31]  Philip Schniter,et al.  Efficient High-Dimensional Inference in the Multiple Measurement Vector Problem , 2011, IEEE Transactions on Signal Processing.

[32]  Jianhua Lu,et al.  Low-Complexity Iterative Detection for Large-Scale Multiuser MIMO-OFDM Systems Using Approximate Message Passing , 2014, IEEE Journal of Selected Topics in Signal Processing.

[33]  Jianhua Lu,et al.  An Expectation Propagation Perspective on Approximate Message Passing , 2015, IEEE Signal Processing Letters.

[34]  Jiangtao Xi,et al.  Approximate Message Passing with Unitary Transformation , 2015, ArXiv.

[35]  I. Daubechies,et al.  An iterative thresholding algorithm for linear inverse problems with a sparsity constraint , 2003, math/0307152.

[36]  Robert W. Heath,et al.  Capacity Analysis of One-Bit Quantized MIMO Systems With Transmitter Channel State Information , 2014, IEEE Transactions on Signal Processing.

[37]  George Eastman House,et al.  Sparse Bayesian Learning and the Relevan e Ve tor Ma hine , 2001 .

[38]  Andrea Montanari,et al.  Message passing algorithms for compressed sensing: I. motivation and construction , 2009, 2010 IEEE Information Theory Workshop on Information Theory (ITW 2010, Cairo).

[39]  Kaare Brandt Petersen,et al.  The Matrix Cookbook , 2006 .