Concise Derivation of Complex Bayesian Approximate Message Passing via Expectation Propagation

In this paper, we address the problem of recovering complex-valued signals from a set of complex-valued linear measurements. Approximate message passing (AMP) is one state-of-the-art algorithm to recover real-valued sparse signals. However, the extension of AMP to complex-valued case is nontrivial and no detailed and rigorous derivation has been explicitly presented. To fill this gap, we extend AMP to complex Bayesian approximate message passing (CB-AMP) using expectation propagation (EP). This novel perspective leads to a concise derivation of CB-AMP without sophisticated transformations between the complex domain and the real domain. In addition, we have derived state evolution equations to predict the reconstruction performance of CB-AMP. Simulation results are presented to demonstrate the efficiency of CB-AMP and state evolution.

[1]  Jianhua Lu,et al.  An Expectation Propagation Perspective on Approximate Message Passing , 2015, IEEE Signal Processing Letters.

[2]  Sundeep Rangan,et al.  Generalized approximate message passing for estimation with random linear mixing , 2010, 2011 IEEE International Symposium on Information Theory Proceedings.

[3]  Philip Schniter,et al.  Compressive Imaging Using Approximate Message Passing and a Markov-Tree Prior , 2010, IEEE Transactions on Signal Processing.

[4]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[5]  Richard G. Baraniuk,et al.  Asymptotic Analysis of Complex LASSO via Complex Approximate Message Passing (CAMP) , 2011, IEEE Transactions on Information Theory.

[6]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[7]  Florent Krzakala,et al.  Approximate message-passing with spatially coupled structured operators, with applications to compressed sensing and sparse superposition codes , 2013, 1312.1740.

[8]  Michael Unser,et al.  Approximate Message Passing With Consistent Parameter Estimation and Applications to Sparse Learning , 2012, IEEE Transactions on Information Theory.

[9]  X. Jin.  Factor graphs and the Sum-Product Algorithm , 2002 .

[10]  Andrea Montanari,et al.  Message passing algorithms for compressed sensing: I. motivation and construction , 2009, 2010 IEEE Information Theory Workshop on Information Theory (ITW 2010, Cairo).

[11]  Gitta Kutyniok,et al.  1 . 2 Sparsity : A Reasonable Assumption ? , 2012 .

[12]  Michael B. Wakin,et al.  An Introduction To Compressive Sampling [A sensing/sampling paradigm that goes against the common knowledge in data acquisition] , 2008 .

[13]  Michael I. Jordan,et al.  Graphical Models, Exponential Families, and Variational Inference , 2008, Found. Trends Mach. Learn..

[14]  M. T. Vlaardingerbroek,et al.  Magnetic Resonance Imaging: Theory and Practice , 1996 .

[15]  Thomas P. Minka,et al.  Divergence measures and message passing , 2005 .

[16]  Andrea Montanari,et al.  Message-passing algorithms for compressed sensing , 2009, Proceedings of the National Academy of Sciences.

[17]  Florent Krzakala,et al.  Probabilistic reconstruction in compressed sensing: algorithms, phase diagrams, and threshold achieving matrices , 2012, ArXiv.

[18]  Cishen Zhang,et al.  On Phase Transition of Compressed Sensing in the Complex Domain , 2011, IEEE Signal Processing Letters.

[19]  A. Hasman,et al.  Probabilistic reasoning in intelligent systems: Networks of plausible inference , 1991 .

[20]  Philip Schniter,et al.  A Message-Passing Receiver for BICM-OFDM Over Unknown Clustered-Sparse Channels , 2011, IEEE Journal of Selected Topics in Signal Processing.

[21]  Philip Schniter.  A message-passing receiver for BICM-OFDM over unknown clustered-sparse channels , 2011, SPAWC 2011.

[22]  E.J. Candes,et al.  An Introduction To Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[23]  I JordanMichael,et al.  Graphical Models, Exponential Families, and Variational Inference , 2008 .

[24]  R. Baraniuk,et al.  Compressive Radar Imaging , 2007, 2007 IEEE Radar Conference.

[25]  Brendan J. Frey,et al.  Factor graphs and the sum-product algorithm , 2001, IEEE Trans. Inf. Theory.

[26]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[27]  Tom Minka,et al.  A family of algorithms for approximate Bayesian inference , 2001 .