Expectation-Maximization-Aided Hybrid Generalized Expectation Consistent for Sparse Signal Reconstruction

The reconstruction of sparse signal is an active area of research. Different from a typical i.i.d. assumption, this paper considers a non-independent prior of group structure. For this more practical setup, we propose EM-aided HyGEC, a new algorithm to address the stability issue and the hyper-parameter issue facing the other algorithms. The instability problem results from the ill condition of the transform matrix, while the unavailability of the hyper-parameters is a ground truth that their values are not known beforehand. The proposed algorithm is built on the paradigm of HyGAMP (proposed by Rangan et al.) but we replace its inner engine, the GAMP, by a matrix-insensitive alternative, the GEC, so that the first issue is solved. For the second issue, we take expectation-maximization as an outer loop, and together with the inner engine HyGEC, we learn the value of the hyper-parameters. Effectiveness of the proposed algorithm is also verified by means of numerical simulations.

[1]  Sundeep Rangan,et al.  Plug in estimation in high dimensional linear inverse problems a rigorous analysis , 2018, NeurIPS.

[2]  Shi Jin,et al.  Concise Derivation for Generalized Approximate Message Passing Using Expectation Propagation , 2018, IEEE Signal Processing Letters.

[3]  Steven Kay,et al.  Fundamentals Of Statistical Signal Processing , 2001 .

[4]  George Eastman House,et al.  Sparse Bayesian Learning and the Relevan e Ve tor Ma hine , 2001 .

[5]  Wei Yu,et al.  Massive Connectivity With Massive MIMO—Part I: Device Activity Detection and Channel Estimation , 2017, IEEE Transactions on Signal Processing.

[6]  Ole Winther,et al.  Expectation Consistent Approximate Inference , 2005, J. Mach. Learn. Res..

[7]  Sundeep Rangan,et al.  Expectation consistent approximate inference: Generalizations and convergence , 2016, 2016 IEEE International Symposium on Information Theory (ISIT).

[8]  Li Ping,et al.  Orthogonal AMP , 2016, IEEE Access.

[9]  Sundeep Rangan,et al.  Vector approximate message passing , 2017, 2017 IEEE International Symposium on Information Theory (ISIT).

[10]  Hongwen Yang,et al.  Message Passing Based Joint Channel and User Activity Estimation for Uplink Grant-Free Massive MIMO Systems With Low-Precision ADCs , 2020, IEEE Signal Processing Letters.

[11]  Brendan J. Frey,et al.  Factor graphs and the sum-product algorithm , 2001, IEEE Trans. Inf. Theory.

[12]  Philip Schniter,et al.  Turbo reconstruction of structured sparse signals , 2010, 2010 44th Annual Conference on Information Sciences and Systems (CISS).

[13]  Philip Schniter,et al.  Learning and free energies for vector approximate message passing , 2016, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[14]  Richard G. Baraniuk,et al.  An Expectation-Maximization Approach to Tuning Generalized Vector Approximate Message Passing , 2018, LVA/ICA.

[15]  Tom Minka,et al.  A family of algorithms for approximate Bayesian inference , 2001 .

[16]  Sundeep Rangan,et al.  Rigorous Dynamics and Consistent Estimation in Arbitrarily Conditioned Linear Systems , 2017, NIPS.

[17]  Jianhua Lu,et al.  An Expectation Propagation Perspective on Approximate Message Passing , 2015, IEEE Signal Processing Letters.

[18]  Philip Schniter,et al.  Compressive Imaging Using Approximate Message Passing and a Markov-Tree Prior , 2010, IEEE Transactions on Signal Processing.

[19]  Shi Jin,et al.  Bayes-Optimal Joint Channel-and-Data Estimation for Massive MIMO With Low-Precision ADCs , 2015, IEEE Transactions on Signal Processing.

[20]  Andrea Montanari,et al.  Message passing algorithms for compressed sensing: I. motivation and construction , 2009, 2010 IEEE Information Theory Workshop on Information Theory (ITW 2010, Cairo).

[21]  Shi Jin,et al.  Generalized expectation consistent signal recovery for nonlinear measurements , 2017, 2017 IEEE International Symposium on Information Theory (ISIT).

[22]  Philip Schniter,et al.  Expectation-Maximization Gaussian-Mixture Approximate Message Passing , 2012, IEEE Transactions on Signal Processing.

[23]  Sundeep Rangan,et al.  Hybrid Approximate Message Passing , 2011, IEEE Transactions on Signal Processing.

[24]  Y. C. Pati,et al.  Orthogonal matching pursuit: recursive function approximation with applications to wavelet decomposition , 1993, Proceedings of 27th Asilomar Conference on Signals, Systems and Computers.

[25]  Hongwen Yang,et al.  A Low-Complexity Joint User Activity, Channel and Data Estimation for Grant-Free Massive MIMO Systems , 2020, IEEE Signal Processing Letters.