The reweighed greedy analysis pursuit algorithm for the cosparse analysis model

Recently, a cosparse analysis model has been introduced as an interesting alternative to the sparse representation synthesis model. This model is focused on zero elements in the analysis representation vector rather than non-zero elements. Hence, finding cosparse solutions is a problem of important significance in signal processing. In this paper, we construct an adaptive weighted matrix in the greedy analysis pursuit algorithm and propose the reweighed greedy analysis pursuit (ReGAP) algorithm for cosparse signal reconstruction with noise. Using a weighted matrix, we fill the gap between greedy and convex relaxation techniques. Theoretical analysis shows that our algorithm is convergent. We estimate the error bound of ReGAP algorithm with cosparse analysis model, and then simulation results demonstrate that our algorithm is feasible and effective.

[1]  Michael Elad,et al.  Cosparse analysis modeling - uniqueness and algorithms , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[2]  Y. C. Pati,et al.  Orthogonal matching pursuit: recursive function approximation with applications to wavelet decomposition , 1993, Proceedings of 27th Asilomar Conference on Signals, Systems and Computers.

[3]  Mário A. T. Figueiredo,et al.  Signal restoration with overcomplete wavelet transforms: comparison of analysis and synthesis priors , 2009, Optical Engineering + Applications.

[4]  Michael Elad,et al.  Optimally sparse representation in general (nonorthogonal) dictionaries via ℓ1 minimization , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[5]  Jian-Feng Cai,et al.  Split Bregman Methods and Frame Based Image Restoration , 2009, Multiscale Model. Simul..

[6]  Michael Elad,et al.  Analysis versus synthesis in signal priors , 2006, 2006 14th European Signal Processing Conference.

[7]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[8]  Deanna Needell,et al.  Greedy signal recovery and uncertainty principles , 2008, Electronic Imaging.

[9]  Stephen P. Boyd,et al.  Disciplined Convex Programming , 2006 .

[10]  Michael Elad,et al.  The Cosparse Analysis Model and Algorithms , 2011, ArXiv.

[11]  Yonina C. Eldar,et al.  Compressed Sensing with Coherent and Redundant Dictionaries , 2010, ArXiv.

[12]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[13]  M. Davies,et al.  Greedy-like algorithms for the cosparse analysis model , 2012, 1207.2456.

[14]  S. Mallat A wavelet tour of signal processing , 1998 .

[15]  Bhaskar D. Rao,et al.  Sparse signal reconstruction from limited data using FOCUSS: a re-weighted minimum norm algorithm , 1997, IEEE Trans. Signal Process..

[16]  Michael Elad,et al.  Recovery of cosparse signals with Greedy Analysis Pursuit in the presence of noise , 2011, 2011 4th IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP).

[17]  Michael Elad,et al.  From Sparse Solutions of Systems of Equations to Sparse Modeling of Signals and Images , 2009, SIAM Rev..

[18]  Michael Elad,et al.  Sparse and Redundant Representations - From Theory to Applications in Signal and Image Processing , 2010 .

[19]  Mohamed-Jalal Fadili,et al.  Robust Sparse Analysis Regularization , 2011, IEEE Transactions on Information Theory.