Robust Sparse Recovery in Impulsive Noise via $\ell _p$ -$\ell _1$ Optimization

This paper addresses the issue of robust sparse recovery in compressive sensing (CS) in the presence of impulsive measurement noise. Recently, robust data-fitting models, such as ℓ1-norm, Lorentzian-norm, and Huber penalty function, have been employed to replace the popular ℓ2-norm loss model to gain more robust performance. In this paper, we propose a robust formulation for sparse recovery using the generalized ℓp-norm with 0 ≤ p <; 2 as the metric for the residual error. To solve this formulation efficiently, we develop an alternating direction method (ADM) via incorporating the proximity operator of ℓp-norm functions into the framework of augmented Lagrangian methods. Furthermore, to derive a convergent method for the nonconvex case of p <; 1, a smoothing strategy has been employed. The convergence conditions of the proposed algorithm have been analyzed for both the convex and nonconvex cases. The new algorithm has been compared with some state-of-the-art robust algorithms via numerical simulations to show its improved performance in highly impulsive noise.

[1]  Qin Huang,et al.  A Robust Algorithm for Joint Sparse Recovery in Presence of Impulsive Noise , 2015, IEEE Signal Processing Letters.

[2]  Robert Schober,et al.  Lp-Norm Spectrum Sensing for Cognitive Radio Networks Impaired by Non-Gaussian Noise , 2009, GLOBECOM 2009 - 2009 IEEE Global Telecommunications Conference.

[3]  Fei Wen,et al.  Robust sparse recovery for compressive sensing in impulsive noise using ℓp-norm model fitting , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[4]  Richard G. Baraniuk,et al.  Exact signal recovery from sparsely corrupted measurements through the Pursuit of Justice , 2009, 2009 Conference Record of the Forty-Third Asilomar Conference on Signals, Systems and Computers.

[5]  Thia Kirubarajan,et al.  Minimum Dispersion Beamforming for Non-Gaussian Signals , 2014, IEEE Transactions on Signal Processing.

[6]  Yunhai Xiao,et al.  Linearized alternating directions method for ℓ1-norm inequality constrained ℓ1-norm minimization , 2014 .

[7]  S. Foucart,et al.  Sparsest solutions of underdetermined linear systems via ℓq-minimization for 0 , 2009 .

[8]  Svetha Venkatesh,et al.  Improved Image Recovery From Compressed Data Contaminated With Impulsive Noise , 2012, IEEE Transactions on Image Processing.

[9]  Nahum Kiryati,et al.  Deblurring of Color Images Corrupted by Impulsive Noise , 2007, IEEE Transactions on Image Processing.

[10]  Lawrence Carin,et al.  Bayesian Compressive Sensing , 2008, IEEE Transactions on Signal Processing.

[11]  Christoph Studer,et al.  Coherence-based recovery guarantees for generalized basis-pursuit de-quantizing , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[12]  Piotr S. Windyga,et al.  Fast impulsive noise removal , 2001, IEEE Trans. Image Process..

[13]  Patrick L. Combettes,et al.  Proximal Splitting Methods in Signal Processing , 2009, Fixed-Point Algorithms for Inverse Problems in Science and Engineering.

[14]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[15]  Yaakov Tsaig,et al.  Fast Solution of $\ell _{1}$ -Norm Minimization Problems When the Solution May Be Sparse , 2008, IEEE Transactions on Information Theory.

[16]  Peter J. Huber,et al.  Robust Statistics , 2005, Wiley Series in Probability and Statistics.

[17]  Zhi-Quan Luo,et al.  Convergence analysis of alternating direction method of multipliers for a family of nonconvex problems , 2014, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[18]  C. L. Nikias,et al.  Signal processing with alpha-stable distributions and applications , 1995 .

[19]  S. Setzer,et al.  Signal recovery from incomplete measurements in the presence of outliers , 2007 .

[20]  Abdelhak M. Zoubir,et al.  An ℓpℓp-norm minimization approach to time delay estimation in impulsive noise , 2013, Digit. Signal Process..

[21]  Thia Kirubarajan,et al.  Robust sparse channel estimation and equalization in impulsive noise using linear programming , 2013, Signal Process..

[22]  Hong Zhu,et al.  Primal and dual alternating direction algorithms for ℓ1-ℓ1-norm minimization problems in compressive sensing , 2012, Computational Optimization and Applications.

[23]  Emmanuel J. Candès,et al.  Highly Robust Error Correction byConvex Programming , 2006, IEEE Transactions on Information Theory.

[24]  Ming Yan,et al.  Restoration of Images Corrupted by Impulse Noise and Mixed Gaussian Impulse Noise using Blind Inpainting , 2013, SIAM J. Imaging Sci..

[25]  E. Candès The restricted isometry property and its implications for compressed sensing , 2008 .

[26]  Kenneth E. Barner,et al.  A Generalized Cauchy Distribution Framework for Problems Requiring Robust Behavior , 2010, EURASIP J. Adv. Signal Process..

[27]  Zongben Xu,et al.  $L_{1/2}$ Regularization: A Thresholding Representation Theory and a Fast Solver , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[28]  Guoyin Li,et al.  Global Convergence of Splitting Methods for Nonconvex Composite Optimization , 2014, SIAM J. Optim..

[29]  Richard G. Baraniuk,et al.  Stable Restoration and Separation of Approximately Sparse Signals , 2011, ArXiv.

[30]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[31]  Jian Yu,et al.  Restoration of images corrupted by mixed Gaussian-impulse noise via l1-l0 minimization , 2011, Pattern Recognit..

[32]  Zhen Yang,et al.  Bayesian Sparse Reconstruction Method of Compressed Sensing in the Presence of Impulsive Noise , 2013, Circuits, Systems, and Signal Processing.

[33]  Kenneth E. Barner,et al.  Lorentzian Iterative Hard Thresholding: Robust Compressed Sensing With Prior Information , 2013, IEEE Transactions on Signal Processing.

[34]  Chrysostomos L. Nikias,et al.  Robust adaptive beamforming in alpha-stable noise environments , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[35]  Martin Storath,et al.  An algorithmic framework for Mumford–Shah regularization of inverse problems in imaging , 2015 .

[36]  Donald Goldfarb,et al.  Second-order cone programming , 2003, Math. Program..

[37]  Raymond H. Chan,et al.  Salt-and-pepper noise removal by median-type noise detectors and detail-preserving regularization , 2005, IEEE Transactions on Image Processing.

[38]  Goran Marjanovic,et al.  lq matrix completion , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[39]  Hong-Kun Xu,et al.  Convergence of Bregman alternating direction method with multipliers for nonconvex composite problems , 2014, 1410.8625.

[40]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[41]  Helmut Bölcskei,et al.  Recovery of Sparsely Corrupted Signals , 2011, IEEE Transactions on Information Theory.

[42]  M. Varanasi,et al.  Parametric generalized Gaussian density estimation , 1989 .

[43]  Richard G. Baraniuk,et al.  Democracy in Action: Quantization, Saturation, and Compressive Sensing , 2011 .

[44]  Dimitri P. Bertsekas,et al.  On the Douglas—Rachford splitting method and the proximal point algorithm for maximal monotone operators , 1992, Math. Program..

[45]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[46]  Pinar Çivicioglu Using Uncorrupted Neighborhoods of the Pixels for Impulsive Noise Suppression With ANFIS , 2007, IEEE Transactions on Image Processing.

[47]  Svetha Venkatesh,et al.  Efficient Algorithms for Robust Recovery of Images From Compressed Data , 2012, IEEE Transactions on Image Processing.

[48]  Lei Huang,et al.  $\ell _{p}$-MUSIC: Robust Direction-of-Arrival Estimator for Impulsive Noise Environments , 2013, IEEE Transactions on Signal Processing.

[49]  Junfeng Yang,et al.  Alternating Direction Algorithms for 1-Problems in Compressive Sensing , 2009, SIAM J. Sci. Comput..

[50]  E.J. Candes,et al.  An Introduction To Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[51]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[52]  Gonzalo R. Arce,et al.  Nonlinear Signal Processing - A Statistical Approach , 2004 .

[53]  Takeshi Hashimoto Bounds on a probability for the heavy tailed distribution and the probability of deficient decoding in sequential decoding , 2005, IEEE Transactions on Information Theory.

[54]  Goran Marjanovic,et al.  On $l_q$ Optimization and Matrix Completion , 2012, IEEE Transactions on Signal Processing.

[55]  David L. Donoho,et al.  High-Dimensional Centrally Symmetric Polytopes with Neighborliness Proportional to Dimension , 2006, Discret. Comput. Geom..

[56]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[57]  Bernard Ghanem,et al.  ℓ0TV: A new method for image restoration in the presence of impulse noise , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[58]  Hossein Mobahi,et al.  Toward a Practical Face Recognition System: Robust Alignment and Illumination by Sparse Representation , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[59]  Emmanuel J. Candès,et al.  Decoding by linear programming , 2005, IEEE Transactions on Information Theory.

[60]  E. Candès,et al.  Stable signal recovery from incomplete and inaccurate measurements , 2005, math/0503066.

[61]  Kenneth E. Barner,et al.  Robust Sampling and Reconstruction Methods for Sparse Signals in the Presence of Impulsive Noise , 2010, IEEE Journal of Selected Topics in Signal Processing.

[62]  Richard G. Baraniuk,et al.  Fast Alternating Direction Optimization Methods , 2014, SIAM J. Imaging Sci..