Sparse Coding Algorithm with Negentropy and Weighted ℓ1-Norm for Signal Reconstruction

Compressive sensing theory has attracted widespread attention in recent years and sparse signal reconstruction has been widely used in signal processing and communication. This paper addresses the problem of sparse signal recovery especially with non-Gaussian noise. The main contribution of this paper is the proposal of an algorithm where the negentropy and reweighted schemes represent the core of an approach to the solution of the problem. The signal reconstruction problem is formalized as a constrained minimization problem, where the objective function is the sum of a measurement of error statistical characteristic term, the negentropy, and a sparse regularization term, lp-norm, for 0 < p < 1. The lp-norm, however, leads to a non-convex optimization problem which is difficult to solve efficiently. Herein we treat the lp -norm as a serious of weighted l1-norms so that the sub-problems become convex. We propose an optimized algorithm that combines forward-backward splitting. The algorithm is fast and succeeds in exactly recovering sparse signals with Gaussian and non-Gaussian noise. Several numerical experiments and comparisons demonstrate the superiority of the proposed algorithm.

[1]  Ali H. Sayed,et al.  Detection of fading overlapping multipath components , 2006, Signal Process..

[2]  Ender M. Eksioglu,et al.  RLS Algorithm With Convex Regularization , 2011, IEEE Signal Processing Letters.

[3]  Jiaru Lin,et al.  A joint recovery algorithm for distributed compressed sensing , 2012, Trans. Emerg. Telecommun. Technol..

[4]  Jianguo Huang,et al.  DOA estimation in monostatic MIMO array based on sparse signal reconstruction , 2016, 2016 IEEE International Conference on Signal Processing, Communications and Computing (ICSPCC).

[5]  David Thomas Magill Adaptive minimum MSE estimation (Corresp.) , 1963, IEEE Trans. Inf. Theory.

[6]  José M. Bioucas-Dias,et al.  A New TwIST: Two-Step Iterative Shrinkage/Thresholding Algorithms for Image Restoration , 2007, IEEE Transactions on Image Processing.

[7]  Sergios Theodoridis,et al.  Sparsity-Aware Learning and Compressed Sensing: An Overview , 2012, ArXiv.

[8]  Lu Liu,et al.  l 0-norm penalised shrinkage linear and widely linear LMS algorithms for sparse system identification , 2017, IET Signal Process..

[9]  Andrew C. Singer,et al.  Signal processing for underwater acoustic communications , 2009, IEEE Communications Magazine.

[10]  Mário A. T. Figueiredo,et al.  Gradient Projection for Sparse Reconstruction: Application to Compressed Sensing and Other Inverse Problems , 2007, IEEE Journal of Selected Topics in Signal Processing.

[11]  F. Y. Wu,et al.  Non-Uniform Norm Constraint LMS Algorithm for Sparse System Identification , 2013, IEEE Communications Letters.

[12]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[13]  Ljubisa Stankovic,et al.  Comparison of a gradient-based and LASSO (ISTA) algorithm for sparse signal reconstruction , 2016, 2016 5th Mediterranean Conference on Embedded Computing (MECO).

[14]  P. Woodward Entropy and negentropy (Edtl.) , 1957 .

[15]  Damiana Lazzaro,et al.  Fast Sparse Image Reconstruction Using Adaptive Nonlinear Filtering , 2011, IEEE Transactions on Image Processing.

[16]  Stephen P. Boyd,et al.  An Interior-Point Method for Large-Scale $\ell_1$-Regularized Least Squares , 2007, IEEE Journal of Selected Topics in Signal Processing.

[17]  Jian Wang,et al.  Performance Analysis of $l_0$ Norm Constraint Least Mean Square Algorithm , 2012, IEEE Transactions on Signal Processing.

[18]  Jianming Liu,et al.  Proportionate Adaptive Filtering for Block-Sparse System Identification , 2015, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[19]  Alfred O. Hero,et al.  Sparse LMS for system identification , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[20]  Damiana Lazzaro,et al.  A fast algorithm for nonconvex approaches to sparse recovery problems , 2013, Signal Process..

[21]  Shu Hung Leung,et al.  Gradient-based variable forgetting factor RLS algorithm in time-varying environments , 2005, IEEE Transactions on Signal Processing.

[22]  Bo Li,et al.  Multi-User Detection for Sporadic IDMA Transmission Based on Compressed Sensing , 2017, Entropy.

[23]  Isao Yamada,et al.  Adaptive proximal forward-backward splitting for sparse system identification under impulsive noise , 2012, 2012 Proceedings of the 20th European Signal Processing Conference (EUSIPCO).

[24]  Michael Elad,et al.  On the Role of Sparse and Redundant Representations in Image Processing , 2010, Proceedings of the IEEE.

[25]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[26]  Dirk A. Lorenz,et al.  Iterated Hard Shrinkage for Minimization Problems with Sparsity Constraints , 2008, SIAM J. Sci. Comput..