Sparse Adaptive Iteratively-Weighted Thresholding Algorithm (SAITA) for Lp-Regularization Using the Multiple Sub-Dictionary Representation

Both L1/2 and L2/3 are two typical non-convex regularizations of Lp (0<p<1), which can be employed to obtain a sparser solution than the L1 regularization. Recently, the multiple-state sparse transformation strategy has been developed to exploit the sparsity in L1 regularization for sparse signal recovery, which combines the iterative reweighted algorithms. To further exploit the sparse structure of signal and image, this paper adopts multiple dictionary sparse transform strategies for the two typical cases p∈{1/2, 2/3} based on an iterative Lp thresholding algorithm and then proposes a sparse adaptive iterative-weighted Lp thresholding algorithm (SAITA). Moreover, a simple yet effective regularization parameter is proposed to weight each sub-dictionary-based Lp regularizer. Simulation results have shown that the proposed SAITA not only performs better than the corresponding L1 algorithms but can also obtain a better recovery performance and achieve faster convergence than the conventional single-dictionary sparse transform-based Lp case. Moreover, we conduct some applications about sparse image recovery and obtain good results by comparison with relative work.

[1]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[2]  Fumiyuki Adachi,et al.  Variable-step-size based sparse adaptive filtering algorithm for channel estimation in broadband wireless communication systems , 2014, EURASIP J. Wirel. Commun. Netw..

[3]  Yonina C. Eldar,et al.  Smoothing and Decomposition for Analysis Sparse Recovery , 2013, IEEE Transactions on Signal Processing.

[4]  Wotao Yin,et al.  Iteratively reweighted algorithms for compressive sensing , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[5]  Zongben Xu,et al.  $L_{1/2}$ Regularization: A Thresholding Representation Theory and a Fast Solver , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[6]  Guan Gui,et al.  Recent results in compressive sensing based image inpainiting algorithms and open problems , 2015, 2015 8th International Congress on Image and Signal Processing (CISP).

[7]  Zongben Xu,et al.  Fast image deconvolution using closed-form thresholding formulas of Lq ð q 1⁄4 12 ; 23 Þ regularization , 2012 .

[8]  Wanzhou Ye,et al.  L 2 / 3 regularization , 2015 .

[9]  M. Fornasier,et al.  Iterative thresholding algorithms , 2008 .

[10]  Yong Zhang,et al.  L2/3 regularization: Convergence of iterative thresholding algorithm , 2015, J. Vis. Commun. Image Represent..

[11]  Goran Marjanovic,et al.  On $l_q$ Optimization and Matrix Completion , 2012, IEEE Transactions on Signal Processing.

[12]  Wang Yao,et al.  L 1/2 regularization , 2010 .

[13]  Minyi Guo,et al.  Mobile Target Detection in Wireless Sensor Networks With Adjustable Sensing Frequency , 2016, IEEE Systems Journal.

[14]  Sundeep Rangan,et al.  Generalized approximate message passing for cosparse analysis compressive sensing , 2013, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[15]  José M. Bioucas-Dias,et al.  Fast Image Recovery Using Variable Splitting and Constrained Optimization , 2009, IEEE Transactions on Image Processing.

[16]  Thomas Strohmer,et al.  Compressed sensing radar , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[17]  Zongben Xu,et al.  Regularization: Convergence of Iterative Half Thresholding Algorithm , 2014 .

[18]  Gitta Kutyniok,et al.  Shearlet-based compressed sensing for fast 3D cardiac MR imaging using iterative reweighting , 2017, Physics in medicine and biology.

[19]  E. Candès The restricted isometry property and its implications for compressed sensing , 2008 .

[20]  Suk Ho Lee,et al.  Colorization-Based RGB-White Color Interpolation using Color Filter Array with Randomly Sampled Pattern , 2017, Sensors.

[21]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[22]  Rick Chartrand,et al.  Exact Reconstruction of Sparse Signals via Nonconvex Minimization , 2007, IEEE Signal Processing Letters.

[23]  Emmanuel J. Candès,et al.  NESTA: A Fast and Accurate First-Order Method for Sparse Recovery , 2009, SIAM J. Imaging Sci..

[24]  Philip Schniter,et al.  Iteratively Reweighted ℓ1 Approaches to Sparse Composite Regularization , 2015, IEEE Trans. Computational Imaging.

[25]  Nei Kato,et al.  The Deep Learning Vision for Heterogeneous Network Traffic Control: Proposal, Challenges, and Future Perspective , 2017, IEEE Wireless Communications.

[26]  Pierre Vandergheynst,et al.  Universal and efficient compressed sensing by spread spectrum and application to realistic Fourier imaging techniques , 2011, EURASIP J. Adv. Signal Process..

[27]  Lajos Hanzo,et al.  Compressive-Sensing-Based Multiuser Detector for the Large-Scale SM-MIMO Uplink , 2015, IEEE Transactions on Vehicular Technology.

[28]  Mike E. Davies,et al.  Iterative Hard Thresholding for Compressed Sensing , 2008, ArXiv.

[29]  Jianhua Li,et al.  Big Data Analysis-Based Security Situational Awareness for Smart Grid , 2018, IEEE Transactions on Big Data.

[30]  Michael Elad,et al.  Sparse Representation for Color Image Restoration , 2008, IEEE Transactions on Image Processing.

[31]  Minyi Guo,et al.  Pricing and Repurchasing for Big Data Processing in Multi-Clouds , 2016, IEEE Transactions on Emerging Topics in Computing.

[32]  Jie Li,et al.  Energy-Efficient Broadcasting Scheme for Smart Industrial Wireless Sensor Networks , 2017, Mob. Inf. Syst..

[33]  Jackie Ma,et al.  A multilevel based reweighting algorithm with joint regularizers for sparse recovery , 2016, 1604.06941.

[34]  Qinye Yin,et al.  Blind Channel Estimation for MIMO-OFDM Systems With Low Order Signal Constellation , 2015, IEEE Communications Letters.

[35]  Zongben Xu,et al.  Fast image deconvolution using closed-form thresholding formulas of regularization , 2013, J. Vis. Commun. Image Represent..

[36]  Chau Yuen,et al.  Near-Optimal Signal Detector Based on Structured Compressive Sensing for Massive SM-MIMO , 2016, IEEE Transactions on Vehicular Technology.

[37]  Jie Li,et al.  Distributed duty cycle control for delay improvement in wireless sensor networks , 2017, Peer-to-Peer Netw. Appl..

[38]  Junfeng Yang,et al.  Alternating Direction Algorithms for 1-Problems in Compressive Sensing , 2009, SIAM J. Sci. Comput..

[39]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Jie Li,et al.  A green and reliable communication modeling for industrial internet of things , 2017, Comput. Electr. Eng..

[41]  Cun-Hui Zhang Nearly unbiased variable selection under minimax concave penalty , 2010, 1002.4734.

[42]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[43]  Wang-Q Lim,et al.  The Discrete Shearlet Transform: A New Directional Transform and Compactly Supported Shearlet Frames , 2010, IEEE Transactions on Image Processing.

[44]  Jianqing Fan,et al.  Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties , 2001 .