Image reconstruction in the presence of non-linear mixtures utilizing wavelet variable-dependency modeling in compressed sensing algorithms

In Compressed Sensing (CS) Theory sparse signals can be reconstructed from far fewer measurements than the Nyquist Sampling Limit. Initial Compressed Sensing algorithms implicitly assume that sparsity domain coefficients are independently distributed. Accounting for and exploiting statistical dependencies in sparse signals can improve recovery performance. Wavelets and their theoretical principles, and the structural statistical modeling of dependencies, are applied to improve feature optimization in the presence of non-linear mixtures. Sparsifying Transforms, such as the Discrete Wavelet Transform (DWT), are used for spatial dependencies such as in natural images. This can exploit hierarchical structure and multiscale subbands of frequencies and orientation, exploiting dependencies across and within scales. Bayes Least Squares-Gaussian-scale Mixtures accurately describe statistical dependencies of wavelet coefficients in images, and, therefore, can be incorporated to address dependencies and improve performance. Sparsifying Transforms and Bayes Least Squares-Gaussian-scale Mixtures are incorporated to model and account for dependency characteristics during the coefficient-weight construction of Compressed Sensing algorithm iterations. The resulting accuracy and performance improvements of incorporating wavelets and their theoretical principles, and incorporating the structural and statistical modeling of dependencies, to account for variable-dependencies in image reconstruction algorithms are shown, both quantitatively and qualitatively.

[1]  Martin J. Wainwright,et al.  Image denoising using scale mixtures of Gaussians in the wavelet domain , 2003, IEEE Trans. Image Process..

[2]  Michael W. Marcellin,et al.  JPEG2000 - image compression fundamentals, standards and practice , 2002, The Kluwer International Series in Engineering and Computer Science.

[3]  Lawrence Carin,et al.  Exploiting Structure in Wavelet-Based Bayesian Compressive Sensing , 2009, IEEE Transactions on Signal Processing.

[4]  Chen Chen,et al.  Compressed-sensing recovery of images and video using multihypothesis predictions , 2011, 2011 Conference Record of the Forty Fifth Asilomar Conference on Signals, Systems and Computers (ASILOMAR).

[5]  David L. Donoho,et al.  Sparse Solution Of Underdetermined Linear Equations By Stagewise Orthogonal Matching Pursuit , 2006 .

[6]  Ali Bilgin,et al.  Compressed sensing using a Gaussian Scale Mixtures model in wavelet domain , 2010, 2010 IEEE International Conference on Image Processing.

[7]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[8]  Mike E. Davies,et al.  Sampling Theorems for Signals From the Union of Finite-Dimensional Linear Subspaces , 2009, IEEE Transactions on Information Theory.

[9]  James E. Fowler,et al.  Multiscale block compressed sensing with smoothed projected Landweber reconstruction , 2011, 2011 19th European Signal Processing Conference.

[10]  Deanna Needell,et al.  CoSaMP: Iterative signal recovery from incomplete and inaccurate samples , 2008, ArXiv.

[11]  E. Candès,et al.  Stable signal recovery from incomplete and inaccurate measurements , 2005, math/0503066.

[12]  Ali Bilgin,et al.  Exploiting Wavelet-Domain Dependencies in Compressed Sensing , 2010, 2010 Data Compression Conference.

[13]  Sudipto Guha,et al.  Near-optimal sparse fourier representations via sampling , 2002, STOC '02.

[14]  I. Daubechies,et al.  Iteratively reweighted least squares minimization for sparse recovery , 2008, 0807.0575.

[15]  Yonina C. Eldar,et al.  Robust Recovery of Signals From a Structured Union of Subspaces , 2008, IEEE Transactions on Information Theory.

[16]  E.J. Candes Compressive Sampling , 2022 .

[17]  Rahul Garg,et al.  Gradient descent with sparsification: an iterative algorithm for sparse recovery with restricted isometry property , 2009, ICML '09.

[18]  Graham Cormode,et al.  Combinatorial Algorithms for Compressed Sensing , 2006 .

[19]  Mário A. T. Figueiredo,et al.  Gradient Projection for Sparse Reconstruction: Application to Compressed Sensing and Other Inverse Problems , 2007, IEEE Journal of Selected Topics in Signal Processing.

[20]  Fang Liu,et al.  Multivariate Compressive Sensing for Image Reconstruction in the Wavelet Domain: Using Scale Mixture Models , 2011, IEEE Transactions on Image Processing.

[21]  Jerome M. Shapiro,et al.  Embedded image coding using zerotrees of wavelet coefficients , 1993, IEEE Trans. Signal Process..

[22]  N. Kingsbury Complex Wavelets for Shift Invariant Analysis and Filtering of Signals , 2001 .

[23]  Lawrence Carin,et al.  Tree-Structured Compressive Sensing With Variational Bayesian Analysis , 2010, IEEE Signal Processing Letters.

[24]  Stephen P. Boyd,et al.  Enhancing Sparsity by Reweighted ℓ1 Minimization , 2007, 0711.1612.

[25]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[26]  James E. Fowler,et al.  Block Compressed Sensing of Images Using Directional Transforms , 2010, 2010 Data Compression Conference.

[27]  Trac D. Tran,et al.  Fast compressive imaging using scrambled block Hadamard ensemble , 2008, 2008 16th European Signal Processing Conference.

[28]  Richard G. Baraniuk,et al.  Wavelet-domain compressive signal reconstruction using a Hidden Markov Tree model , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[29]  Robert D. Nowak,et al.  Signal Reconstruction From Noisy Random Projections , 2006, IEEE Transactions on Information Theory.

[30]  William A. Pearlman,et al.  A new, fast, and efficient image codec based on set partitioning in hierarchical trees , 1996, IEEE Trans. Circuits Syst. Video Technol..

[31]  Trac D. Tran,et al.  Fast and Efficient Compressive Sensing Using Structurally Random Matrices , 2011, IEEE Transactions on Signal Processing.

[32]  Volkan Cevher,et al.  Model-Based Compressive Sensing , 2008, IEEE Transactions on Information Theory.

[33]  N. Do Minh,et al.  Tree-Based Majorize-Maximize Algorithm for Compressed Sensing with Sparse-Tree Prior , 2007 .

[34]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[35]  Martin Vetterli,et al.  Spatially adaptive wavelet thresholding with context modeling for image denoising , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[36]  Levent Sendur,et al.  Bivariate shrinkage functions for wavelet-based denoising exploiting interscale dependency , 2002, IEEE Trans. Signal Process..

[37]  David L. Donoho,et al.  De-noising by soft-thresholding , 1995, IEEE Trans. Inf. Theory.

[38]  T. Blumensath,et al.  Iterative Thresholding for Sparse Approximations , 2008 .

[39]  Marco F. Duarte,et al.  Compressive sensing recovery of spike trains using a structured sparsity model , 2009 .

[40]  Junzhou Huang,et al.  Learning with structured sparsity , 2009, ICML '09.

[41]  Martin J. Wainwright,et al.  Scale Mixtures of Gaussians and the Statistics of Natural Images , 1999, NIPS.

[42]  Lu Gan Block Compressed Sensing of Natural Images , 2007, 2007 15th International Conference on Digital Signal Processing.