Adaptive Compressed Image Sensing Using Dictionaries

In recent years, the theory of compressed sensing has emerged as an alternative for the Shannon sampling theorem, suggesting that compressible signals can be reconstructed from far fewer samples than required by the Shannon sampling theorem. In fact the theory advocates that nonadaptive, “random” functionals are in some sense optimal for this task. However, in practice, compressed sensing is very difficult to implement for large data sets, particularly because the recovery algorithms require significant computational resources. In this work, we present a new alternative method for simultaneous image acquisition and compression called adaptive compressed sampling. We exploit wavelet tree structures found in natural images to replace the “universal” acquisition of incoherent measurements with a direct and fast method for adaptive wavelet tree acquisition. The main advantages of this direct approach are that no complex recovery algorithm is in fact needed and that it allows more control over the compressed image quality, in particular, the sharpness of edges. Our experimental results show, by way of software simulations, that our adaptive algorithms perform better than existing nonadaptive methods in terms of image quality and speed.

[1]  Selin Aviyente,et al.  Mutual information based subband selection for wavelet packet based image classification , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[2]  Terence Tao,et al.  The Dantzig selector: Statistical estimation when P is much larger than n , 2005, math/0506081.

[3]  Ingrid Daubechies,et al.  Ten Lectures on Wavelets , 1992 .

[4]  Piotr Indyk,et al.  Sparse Recovery Using Sparse Random Matrices , 2010, LATIN.

[5]  Lawrence Carin,et al.  Exploiting Structure in Wavelet-Based Bayesian Compressive Sensing , 2009, IEEE Transactions on Signal Processing.

[6]  R. Moddemeijer On estimation of entropy and mutual information of continuous distributions , 1989 .

[7]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[8]  Justin Romberg,et al.  Practical Signal Recovery from Random Projections , 2005 .

[9]  Deanna Needell,et al.  CoSaMP: Iterative signal recovery from incomplete and inaccurate samples , 2008, ArXiv.

[10]  Trac D. Tran,et al.  Fast compressive imaging using scrambled block Hadamard ensemble , 2008, 2008 16th European Signal Processing Conference.

[11]  Emmanuel J. Candès,et al.  Decoding by linear programming , 2005, IEEE Transactions on Information Theory.

[12]  Mohammad A. Karim,et al.  Forest representation of wavelet transform and feature detection , 2000 .

[13]  Rune B. Lyngsø,et al.  Lecture Notes I , 2008 .

[14]  Eero P. Simoncelli,et al.  Image compression via joint statistical characterization in the wavelet domain , 1999, IEEE Trans. Image Process..

[15]  Robert D. Nowak,et al.  Wavelet-based statistical signal processing using hidden Markov models , 1998, IEEE Trans. Signal Process..

[16]  Stéphane Mallat,et al.  A Wavelet Tour of Signal Processing - The Sparse Way, 3rd Edition , 2008 .

[17]  Xin-She Yang,et al.  Introduction to Algorithms , 2021, Nature-Inspired Optimization Algorithms.

[18]  Ting Sun,et al.  Single-pixel imaging via compressive sampling , 2008, IEEE Signal Process. Mag..

[19]  Jean-Luc Starck,et al.  Compressed Sensing in Astronomy , 2008, IEEE Journal of Selected Topics in Signal Processing.

[20]  Robert D. Nowak,et al.  Multiscale Modeling and Estimation of Poisson Processes with Application to Photon-Limited Imaging , 1999, IEEE Trans. Inf. Theory.

[21]  R. DeVore,et al.  Nonlinear approximation , 1998, Acta Numerica.

[22]  Deanna Needell,et al.  Signal Recovery From Incomplete and Inaccurate Measurements Via Regularized Orthogonal Matching Pursuit , 2007, IEEE Journal of Selected Topics in Signal Processing.

[23]  William A. Pearlman,et al.  A new, fast, and efficient image codec based on set partitioning in hierarchical trees , 1996, IEEE Trans. Circuits Syst. Video Technol..

[24]  D. Donoho For most large underdetermined systems of linear equations the minimal 𝓁1‐norm solution is also the sparsest solution , 2006 .

[25]  Eero P. Simoncelli Modeling the joint statistics of images in the wavelet domain , 1999, Optics & Photonics.

[26]  Richard Baraniuk,et al.  Multiscale texture segmentation using wavelet-domain hidden Markov models , 1998, Conference Record of Thirty-Second Asilomar Conference on Signals, Systems and Computers (Cat. No.98CH36284).

[27]  Liam Paninski,et al.  Estimation of Entropy and Mutual Information , 2003, Neural Computation.

[28]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[29]  E. Candès,et al.  Sparsity and incoherence in compressive sampling , 2006, math/0611957.

[30]  Michael E. Taylor,et al.  Differential Geometry I , 1994 .

[31]  D. D.-Y. Po,et al.  Directional multiscale modeling of images using the contourlet transform , 2006, IEEE Transactions on Image Processing.

[32]  Oscar Gonzalez,et al.  Curves, circles, and spheres , 2002 .

[33]  Yehuda Pfeffer A Micro-Mirror Array based System for Compressive Sensing of Hyperspectral Data , 2010 .

[34]  Mike E. Davies,et al.  Iterative Hard Thresholding for Compressed Sensing , 2008, ArXiv.

[35]  Michael W. Marcellin,et al.  Comparison of different methods of classification in subband coding of images , 1997, IEEE Trans. Image Process..

[36]  Emmanuel J. Candès,et al.  Robust Signal Recovery from Incomplete Observations , 2006, 2006 International Conference on Image Processing.

[37]  Volkan Cevher,et al.  Model-Based Compressive Sensing , 2008, IEEE Transactions on Information Theory.

[38]  Pierre Moulin,et al.  Information-theoretic analysis of interscale and intrascale dependencies between image wavelet coefficients , 2001, IEEE Trans. Image Process..

[39]  Jianhua Chen,et al.  Context modeling and entropy coding of wavelet coefficients for image compression , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[40]  Yaakov Tsaig,et al.  Extensions of compressed sensing , 2006, Signal Process..

[41]  Mohamed-Jalal Fadili,et al.  Multivariate statistical modeling of images with the curvelet transform , 2005, Proceedings of the Eighth International Symposium on Signal Processing and Its Applications, 2005..

[42]  Alex Pentland,et al.  A practical approach to fractal-based image compression , 1991, [1991] Proceedings. Data Compression Conference.

[43]  Alex Pentland,et al.  Practical approach to fractal-based image compression , 1991, Other Conferences.

[44]  Justin K. Romberg,et al.  Bayesian tree-structured image modeling using wavelet-domain hidden Markov models , 2001, IEEE Trans. Image Process..

[45]  David L. Donoho,et al.  Sparse Solution Of Underdetermined Linear Equations By Stagewise Orthogonal Matching Pursuit , 2006 .

[46]  Wilfried Philips,et al.  Estimating image blur in the wavelet domain. , 2001 .

[47]  E. Candès,et al.  New tight frames of curvelets and optimal representations of objects with piecewise C2 singularities , 2004 .

[48]  Jerome M. Shapiro,et al.  Embedded image coding using zerotrees of wavelet coefficients , 1993, IEEE Trans. Signal Process..

[49]  Minh N. Do,et al.  Signal reconstruction using sparse tree representations , 2005, SPIE Optics + Photonics.

[50]  Richard G. Baraniuk,et al.  Fast reconstruction of piecewise smooth signals from random projections , 2005 .

[51]  Sheila S. Hemami,et al.  Regularity-preserving image interpolation , 1999, IEEE Trans. Image Process..

[52]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[53]  Balas K. Natarajan,et al.  Sparse Approximate Solutions to Linear Systems , 1995, SIAM J. Comput..

[54]  D. Donoho,et al.  Sparse MRI: The application of compressed sensing for rapid MR imaging , 2007, Magnetic resonance in medicine.

[55]  Olgica Milenkovic,et al.  Subspace Pursuit for Compressive Sensing: Closing the Gap Between Performance and Complexity , 2008, ArXiv.

[56]  E.J. Candes,et al.  An Introduction To Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[57]  Ahmad Zandi,et al.  Implementation of compression with reversible embedded wavelets , 1995, Optics & Photonics.

[58]  E.J. Candes Compressive Sampling , 2022 .

[59]  Yasuyuki Matsushita,et al.  High-resolution hyperspectral imaging via matrix factorization , 2011, CVPR 2011.

[60]  Roberto Rinaldo,et al.  Image coding by block prediction of multiresolution subimages , 1995, IEEE Trans. Image Process..

[61]  R. DeVore,et al.  A Simple Proof of the Restricted Isometry Property for Random Matrices , 2008 .

[62]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[63]  S. Mallat A wavelet tour of signal processing , 1998 .

[64]  Frédéric Lesage,et al.  The Application of Compressed Sensing for , 2009 .

[65]  J. Tropp,et al.  SIGNAL RECOVERY FROM PARTIAL INFORMATION VIA ORTHOGONAL MATCHING PURSUIT , 2005 .

[66]  J. Maddocks,et al.  Global curvature, thickness, and the ideal shapes of knots. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[67]  Ajai Jain,et al.  The Handbook of Pattern Recognition and Computer Vision , 1993 .

[68]  Martin Vetterli,et al.  Resolution enhancement of images using wavelet transform extrema extrapolation , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[69]  R. DeVore,et al.  Compressed sensing and best k-term approximation , 2008 .

[70]  Stéphane Mallat,et al.  Singularity detection and processing with wavelets , 1992, IEEE Trans. Inf. Theory.

[71]  Dmitry M. Malioutov,et al.  Sequential Compressed Sensing , 2010, IEEE Journal of Selected Topics in Signal Processing.

[72]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[73]  Antonio Ortega,et al.  Efficient context-based lossy wavelet image coding , 1997 .