Compressive sensing for 3d data processing tasks: applications, models and algorithms

Compressive sensing (CS) is a novel sampling methodology representing a paradigm shift from conventional data acquisition schemes. The theory of compressive sensing ensures that under suitable conditions compressible signals or images can be reconstructed from far fewer samples or measurements than what are required by the Nyquist rate. So far in the literature, most works on CS concentrate on one-dimensional or two-dimensional data. However, besides involving far more data, three-dimensional (3D) data processing does have particularities that require the development of new techniques in order to make successful transitions from theoretical feasibilities to practical capacities. This thesis studies several issues arising from the applications of the CS methodology to some 3D image processing tasks. Two specific applications are hyperspectral imaging and video compression where 3D images are either directly unmixed or recovered as a whole from CS samples. The main issues include CS decoding models, preprocessing techniques and reconstruction algorithms, as well as CS encoding matrices in the case of video compression. Our investigation involves three major parts. (1) Total variation (TV) regularization plays a central role in the decoding models studied in this thesis. To solve such models, we propose an efficient scheme to implement the classic augmented Lagrangian multiplier method and study its convergence properties. The resulting Matlab package TVAL3 is used to solve several models. Computational results show that, thanks to its low per-iteration complexity, the proposed algorithm is capable of handling realistic 3D image processing tasks. (2) Hyperspectral image processing typically demands heavy computational resources due to an enormous amount of data involved. We investigate low-complexity procedures to unmix, sometimes blindly, CS compressed hyperspectral data to directly obtain material signatures and their abundance fractions, bypassing the high-complexity task of reconstructing the image cube itself. (3) To overcome the "cliff effect" suffered by current video coding schemes, we explore a compressive video sampling framework to improve scalability with respect to channel capacities. We propose and study a novel multi-resolution CS encoding matrix, and a decoding model with a TV-DCT regularization function. Extensive numerical results are presented, obtained from experiments that use not only synthetic data, but also real data measured by hardware. The results establish feasibility and robustness, to various extent, of the proposed 3D data processing schemes, models and algorithms. There still remain many challenges to be further resolved in each area, but hopefully the progress made in this thesis will represent a useful first step towards meeting these challenges in the future.

[1]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[2]  R. Tapia Diagonalized multiplier methods and quasi-Newton methods for constrained optimization , 1977 .

[3]  Jean-Jacques Fuchs,et al.  On sparse representations in arbitrary redundant bases , 2004, IEEE Transactions on Information Theory.

[4]  B. Logan,et al.  Signal recovery and the large sieve , 1992 .

[5]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[6]  R.G. Baraniuk,et al.  Distributed Compressed Sensing of Jointly Sparse Signals , 2005, Conference Record of the Thirty-Ninth Asilomar Conference onSignals, Systems and Computers, 2005..

[7]  Junfeng Yang,et al.  An Efficient TVL1 Algorithm for Deblurring Multichannel Images Corrupted by Impulsive Noise , 2009, SIAM J. Sci. Comput..

[8]  Alan H. Strahler,et al.  Geometric-optical bidirectional reflectance modeling of the discrete crown vegetation canopy: effect of crown shape and mutual shadowing , 1992, IEEE Trans. Geosci. Remote. Sens..

[9]  Donald Geman,et al.  Nonlinear image recovery with half-quadratic regularization , 1995, IEEE Trans. Image Process..

[10]  David L. Donoho,et al.  Neighborly Polytopes And Sparse Solution Of Underdetermined Linear Equations , 2005 .

[11]  Yin Zhang,et al.  Scalable video coding using compressive sensing , 2012, Bell Labs Technical Journal.

[12]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[13]  Tsuhan Chen,et al.  A Unified QoS Optimization for Scalable Video Multirate Multicast over Hybrid Coded Network , 2010, 2010 IEEE International Conference on Communications.

[14]  J. Borwein,et al.  Two-Point Step Size Gradient Methods , 1988 .

[15]  Hari Kalva,et al.  The VC-1 and H.264 Video Compression Standards for Broadband Video Services , 2008 .

[16]  Francis T. Marchese,et al.  A System for Real-Time Transcoding and Delivery of Video to Smartphones , 2010, 2010 14th International Conference Information Visualisation.

[17]  R. Luce,et al.  Parameter identification for an elliptic partial differential equation with distributed noisy data , 1999 .

[18]  José M. Bioucas-Dias,et al.  A variable splitting augmented Lagrangian approach to linear spectral unmixing , 2009, 2009 First Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing.

[19]  F. Santosa,et al.  Linear inversion of ban limit reflection seismograms , 1986 .

[20]  Tom Goldstein,et al.  The Split Bregman Method for L1-Regularized Problems , 2009, SIAM J. Imaging Sci..

[21]  José M. Bioucas-Dias,et al.  Minimum Volume Simplex Analysis: A Fast Algorithm to Unmix Hyperspectral Data , 2008, IGARSS 2008 - 2008 IEEE International Geoscience and Remote Sensing Symposium.

[22]  L. Grippo,et al.  A nonmonotone line search technique for Newton's method , 1986 .

[23]  Xiaoming Huo,et al.  Uncertainty principles and ideal atomic decomposition , 2001, IEEE Trans. Inf. Theory.

[24]  Chein-I Chang,et al.  A New Growing Method for Simplex-Based Endmember Extraction Algorithm , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Wallace M. Porter,et al.  The airborne visible/infrared imaging spectrometer (AVIRIS) , 1993 .

[26]  Yin Zhang,et al.  Video coding using compressive sensing for wireless communications , 2011, 2011 IEEE Wireless Communications and Networking Conference.

[27]  R. Nowak,et al.  Compressed Sensing for Networked Data , 2008, IEEE Signal Processing Magazine.

[28]  José M. Bioucas-Dias,et al.  A New TwIST: Two-Step Iterative Shrinkage/Thresholding Algorithms for Image Restoration , 2007, IEEE Transactions on Image Processing.

[29]  M. Hestenes Multiplier and gradient methods , 1969 .

[30]  Yin Zhang,et al.  A Compressive Sensing and Unmixing Scheme for Hyperspectral Data Processing , 2012, IEEE Transactions on Image Processing.

[31]  P. Tseng Applications of splitting algorithm to decomposition in convex programming and variational inequalities , 1991 .

[32]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[33]  Stanley Osher,et al.  L1 unmixing and its application to hyperspectral image enhancement , 2009, Defense + Commercial Sensing.

[34]  Emmanuel J. Candès,et al.  NESTA: A Fast and Accurate First-Order Method for Sparse Recovery , 2009, SIAM J. Imaging Sci..

[35]  R. Byrd Local convergence of the diagonalized method of multipliers , 1978 .

[36]  Dina Katabi,et al.  SoftCast: One Video to Serve All Wireless Receivers , 2009 .

[37]  R. Courant Variational methods for the solution of problems of equilibrium and vibrations , 1943 .

[38]  Yin Zhang On Theory of Compressive Sensing via L_1-Minimization: Simple Derivations and Extensions , 2008 .

[39]  R. Clark,et al.  Reflectance spectroscopy: Quantitative analysis techniques for remote sensing applications , 1984 .

[40]  Rémi Gribonval,et al.  Sparse representations in unions of bases , 2003, IEEE Trans. Inf. Theory.

[41]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[42]  R. Tapia Newton's Method for Problems with Equality Constraints , 1974 .

[43]  E.L. Jacobs,et al.  Compressive sensing applied to homeland security , 2008, 2008 IEEE Sensors Applications Symposium.

[44]  Richard G. Baraniuk,et al.  Compressive imaging for video representation and coding , 2006 .

[45]  D. Donoho,et al.  Basis pursuit , 1994, Proceedings of 1994 28th Asilomar Conference on Signals, Systems and Computers.

[46]  Dimitri P. Bertsekas,et al.  Constrained Optimization and Lagrange Multiplier Methods , 1982 .

[47]  Bingsheng He,et al.  Some convergence properties of a method of multipliers for linearly constrained monotone variational inequalities , 1998, Oper. Res. Lett..

[48]  Wotao Yin,et al.  Bregman Iterative Algorithms for (cid:2) 1 -Minimization with Applications to Compressed Sensing ∗ , 2008 .

[49]  C. Vogel,et al.  Analysis of bounded variation penalty methods for ill-posed problems , 1994 .

[50]  L. He,et al.  MR Image Reconstruction from Sparse Radial Samples Using Bregman Iteration , 2006 .

[51]  D. L. Donoho,et al.  Rapid MR Imaging with "Compressed Sensing" and Randomly Under-Sampled 3DFT Trajectories , 2004 .

[52]  Mario Winter,et al.  N-FINDR: an algorithm for fast autonomous spectral end-member determination in hyperspectral data , 1999, Optics & Photonics.

[53]  Junfeng Yang,et al.  A Fast Algorithm for Edge-Preserving Variational Multichannel Image Restoration , 2009, SIAM J. Imaging Sci..

[54]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[55]  Heiko Schwarz,et al.  Overview of the Scalable Video Coding Extension of the H.264/AVC Standard , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[56]  邵文革,et al.  Gilbert综合征二例 , 2009 .

[57]  Thomas S. Huang,et al.  Distributed Video Coding using Compressive Sampling , 2009, 2009 Picture Coding Symposium.

[58]  R. Rockafellar The multiplier method of Hestenes and Powell applied to convex programming , 1973 .

[59]  Chein-I Chang,et al.  Constrained subpixel target detection for remotely sensed imagery , 2000, IEEE Trans. Geosci. Remote. Sens..

[60]  Tony F. Chan,et al.  Total variation blind deconvolution , 1998, IEEE Trans. Image Process..

[61]  P. Lions,et al.  Image recovery via total variation minimization and related problems , 1997 .

[62]  J. Claerbout,et al.  Robust Modeling With Erratic Data , 1973 .

[63]  Donald Geman,et al.  Constrained Restoration and the Recovery of Discontinuities , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[64]  J. Boardman Automating spectral unmixing of AVIRIS data using convex geometry concepts , 1993 .

[65]  Junfeng Yang,et al.  A Fast TVL1-L2 Minimization Algorithm for Signal Reconstruction from Partial Fourier Data , 2008 .

[66]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[67]  Roland Glowinski,et al.  Constrained motion problems with applications by nonlinear programming methods , 1995 .

[68]  Thomas Strohmer,et al.  Compressed sensing radar , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[69]  Liming Zhang,et al.  A new scheme for decomposition of mixed pixels based on nonnegative matrix factorization , 2007, 2007 IEEE International Geoscience and Remote Sensing Symposium.

[70]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[71]  Trac D. Tran,et al.  Distributed Compressed Video Sensing , 2009, 2009 43rd Annual Conference on Information Sciences and Systems.

[72]  Patrick J. Flynn,et al.  A survey of approaches and challenges in 3D and multi-modal 3D + 2D face recognition , 2006, Comput. Vis. Image Underst..

[73]  R. Glowinski Lectures on Numerical Methods for Non-Linear Variational Problems , 1981 .

[74]  Paul A. Wilford,et al.  A hierarchical modulation for upgrading digital broadcast systems , 2005, IEEE Transactions on Broadcasting.

[75]  A. Bonnet,et al.  On the regularity of edges in image segmentation , 1996 .

[76]  Yin Zhang,et al.  Solving a low-rank factorization model for matrix completion by a nonlinear successive over-relaxation algorithm , 2012, Mathematical Programming Computation.

[77]  Holger Rauhut Stability Results for Random Sampling of Sparse Trigonometric Polynomials , 2008, IEEE Transactions on Information Theory.

[78]  Deanna Needell,et al.  CoSaMP: Iterative signal recovery from incomplete and inaccurate samples , 2008, ArXiv.

[79]  M. J. D. Powell,et al.  A method for nonlinear constraints in minimization problems , 1969 .

[80]  Emmanuel J. Candès,et al.  Decoding by linear programming , 2005, IEEE Transactions on Information Theory.

[81]  Tony F. Chan,et al.  Color TV: total variation methods for restoration of vector-valued images , 1998, IEEE Trans. Image Process..

[82]  Mário A. T. Figueiredo,et al.  Near-infrared hyperspectral unmixing based on a minimum volume criterion for fast and accurate chemometric characterization of counterfeit tablets. , 2010, Analytical chemistry.

[83]  L. Rabiner,et al.  Multirate digital signal processing: Prentice-Hall, Inc. Englewood Cliffs, New Jersey 07362, 1983, 411 pp., ISBN 0-13-605162-6 , 1983 .

[84]  José M. Bioucas-Dias,et al.  Two-Step Algorithms for Linear Inverse Problems with Non-Quadratic Regularization , 2007, 2007 IEEE International Conference on Image Processing.

[85]  JA Zamudio Exploring for onshore oil seeps with hyperspectral imaging , 2002 .

[86]  William W. Hager,et al.  A Nonmonotone Line Search Technique and Its Application to Unconstrained Optimization , 2004, SIAM J. Optim..

[87]  G. McCormick,et al.  The Gradient Projection Method under Mild Differentiability Conditions , 1972 .

[88]  D.S. Wills,et al.  Hyper-spectral image processing applications on the SIMD Pixel Processor for the digital battlefield , 1999, Proceedings IEEE Workshop on Computer Vision Beyond the Visible Spectrum: Methods and Applications (CVBVS'99).

[89]  José M. Bioucas-Dias,et al.  Does independent component analysis play a role in unmixing hyperspectral data? , 2005, IEEE Trans. Geosci. Remote. Sens..

[90]  Richard G. Baraniuk,et al.  Theory and Implementation of an Analog-to-Information Converter using Random Demodulation , 2007, 2007 IEEE International Symposium on Circuits and Systems.

[91]  Wotao Yin,et al.  Second-order Cone Programming Methods for Total Variation-Based Image Restoration , 2005, SIAM J. Sci. Comput..

[92]  Chong-Yung Chi,et al.  A Convex Analysis-Based Minimum-Volume Enclosing Simplex Algorithm for Hyperspectral Unmixing , 2009, IEEE Transactions on Signal Processing.

[93]  R. Glowinski,et al.  Méthodes de Lagrangien augmenté : applications à la résolution numérique de problèmes aux limites , 1982 .

[94]  Klaus Jäger,et al.  Automatic generation of 3D models from real multisensor data , 2008, 2008 11th International Conference on Information Fusion.

[95]  Michel Barlaud,et al.  Variational approach for edge-preserving regularization using coupled PDEs , 1998, IEEE Trans. Image Process..

[96]  Chong-Yung Chi,et al.  A convex analysis-based minimum-volume enclosing simplex algorithm for hyperspectral unmixing , 2009, IEEE Trans. Signal Process..

[97]  M. MarcosRaydan Convergence properties of the Barzilai and Borwein gradient method , 1991 .

[98]  P. Lions,et al.  Splitting Algorithms for the Sum of Two Nonlinear Operators , 1979 .

[99]  Chengbo Li An efficient algorithm for total variation regularization with applications to the single pixel camera and compressive sensing , 2010 .

[100]  Michael Elad,et al.  A generalized uncertainty principle and sparse representation in pairs of bases , 2002, IEEE Trans. Inf. Theory.

[101]  D. Donoho,et al.  Uncertainty principles and signal recovery , 1989 .

[102]  J. Romberg,et al.  Imaging via Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[103]  Paul H. Calamai,et al.  Projected gradient methods for linearly constrained problems , 1987, Math. Program..

[104]  Gary A. Shaw,et al.  Hyperspectral subpixel target detection using the linear mixing model , 2001, IEEE Trans. Geosci. Remote. Sens..

[105]  Balas K. Natarajan,et al.  Sparse Approximate Solutions to Linear Systems , 1995, SIAM J. Comput..

[106]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[107]  D. Donoho,et al.  Sparse MRI: The application of compressed sensing for rapid MR imaging , 2007, Magnetic resonance in medicine.

[108]  Andy M. Yip,et al.  Recent Developments in Total Variation Image Restoration , 2004 .

[109]  B. Mercier,et al.  A dual algorithm for the solution of nonlinear variational problems via finite element approximation , 1976 .

[110]  Richard G. Baraniuk,et al.  A new compressive imaging camera architecture using optical-domain compression , 2006, Electronic Imaging.

[111]  ANTONIN CHAMBOLLE,et al.  An Algorithm for Total Variation Minimization and Applications , 2004, Journal of Mathematical Imaging and Vision.

[112]  M. Fortin,et al.  Augmented Lagrangian methods : applications to the numerical solution of boundary-value problems , 1983 .

[113]  C.E. Shannon,et al.  Communication in the Presence of Noise , 1949, Proceedings of the IRE.

[114]  Bingsheng He,et al.  A new inexact alternating directions method for monotone variational inequalities , 2002, Math. Program..

[115]  Junfeng Yang,et al.  A New Alternating Minimization Algorithm for Total Variation Image Reconstruction , 2008, SIAM J. Imaging Sci..