Sparse Approximation Using M-Term Pursuit and Application in Image and Video Coding

This paper introduces a novel algorithm for sparse approximation in redundant dictionaries called the M-term pursuit (MTP). This algorithm decomposes a signal into a linear combination of atoms that are selected in order to represent the main signal components. The MTP algorithm provides an adaptive representation for signals in any complete dictionary. The basic idea behind the MTP is to partition the dictionary into L quasi-disjoint subdictionaries. A k-term signal approximation is then iteratively computed, where each iteration leads to the selection of M ≤ L atoms based on thresholding. The MTP algorithm is shown to achieve competitive performance with the matching pursuit (MP) algorithm that greedily selects atoms one by one. This is due to efficient partitioning of the dictionary. At the same time, the computational complexity is dramatically reduced compared to MP due to the batch selection of atoms. We finally illustrate the performance of MTP in image and video compression applications, where we show that the suboptimal atom selection of MTP is largely compensated by the reduction in complexity compared with MP.

[1]  Mike E. Davies,et al.  Iterative Hard Thresholding for Compressed Sensing , 2008, ArXiv.

[2]  Deanna Needell,et al.  CoSaMP: Iterative signal recovery from incomplete and inaccurate samples , 2008, ArXiv.

[3]  T. Blumensath,et al.  Faster & greedier: algorithms for sparse reconstruction of large datasets , 2008, 2008 3rd International Symposium on Communications, Control and Signal Processing.

[4]  Olgica Milenkovic,et al.  Subspace Pursuit for Compressive Sensing Signal Reconstruction , 2008, IEEE Transactions on Information Theory.

[5]  P. Frossard,et al.  Tree-Based Pursuit: Algorithm and Properties , 2006, IEEE Transactions on Signal Processing.

[6]  Pascal Frossard,et al.  Flexible motion-adaptive video coding with redundant expansions , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Pascal Frossard,et al.  Low-rate and flexible image coding with redundant representations , 2006, IEEE Transactions on Image Processing.

[8]  Pascal Frossard,et al.  The M-term pursuit for image representation and progressive compression , 2005, IEEE International Conference on Image Processing 2005.

[9]  Joel A. Tropp,et al.  Greed is good: algorithmic results for sparse approximation , 2004, IEEE Transactions on Information Theory.

[10]  Rémi Gribonval,et al.  Sparse representations in unions of bases , 2003, IEEE Trans. Inf. Theory.

[11]  Pascal Frossard,et al.  High-flexibility scalable image coding , 2003, Visual Communications and Image Processing.

[12]  Michael Elad,et al.  Optimally sparse representation in general (nonorthogonal) dictionaries via ℓ1 minimization , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[13]  S. Mallat,et al.  Adaptive greedy approximations , 1997 .

[14]  Avideh Zakhor,et al.  Very low bit-rate video coding based on matching pursuits , 1997, IEEE Trans. Circuits Syst. Video Technol..

[15]  Gene H. Golub,et al.  Matrix computations (3rd ed.) , 1996 .

[16]  Y. C. Pati,et al.  Orthogonal matching pursuit: recursive function approximation with applications to wavelet decomposition , 1993, Proceedings of 27th Asilomar Conference on Signals, Systems and Computers.

[17]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[18]  Ingrid Daubechies,et al.  Ten Lectures on Wavelets , 1992 .

[19]  W. Marsden I and J , 2012 .

[20]  Robert H. Halstead,et al.  Matrix Computations , 2011, Encyclopedia of Parallel Computing.

[21]  Prashant Parikh A Theory of Communication , 2010 .

[22]  David L. Donoho,et al.  Sparse Solution Of Underdetermined Linear Equations By Stagewise Orthogonal Matching Pursuit , 2006 .

[23]  A. Rahmoune Image/video representation and scalable coding using redundant dictionaries , 2005 .

[24]  J. Tropp JUST RELAX: CONVEX PROGRAMMING METHODS FOR SUBSET SELECTION AND SPARSE APPROXIMATION , 2004 .

[25]  Joel A. Tropp,et al.  Topics in sparse approximation , 2004 .

[26]  Pascal Frossard,et al.  L OW RATE AND SCALABLE IMAGE CODING WITH REDUNDANT REPRESENTATIONS , 2004 .

[27]  D. Donoho,et al.  Maximal Sparsity Representation via l 1 Minimization , 2002 .

[28]  Xiaoming Huo,et al.  Sparse image representation via combined transforms , 1999 .