Audio Sparse Decompositions in Parallel

Greedy methods are often the only practical way to solve very large sparse approximation problems. Among such methods, matching pursuit (MP) is undoubtedly one of the most widely used, due to its simplicity and relatively low overhead. Since MP works sequentially, however, it is not straightforward to formulate it as a parallel algorithm, to take advantage of multicore platforms for real-time processing. In this article, we investigate how a slight modification of MP makes it possible to break down the decomposition into multiple local tasks, while avoiding blocking effects. Our simulations on audio signals indicate that this parallel local matching pursuit (PLoMP) gives results comparable to the original MP algorithm but could potentially run in a fraction of the time-on-the-fly sparse approximations of high-dimensional signals should soon become a reality.

[1]  Avideh Zakhor,et al.  Matching pursuit video coding .I. Dictionary approximation , 2002, IEEE Trans. Circuits Syst. Video Technol..

[2]  M. Andrecut Sparse Approximation of Computational Time Reversal Imaging , 2009 .

[3]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[4]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[5]  Mike E. Davies,et al.  Gradient Pursuits , 2008, IEEE Transactions on Signal Processing.

[6]  Louis Dunn Fielder,et al.  ISO/IEC MPEG-2 Advanced Audio Coding , 1997 .

[7]  O. Arikan,et al.  A parallelized matching pursuit algorithm for the four-parameter chirplet decomposition , 1998, Proceedings of the IEEE-SP International Symposium on Time-Frequency and Time-Scale Analysis (Cat. No.98TH8380).

[8]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[9]  Pierre Vandergheynst,et al.  A low complexity Orthogonal Matching Pursuit for sparse signal approximation with shift-invariant dictionaries , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[10]  Stephen J. Wright,et al.  Implementing Algorithms for Signal and Image Reconstruction on Graphical Processing Units , 2008 .

[11]  Y. C. Pati,et al.  Orthogonal matching pursuit: recursive function approximation with applications to wavelet decomposition , 1993, Proceedings of 27th Asilomar Conference on Signals, Systems and Computers.

[12]  Hossein Najaf-Zadeh,et al.  A Biologically-Inspired Low-Bit-Rate Universal Audio Coder , 2007 .

[13]  Rémi Gribonval,et al.  Sparse Representations in Audio and Music: From Coding to Source Separation , 2010, Proceedings of the IEEE.

[14]  Rémi Gribonval Sparse decomposition of stereo signals with Matching Pursuit and application to blind separation of more than two sources from a stereo mixture , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[15]  Richard Baraniuk,et al.  The Dual-tree Complex Wavelet Transform , 2007 .

[16]  Andreas Turk,et al.  Hierarchical parallel matching pursuit , 1994, Optics & Photonics.

[17]  Gaël Richard,et al.  Union of MDCT Bases for Audio Coding , 2008, IEEE Transactions on Audio, Speech, and Language Processing.

[18]  Touradj Ebrahimi,et al.  The JPEG 2000 still image compression standard , 2001, IEEE Signal Process. Mag..

[19]  Terence Tao,et al.  The Dantzig selector: Statistical estimation when P is much larger than n , 2005, math/0506081.

[20]  Avideh Zakhor,et al.  Matching pursuit video coding at very low bit rates , 1995, Proceedings DCC '95 Data Compression Conference.

[21]  Gabriella Dodero,et al.  A Scalable Parallel Algorithm for Matching Pusuit Signal Decomposition , 1998, HPCN Europe.

[22]  Gaël Richard,et al.  Audio Signal Representations for Indexing in the Transform Domain , 2010, IEEE Transactions on Audio, Speech, and Language Processing.

[23]  Joel A. Tropp,et al.  Greed is good: algorithmic results for sparse approximation , 2004, IEEE Transactions on Information Theory.

[24]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[25]  Emmanuel Vincent,et al.  Instrument-Specific Harmonic Atoms for Mid-Level Music Representation , 2008, IEEE Transactions on Audio, Speech, and Language Processing.

[26]  Yehoshua Y. Zeevi,et al.  Sparse ICA for blind separation of transmitted and reflected images , 2005, Int. J. Imaging Syst. Technol..

[27]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[28]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[29]  D. Gabor Acoustical Quanta and the Theory of Hearing , 1947, Nature.

[30]  Dmitry M. Malioutov,et al.  A sparse signal reconstruction perspective for source localization with sensor arrays , 2005, IEEE Transactions on Signal Processing.

[31]  A. Barron,et al.  Approximation and learning by greedy algorithms , 2008, 0803.1718.

[32]  R. Tibshirani,et al.  Least angle regression , 2004, math/0406456.

[33]  Pierre Vandergheynst,et al.  Image compression using an edge adapted redundant dictionary and wavelets , 2006, Signal Process..

[34]  Sacha Krstulovic,et al.  Mptk: Matching Pursuit Made Tractable , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.