The MUSIC algorithm for sparse objects: a compressed sensing analysis

The multiple signal classification (MUSIC) algorithm, and its extension for imaging sparse extended objects, with noisy data is analyzed by compressed sensing (CS) techniques. A thresholding rule is developed to augment the standard MUSIC algorithm. The notion of restricted isometry property (RIP) and an upper bound on the restricted isometry constant (RIC) are employed to establish sufficient conditions for the exact localization by MUSIC with or without noise. In the noiseless case, the sufficient condition gives an upper bound on the numbers of random sampling and incident directions necessary for exact localization. In the noisy case, the sufficient condition assumes additionally an upper bound for the noise-to-object ratio in terms of the RIC and the dynamic range of objects. This bound points to the super-resolution capability of the MUSIC algorithm. Rigorous comparison of performance between MUSIC and the CS minimization principle, basis pursuit denoising (BPDN), is given. In general, the MUSIC algorithm guarantees to recover, with high probability, s scatterers with random sampling and incident directions and sufficiently high frequency. For the favorable imaging geometry where the scatterers are distributed on a transverse plane MUSIC guarantees to recover, with high probability, s scatterers with a median frequency and random sampling/incident directions. Moreover, for the problems of spectral estimation and source localizations both BPDN and MUSIC guarantee, with high probability, to identify exactly the frequencies of random signals with the number of sampling times. However, in the absence of abundant realizations of signals, BPDN is the preferred method for spectral estimation. Indeed, BPDN can identify the frequencies approximately with just one realization of signals with the recovery error at worst linearly proportional to the noise level. Numerical results confirm that BPDN outperforms MUSIC in the well-resolved case while the opposite is true for the under-resolved case, giving abundant evidence for the super-resolution capability of the MUSIC algorithm. Another advantage of MUSIC over BPDN is the former's flexibility with grid spacing and the guarantee of approximate localization of sufficiently separated objects in an arbitrarily refined grid. The localization error is bounded from above by for general configurations and by for objects distributed in a transverse plane, in line with physical intuition.

[1]  Michael Elad,et al.  From Sparse Solutions of Systems of Equations to Sparse Modeling of Signals and Images , 2009, SIAM Rev..

[2]  Thomas Strohmer,et al.  Compressed Remote Sensing of Sparse Objects , 2009, SIAM J. Imaging Sci..

[3]  Bhaskar D. Rao,et al.  Sparse solutions to linear inverse problems with multiple measurement vectors , 2005, IEEE Transactions on Signal Processing.

[4]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[5]  Claire Prada,et al.  Experimental subwavelength localization of scatterers by decomposition of the time reversal operator interpreted as a covariance matrix. , 2003, The Journal of the Acoustical Society of America.

[6]  Albert Fannjiang,et al.  Exact localization and superresolution with noisy data and random illumination , 2010, ArXiv.

[7]  Michael Elad,et al.  Stable recovery of sparse overcomplete representations in the presence of noise , 2006, IEEE Transactions on Information Theory.

[8]  Holger Rauhut Stability Results for Random Sampling of Sparse Trigonometric Polynomials , 2008, IEEE Transactions on Information Theory.

[9]  Emmanuel J. Candès,et al.  Decoding by linear programming , 2005, IEEE Transactions on Information Theory.

[10]  Margaret Cheney,et al.  The Linear Sampling Method and the MUSIC Algorithm , 2001 .

[11]  A. Devaney,et al.  Time-reversal imaging with multiple signal classification considering multiple scattering between the targets , 2004 .

[12]  Hongkai Zhao,et al.  A phase and space coherent direct imaging method. , 2009, The Journal of the Acoustical Society of America.

[13]  Davies Rémi Gribonval Restricted Isometry Constants Where Lp Sparse Recovery Can Fail for 0 , 2008 .

[14]  R. O. Schmidt,et al.  Multiple emitter location and signal Parameter estimation , 1986 .

[15]  Joel A. Tropp,et al.  ALGORITHMS FOR SIMULTANEOUS SPARSE APPROXIMATION , 2006 .

[16]  G. Stewart Error and Perturbation Bounds for Subspaces Associated with Certain Eigenvalue Problems , 1973 .

[17]  A. Fannjiang,et al.  Compressive inverse scattering: I. High-frequency SIMO/MISO and MIMO measurements , 2009, 0906.5405.

[18]  E. Candès,et al.  Near-ideal model selection by ℓ1 minimization , 2008, 0801.0345.

[19]  Joel A. Tropp,et al.  Algorithms for simultaneous sparse approximation. Part I: Greedy pursuit , 2006, Signal Process..

[20]  Restricted Isometry Constants where p sparse , 2011 .

[21]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[22]  E. Candès The restricted isometry property and its implications for compressed sensing , 2008 .

[23]  J. Devaney,et al.  1 Super-resolution Processing of Multi-static Data Using Time Reversal and MUSIC A , 2000 .

[24]  A. Kirsch The MUSIC-algorithm and the factorization method in inverse scattering theory for inhomogeneous media , 2002 .

[25]  Ekaterina Iakovleva,et al.  A MUSIC Algorithm for Locating Small Inclusions Buried in a Half-Space from the Scattering Amplitude at a Fixed Frequency , 2005, Multiscale Model. Simul..

[26]  Junfeng Yang,et al.  Alternating Direction Algorithms for 1-Problems in Compressive Sensing , 2009, SIAM J. Sci. Comput..

[27]  Anthony J. Devaney,et al.  Time-reversal-based imaging and inverse scattering of multiply scattering point targets , 2005 .

[28]  C GilbertAnna,et al.  Algorithms for simultaneous sparse approximation. Part II , 2006 .

[29]  G. Stewart,et al.  Matrix Perturbation Theory , 1990 .

[30]  A. Fannjiang,et al.  Compressive inverse scattering: II. Multi-shot SISO measurements with born scatterers , 2010 .

[31]  Rémi Gribonval,et al.  Restricted Isometry Constants Where $\ell ^{p}$ Sparse Recovery Can Fail for $0≪ p \leq 1$ , 2009, IEEE Transactions on Information Theory.

[32]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[33]  Yves Meyer,et al.  Wavelets - tools for science and technology , 1987 .

[34]  Charles W. Therrien,et al.  Discrete Random Signals and Statistical Signal Processing , 1992 .

[35]  Stéphane Jaffard,et al.  Wavelets: Tools for Science & Technology , 1987 .

[36]  N I Grinberg,et al.  The Factorization Method for Inverse Problems , 2007 .