An Optimization View of MUSIC and Its Extension to Missing Data

One of the classical approaches for estimating the frequencies and damping factors in a spectrally sparse signal is the MUltiple SIgnal Classification (MUSIC) algorithm, which exploits the low-rank structure of an autocorrelation matrix. Low-rank matrices have also received considerable attention recently in the context of optimization algorithms with partial observations. In this work, we offer a novel optimization-based perspective on the classical MUSIC algorithm that could lead to future developments and understanding. In particular, we propose an algorithm for spectral estimation that involves searching for the peaks of the dual polynomial corresponding to a certain nuclear norm minimization (NNM) problem, and we show that this algorithm is in fact equivalent to MUSIC itself. Building on this connection, we also extend the classical MUSIC algorithm to the missing data case. We provide exact recovery guarantees for our proposed algorithms and quantify how the sample complexity depends on the true spectral parameters. Simulation results also indicate that the proposed algorithms significantly outperform some relevant existing methods in frequency estimation of damped exponentials.

[1]  Jack W. Macki,et al.  Classroom Notes , 1967, The Mathematical Gazette.

[2]  Michael B. Wakin,et al.  Radar signal demixing via convex optimization , 2017, 2017 22nd International Conference on Digital Signal Processing (DSP).

[3]  Yingbo Hua,et al.  On rank of block Hankel matrix for 2-D frequency detection and estimation , 1996, IEEE Trans. Signal Process..

[4]  B. Hofmann-Wellenhof,et al.  Introduction to spectral analysis , 1986 .

[5]  Emre Ertin,et al.  Sparsity and Compressed Sensing in Radar Imaging , 2010, Proceedings of the IEEE.

[6]  F. Marvasti Nonuniform sampling : theory and practice , 2001 .

[7]  Emmanuel J. Candès,et al.  Exact Matrix Completion via Convex Optimization , 2008, Found. Comput. Math..

[8]  Stephen P. Boyd,et al.  A rank minimization heuristic with application to minimum order system approximation , 2001, Proceedings of the 2001 American Control Conference. (Cat. No.01CH37148).

[9]  Emmanuel J. Candès,et al.  Towards a Mathematical Theory of Super‐resolution , 2012, ArXiv.

[10]  Jean-Yves Tourneret,et al.  A New Frequency Estimation Method for Equally and Unequally Spaced Data , 2014, IEEE Transactions on Signal Processing.

[11]  Louis L. Scharf,et al.  Toeplitz and Hankel kernels for estimating time-varying spectra of discrete-time random processes , 2001, IEEE Trans. Signal Process..

[12]  Tapan K. Sarkar,et al.  Matrix pencil method for estimating parameters of exponentially damped/undamped sinusoids in noise , 1990, IEEE Trans. Acoust. Speech Signal Process..

[13]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[14]  Michael B. Wakin,et al.  Sampling considerations for modal analysis with damping , 2015, Smart Structures.

[15]  Wenjing Liao,et al.  MUSIC for Single-Snapshot Spectral Estimation: Stability and Super-resolution , 2014, ArXiv.

[16]  Ralph Otto Schmidt,et al.  A signal subspace approach to multiple emitter location and spectral estimation , 1981 .

[17]  Antonio J. Plaza,et al.  MUSIC-CSR: Hyperspectral Unmixing via Multiple Signal Classification and Collaborative Sparse Regression , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Parikshit Shah,et al.  Compressed Sensing Off the Grid , 2012, IEEE Transactions on Information Theory.

[19]  Dehui Yang,et al.  Atomic Norm Minimization for Modal Analysis From Random and Compressed Samples , 2017, IEEE Transactions on Signal Processing.

[20]  Mathews Jacob,et al.  Separation-Free Super-Resolution from Compressed Measurements is Possible: an Orthonormal Atomic Norm Minimization Approach , 2017, ArXiv.

[21]  R. O. Schmidt,et al.  Multiple emitter location and signal Parameter estimation , 1986 .

[22]  D. Thomson,et al.  Spectrum estimation and harmonic analysis , 1982, Proceedings of the IEEE.

[23]  Raj Rao Nadakuditi,et al.  The performance of music-based DOA in white noise with missing data , 2012, 2012 IEEE Statistical Signal Processing Workshop (SSP).

[24]  Michael B. Wakin,et al.  Atomic Norm Denoising for Complex Exponentials With Unknown Waveform Modulations , 2019, IEEE Transactions on Information Theory.

[25]  Viktor Larsson,et al.  Convex Low Rank Approximation , 2016, International Journal of Computer Vision.

[26]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[27]  Pablo A. Parrilo,et al.  The Convex Geometry of Linear Inverse Problems , 2010, Foundations of Computational Mathematics.

[28]  Jong Chul Ye,et al.  Compressive MUSIC: Revisiting the Link Between Compressive Sensing and Array Signal Processing , 2012, IEEE Transactions on Information Theory.

[29]  M. Viberg,et al.  Two decades of array signal processing research: the parametric approach , 1996, IEEE Signal Process. Mag..

[30]  Wenjing Liao MUSIC for joint frequency estimation: Stability with compressive measurements , 2014, 2014 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[31]  Srinivasan Umesh,et al.  Estimation of parameters of exponentially damped sinusoids using fast maximum likelihood estimation with application to NMR spectroscopy data , 1996, IEEE Trans. Signal Process..

[32]  Lihua Xie,et al.  Exact Joint Sparse Frequency Recovery via Optimization Methods , 2014, 1405.6585.

[33]  Jian-Feng Cai,et al.  Accelerated NMR spectroscopy with low-rank reconstruction. , 2015, Angewandte Chemie.

[34]  Gongguo Tang,et al.  Approximate support recovery of atomic line spectral estimation: A tale of resolution and precision , 2016, 2016 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[35]  Yuxin Chen,et al.  Robust Spectral Compressed Sensing via Structured Matrix Completion , 2013, IEEE Transactions on Information Theory.

[36]  Jonathan Gillard,et al.  Optimization challenges in the structured low rank approximation problem , 2013, J. Glob. Optim..

[37]  Yuejie Chi,et al.  Off-the-Grid Line Spectrum Denoising and Estimation With Multiple Measurement Vectors , 2014, IEEE Transactions on Signal Processing.

[38]  Javad Razavilar,et al.  Improved Parameter Estimation Schemes for Damped Sinusoidal Signals Based on Low-Rank Hankel Approximation , 1995 .

[39]  Sujay Sanghavi,et al.  Completing any low-rank matrix, provably , 2013, J. Mach. Learn. Res..

[40]  Zhihui Zhu,et al.  On the dimensionality of wall and target return subspaces in through-the-wall radar imaging , 2016, 2016 4th International Workshop on Compressed Sensing Theory and its Applications to Radar, Sonar and Remote Sensing (CoSeRa).

[41]  Helmut Bölcskei,et al.  Vandermonde Matrices with Nodes in the Unit Disk and the Large Sieve , 2017, Applied and Computational Harmonic Analysis.

[42]  Paul Tseng,et al.  Hankel Matrix Rank Minimization with Applications to System Identification and Realization , 2013, SIAM J. Matrix Anal. Appl..

[43]  Lei Zhang,et al.  Weighted Nuclear Norm Minimization with Application to Image Denoising , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[44]  Ken Hayami Convergence of the Conjugate Gradient Method on Singular Systems , 2018 .

[45]  Dan Kalman,et al.  The Generalized Vandermonde Matrix , 1984 .

[46]  Liangpei Zhang,et al.  Hyperspectral Image Restoration Using Low-Rank Matrix Recovery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[47]  Fredrik Andersson,et al.  Fixed-point algorithms for frequency estimation and structured low rank approximation , 2016, Applied and Computational Harmonic Analysis.