New Method of Sparse Parameter Estimation in Separable Models and Its Use for Spectral Analysis of Irregularly Sampled Data

Separable models occur frequently in spectral analysis, array processing, radar imaging and astronomy applications. Statistical inference methods for these models can be categorized in three large classes: parametric, nonparametric (also called “dense”) and semiparametric (also called “sparse”). We begin by discussing the advantages and disadvantages of each class. Then we go on to introduce a new semiparametric/sparse method called SPICE (a semiparametric/sparse iterative covariance-based estimation method). SPICE is computationally quite efficient, enjoys global convergence properties, can be readily used in the case of replicated measurements and, unlike most other sparse estimation methods, does not require any subtle choices of user parameters. We illustrate the statistical performance of SPICE by means of a line-spectrum estimation study for irregularly sampled data.

[1]  Jos F. Sturm,et al.  A Matlab toolbox for optimization over symmetric cones , 1999 .

[2]  Petre Stoica,et al.  Decoupled estimation of DOA and angular spread for spatially distributed sources , 1999, Conference Record of the Thirty-Third Asilomar Conference on Signals, Systems, and Computers (Cat. No.CH37020).

[3]  Gene H. Golub,et al.  The differentiation of pseudo-inverses and non-linear least squares problems whose variables separate , 1972, Milestones in Matrix Computation.

[4]  R. Paul Butler,et al.  A Pair of Resonant Planets Orbiting GJ 876 , 2001 .

[5]  Petre Stoica,et al.  Spectral analysis of nonuniformly sampled data - a review , 2010, Digit. Signal Process..

[6]  Yurii Nesterov,et al.  Interior-point polynomial algorithms in convex programming , 1994, Siam studies in applied mathematics.

[7]  Yaming Yu Monotonic convergence of a general algorithm for computing optimal designs , 2009, 0905.2646.

[8]  W. Marsden I and J , 2012 .

[9]  Björn E. Ottersten,et al.  Covariance Matching Estimation Techniques for Array Signal Processing Applications , 1998, Digit. Signal Process..

[10]  S.M. Kay,et al.  Spectrum analysis—A modern perspective , 1981, Proceedings of the IEEE.

[11]  Prabhu Babu,et al.  ANALYSIS OF RADIAL VELOCITY DATA BY A NOVEL ADAPTIVE APPROACH , 2010 .

[12]  G. Elfving Optimum Allocation in Linear Regression Theory , 1952 .

[13]  P. Bartholdi,et al.  VARIABLE STARS : WHICH NYQUIST FREQUENCY? , 1999 .

[14]  J. Scargle Studies in astronomical time series analysis. II - Statistical aspects of spectral analysis of unevenly spaced data , 1982 .

[15]  Jian Li,et al.  Source Localization and Sensing: A Nonparametric Iterative Adaptive Approach Based on Weighted Least Squares , 2010, IEEE Transactions on Aerospace and Electronic Systems.

[16]  G. Golub,et al.  Separable nonlinear least squares: the variable projection method and its applications , 2003 .

[17]  Hao He,et al.  On probing waveforms and adaptive receivers for active sonar , 2010, OCEANS 2010 MTS/IEEE SEATTLE.

[18]  J. Daniel The Conjugate Gradient Method for Linear and Nonlinear Operator Equations , 1967 .

[19]  Jian Li,et al.  Iterative Adaptive Approaches to MIMO Radar Imaging , 2010, IEEE Journal of Selected Topics in Signal Processing.

[20]  Garry Tamlyn,et al.  Music , 1993 .

[21]  Arian Maleki,et al.  Optimally Tuned Iterative Reconstruction Algorithms for Compressed Sensing , 2009, IEEE Journal of Selected Topics in Signal Processing.

[22]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[23]  Hao He,et al.  Spectral Analysis of Nonuniformly Sampled Data: A New Approach Versus the Periodogram , 2009, IEEE Transactions on Signal Processing.

[24]  Bhaskar D. Rao,et al.  Sparse signal reconstruction from limited data using FOCUSS: a re-weighted minimum norm algorithm , 1997, IEEE Trans. Signal Process..

[25]  Petre Stoica,et al.  MUSIC, maximum likelihood, and Cramer-Rao bound , 1989, IEEE Transactions on Acoustics, Speech, and Signal Processing.

[26]  Jian Li,et al.  SPICE: A Sparse Covariance-Based Estimation Method for Array Processing , 2011, IEEE Transactions on Signal Processing.

[27]  Joseph R. Guerci,et al.  Space-Time Adaptive Processing for Radar , 2003 .

[28]  Jian Li,et al.  Computationally efficient maximum-likelihood estimation of structured covariance matrices , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[29]  Petre Stoica,et al.  Spectral Analysis of Signals , 2009 .

[30]  Luc Pronzato,et al.  Optimal experimental design and some related control problems , 2008, Autom..

[31]  Jian Li,et al.  Amplitude estimation of sinusoidal signals: survey, new results, and an application , 2000, IEEE Trans. Signal Process..