A Sparsity-Based Method for the Estimation of Spectral Lines From Irregularly Sampled Data

We address the problem of estimating spectral lines from irregularly sampled data within the framework of sparse representations. Spectral analysis is formulated as a linear inverse problem, which is solved by minimizing an l1-norm penalized cost function. This approach can be viewed as a basis pursuit de-noising (BPDN) problem using a dictionary of cisoids with high frequency resolution. In the studied case, however, usual BPDN characterizations of uniqueness and sparsity do not apply. This paper deals with the l1-norm penalization of complex-valued variables, that brings satisfactory prior modeling for the estimation of spectral lines. An analytical characterization of the minimizer of the criterion is given and geometrical properties are derived about the uniqueness and the sparsity of the solution. An efficient optimization strategy is proposed. Convergence properties of the iterative coordinate descent (ICD) and iterative reweighted least-squares (IRLS) algorithms are first examined. Then, both strategies are merged in a convergent procedure, that takes advantage of the specificities of ICD and IRLS, considerably improving the convergence speed. The computation of the resulting spectrum estimator can be implemented efficiently for any sampling scheme. Algorithm performance and estimation quality are illustrated throughout the paper using an artificial data set, typical of some astrophysical problems, where sampling irregularities are caused by day/night alternation. We show that accurate frequency location is achieved with high resolution. In particular, compared with sequential Matching Pursuit methods, the proposed approach is shown to achieve more robustness regarding sampling artifacts.

[1]  Michael Elad,et al.  Stable recovery of sparse overcomplete representations in the presence of noise , 2006, IEEE Transactions on Information Theory.

[2]  Harold W. Kuhn,et al.  A note on Fermat's problem , 1973, Math. Program..

[3]  P. Tseng,et al.  Block Coordinate Relaxation Methods for Nonparametric Wavelet Denoising , 2000 .

[4]  Grant Foster,et al.  The cleanest Fourier spectrum , 1995 .

[5]  Petre Stoica,et al.  Maximum likelihood estimation of the parameters of multiple sinusoids from noisy measurements , 1989, IEEE Trans. Acoust. Speech Signal Process..

[6]  Mauricio D. Sacchi,et al.  Interpolation and extrapolation using a high-resolution discrete Fourier transform , 1998, IEEE Trans. Signal Process..

[7]  Jean-Jacques Fuchs,et al.  Recovery of exact sparse representations in the presence of bounded noise , 2005, IEEE Transactions on Information Theory.

[8]  D. H. Roberts,et al.  Time Series Analysis with Clean - Part One - Derivation of a Spectrum , 1987 .

[9]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[10]  P. Tseng Convergence of a Block Coordinate Descent Method for Nondifferentiable Minimization , 2001 .

[11]  Mário A. T. Figueiredo Adaptive Sparseness for Supervised Learning , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Joel A. Tropp,et al.  Just relax: convex programming methods for identifying sparse signals in noise , 2006, IEEE Transactions on Information Theory.

[13]  P. Bartholdi,et al.  VARIABLE STARS : WHICH NYQUIST FREQUENCY? , 1999 .

[14]  Frédéric Champagnat,et al.  A connection between half-quadratic criteria and EM algorithms , 2004, IEEE Signal Processing Letters.

[15]  David L. Donoho,et al.  Application of basis pursuit in spectrum estimation , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[16]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[17]  Peter J. Huber,et al.  Robust Statistics , 2005, Wiley Series in Probability and Statistics.

[18]  Xiaoming Huo,et al.  Uncertainty principles and ideal atomic decomposition , 2001, IEEE Trans. Inf. Theory.

[19]  Frederic Dublanchet Contribution de la methodologie bayesienne a l'analyse spectrale de raies pures et a la goniometrie haute resolution , 1996 .

[20]  Bhaskar D. Rao,et al.  Sparse signal reconstruction from limited data using FOCUSS: a re-weighted minimum norm algorithm , 1997, IEEE Trans. Signal Process..

[21]  D. F. Gray,et al.  A new approach to periodogram analyses , 1973 .

[22]  Jean-François Giovannelli,et al.  Regularized estimation of mixed spectra using a circular Gibbs-Markov model , 2001, IEEE Trans. Signal Process..

[23]  H. Sawada,et al.  On real and complex valued /spl lscr//sub 1/-norm minimization for overcomplete blind source separation , 2005, IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, 2005..

[24]  Jean-François Giovannelli,et al.  Bayesian interpretation of periodograms , 2001, IEEE Trans. Signal Process..

[25]  Jos F. Sturm,et al.  A Matlab toolbox for optimization over symmetric cones , 1999 .

[26]  Jean-Jacques Fuchs,et al.  Sparsity and uniqueness for some specific under-determined linear systems , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[27]  M. R. Osborne,et al.  A new approach to variable selection in least squares problems , 2000 .

[28]  S. Bourguignon,et al.  SparSpec: a new method for fitting multiple sinusoids with irregularly sampled data , 2007 .

[29]  Sébastien Bourguignon,et al.  REGULARIZED ESTIMATION OF LINE SPECTRA FROM IRREGULARLY SAMPLED ASTROPHYSICAL DATA , .

[30]  B. Ripley,et al.  Robust Statistics , 2018, Encyclopedia of Mathematical Geosciences.

[31]  T. Chan,et al.  On the Convergence of the Lagged Diffusivity Fixed Point Method in Total Variation Image Restoration , 1999 .

[32]  F.J.M. Barning,et al.  The numerical analysis of the light-curve of 12 lacertae : (bulletin of the astronomical institute of the netherlands, _1_7(1963), p 22-28) , 1963 .

[33]  Thomas W. Parks,et al.  Extrapolation and spectral estimation with iterative weighted norm modification , 1991, IEEE Trans. Signal Process..

[34]  Dmitry M. Malioutov,et al.  A sparse signal reconstruction perspective for source localization with sensor arrays , 2005, IEEE Transactions on Signal Processing.

[35]  R. Tibshirani,et al.  Least angle regression , 2004, math/0406456.

[36]  I. Daubechies,et al.  An iterative thresholding algorithm for linear inverse problems with a sparsity constraint , 2003, math/0307152.

[37]  New York Dover,et al.  ON THE CONVERGENCE PROPERTIES OF THE EM ALGORITHM , 1983 .

[38]  Jean-Jacques Fuchs,et al.  On sparse representations in arbitrary redundant bases , 2004, IEEE Transactions on Information Theory.

[39]  R. A. Boyles On the Convergence of the EM Algorithm , 1983 .

[40]  Stefano Alliney,et al.  An algorithm for the minimization of mixed l1 and l2 norms with application to Bayesian estimation , 1994, IEEE Trans. Signal Process..