Bayesian Frequency Estimation

In the literature, the problem of frequency estimation is usually cast in a nonlinear parametric fashion. We show in this paper that it can also be formulated in a Bayesian nonparametric framework by assigning a uniform a priori probability distribution to the unknown frequency. We find that the covariance matrix of signal model is the discrete-time analogue of the integral operator whose eigenfunctions are the famous prolate spheroidal wave functions, introduced by Slepian and coworkers in the 1960's. Two methods are proposed to estimate the hyperparameters of the prior distribution. One uses techniques which are essentially linear from subspace identification. The other is based on Prediction Error Minimization. An explicit formula for the predictor is derived exploiting the exceptional decay property of the eigenvalues of the covariance matrix. In addition, a covariance estimation scheme is suggested assuming panel data in response to the nonergodicity of the process. The approach seems quite promising.

[1]  Barry G. Quinn,et al.  The Estimation and Tracking of Frequency , 2001 .

[2]  Jian Li,et al.  SPICE: A Sparse Covariance-Based Estimation Method for Array Processing , 2011, IEEE Transactions on Signal Processing.

[3]  D. Slepian Prolate spheroidal wave functions, fourier analysis, and uncertainty — V: the discrete case , 1978, The Bell System Technical Journal.

[4]  Alex Smola,et al.  Kernel methods in machine learning , 2007, math/0701907.

[5]  B. D. Finetti La prévision : ses lois logiques, ses sources subjectives , 1937 .

[6]  Carl E. Rasmussen,et al.  Sparse Spectrum Gaussian Process Regression , 2010, J. Mach. Learn. Res..

[7]  G. Picci,et al.  Linear Stochastic Systems: A Geometric Approach to Modeling, Estimation and Identification , 2016 .

[8]  G. Picci,et al.  A BAYESIAN NON-PARAMETRIC APPROACH TO FREQUENCY ESTIMATION , 2015 .

[9]  J. Kingman Uses of Exchangeability , 1978 .

[10]  D. Aldous Exchangeability and related topics , 1985 .

[11]  Alessandro Chiuso,et al.  Regularization and Bayesian learning in dynamical systems: Past, present and future , 2015, Annu. Rev. Control..

[12]  H. Landau,et al.  On Szegö’s eingenvalue distribution theorem and non-Hermitian kernels , 1975 .

[13]  E. C. OBI Eigenvalue Distribution of Time and Frequency Limiting , 2007 .

[14]  Kedar Khare Bandpass sampling and bandpass analogues of prolate spheroidal functions , 2006, Signal Process..

[15]  G. Picci,et al.  A SUBSPACE ALGORITHM FOR EXTRACTING PERIODIC COMPONENTS FROM MULTIVARIABLE SIGNALS IN COLORED NOISE , 2012 .

[16]  Petre Stoica,et al.  Spectral Analysis of Signals , 2009 .

[17]  Michael I. Jordan,et al.  Multiple kernel learning, conic duality, and the SMO algorithm , 2004, ICML.