Kullback-Leibler approximation of spectral density functions

We introduce a Kullback-Leibler type distance between spectral density functions of stationary stochastic processes and solve the problem of optimal approximation of a given spectral density /spl Psi/ by one that is consistent with prescribed second-order statistics. In particular, we show (i) that there is a unique spectral density /spl Phi/ which minimizes this Kullback-Leibler distance, (ii) that this optimal approximate is of the form /spl Psi//Q where the "correction term" Q is a rational spectral density function, and (iii) that the coefficients of Q can be obtained numerically by solving a suitable convex optimization problem. In the special case where /spl Psi/=1, the convex functional becomes quadratic and the solution is then specified by linear equations.

[1]  S. Haykin Nonlinear Methods of Spectral Analysis , 1980 .

[2]  Tryphon T. Georgiou,et al.  A new approach to spectral estimation: a tunable high-resolution spectral estimator , 2000, IEEE Trans. Signal Process..

[3]  I. Good Maximum Entropy for Hypothesis Formulation, Especially for Multidimensional Contingency Tables , 1963 .

[4]  K. Hoffman Banach Spaces of Analytic Functions , 1962 .

[5]  Anders Lindquist,et al.  A Convex Optimization Approach to Generalized Moment Problems , 2003 .

[6]  Tryphon T. Georgiou,et al.  Spectral analysis based on the state covariance: the maximum entropy spectrum and linear fractional parametrization , 2002, IEEE Trans. Autom. Control..

[7]  Ryozo Nagamune A robust solver using a continuation method for Nevanlinna-Pick interpolation with degree constraint , 2003, IEEE Trans. Autom. Control..

[8]  P. Enqvist A homotopy approach to rational covariance extension with degree constraint , 2001 .

[9]  Tryphon T. Georgiou,et al.  Spectral estimation via selective harmonic amplification , 2001, IEEE Trans. Autom. Control..

[10]  C. Byrnes,et al.  A Convex Optimization Approach to the Rational Covariance Extension Problem , 1999 .

[11]  Tryphon T. Georgiou,et al.  A generalized entropy criterion for Nevanlinna-Pick interpolation with degree constraint , 2001, IEEE Trans. Autom. Control..

[12]  I. Csiszár $I$-Divergence Geometry of Probability Distributions and Minimization Problems , 1975 .

[13]  Anders Lindquist,et al.  From Finite Covariance Windows to Modeling Filters: A Convex Optimization Approach , 2001, SIAM Rev..