Distance measures and estimation performance bounds for continuous-time data

Recursive expressions for certain distance measures between continuous-time stationary vector-Gaussian processes are derived and used to derive upper bounds to the mean square error performance of the Bayes and maximum-likelihood estimates of a parameter, when only a finite-valued parameter set is used. The question of convergence when the true parameter value does not belong to the finite set is also answered.

[1]  T. Kailath.  The Divergence and Bhattacharyya Distance Measures in Signal Selection , 1967 .

[2]  T. Kailath.  The innovations approach to detection and estimation theory , 1970 .

[3]  D. Lainiotis.  Optimal adaptive estimation: Structure and parameter adaption , 1971 .

[4]  Jakov Snyders.  On the error matrix in optimal linear filtering of stationary processes , 1973, IEEE Trans. Inf. Theory.

[5]  Demetrios Kazakos,et al.  Spectral distance measures between continuous-time vector Gaussian processes , 1982, IEEE Trans. Inf. Theory.

[6]  Fred C. Schweppe,et al.  State Space Evaluation of the Bhattacharyya Distance between Two Gaussian Processes , 1967, Inf. Control..

[7]  H. Chernoff.  A Measure of Asymptotic Efficiency for Tests of a Hypothesis Based on the sum of Observations , 1952 .

[8]  J. L. Jackson,et al.  LINEAR FILTER OPTIMIZATION WITH GAME THEORY CONSIDERATIONS , 1955 .

[9]  Fred C. Schweppe,et al.  Evaluation of likelihood functions for Gaussian signals , 1965, IEEE Trans. Inf. Theory.

[10]  P. Papantoni-Kazakos,et al.  Spectral distance measures between Gaussian processes , 1980, ICASSP.

[11]  P. E. Caines,et al.  A Note on the Consistency of Maximum Likelihood Estimates for Finite Families of Stochastic Processes , 1975 .

[12]  Demetrios Kazakos,et al.  The Bhattacharyya distance and detection between Markov chains , 1978, IEEE Trans. Inf. Theory.

[13]  Fred C. Schweppe,et al.  On the Bhattacharyya Distance and the Divergence between Gaussian Processes , 1967, Inf. Control..

[14]  Demetrios Kazakos.  New convergence bounds for Bayes estimators , 1981, IEEE Trans. Inf. Theory.

[15]  Thomas Kailath,et al.  A general likelihood-ratio formula for random signals in Gaussian noise , 1969, IEEE Trans. Inf. Theory.

[16]  Jack Capon,et al.  Hilbert space methods for detection theory and pattern recognition , 1965, IEEE Trans. Inf. Theory.

[17]  Y. Baram,et al.  Consistent estimation on finite parameter sets with application to linear systems identification , 1978 .

[18]  D. Magill.  Optimal adaptive estimation of sampled stochastic processes , 1965 .