Adaptive estimation in linear systems with unknown Markovian noise statistics

The asymptotic behavior of a Bayes optimal adaptive estimation scheme for a linear discrete-time dynamical system with unknown Markovian noise statistics is investigated. Noise influencing the state equation and the measurement equation is assumed to come from a group of Gaussian distributions having different means and covariances, with transitions from one noise source to another determined by a Markov transition matrix. The transition probability matrix is unknown and can take values only from a finite set. An example is simulated to illustrate the convergence.

[1]  R. Moose.  An adaptive state estimation solution to the maneuvering target problem , 1975 .

[2]  Hiromitsu Kumamoto,et al.  Random sampling approach to state estimation in switching environments , 1977, Autom..

[3]  K. Fu,et al.  On state estimation in switching environments , 1968 .

[4]  Demetrios G. Lainiotis,et al.  Optimal Estimation in the Presence of Unknown Parameters , 1969, IEEE Trans. Syst. Sci. Cybern..

[5]  A. Haddad,et al.  Robust state estimation in uncertain systems: Combined detection estimation with incremental MSE criterion , 1976, 1976 IEEE Conference on Decision and Control including the 15th Symposium on Adaptive Processes.

[6]  A. Jaffer,et al.  Optimal sequential estimation of discrete processes with Markov interrupted observations , 1971 .

[7]  Amin G. Jaffer,et al.  Recursive Bayesian estimation with uncertain observation (Corresp.) , 1971, IEEE Trans. Inf. Theory.

[8]  R. E. Kalman,et al.  Control System Analysis and Design Via the “Second Method” of Lyapunov: II—Discrete-Time Systems , 1960 .

[9]  R. S. Bucy.  A priori bounds for the Riccati equation , 1972 .

[10]  J. Thorp.  Optimal Tracking of Maneuvering Targets , 1973, IEEE Transactions on Aerospace and Electronic Systems.

[11]  A. Wald.  Note on the Consistency of the Maximum Likelihood Estimate , 1949 .

[12]  E. Tse.  Information matrix and local identifiability of parameters , 1973 .

[13]  G. Williams,et al.  Surveillance of several Markov targets , 1976, IEEE Trans. Inf. Theory.

[14]  A. Willsky,et al.  A generalized likelihood ratio approach to the detection and estimation of jumps in linear systems , 1976 .

[15]  Keigo Yamada.  Asymptotic behavior of posterior distributions for random processes under incorrect models , 1976 .

[16]  J. Deyst,et al.  Conditions for asymptotic stability of the discrete minimum-variance linear estimator , 1968 .

[17]  C. Shen,et al.  Bayes' decision rule for rapid detection and adaptive estimation scheme with space applications , 1974 .

[18]  Raman K. Mehra,et al.  Approaches to adaptive filtering , 1970 .

[19]  K. Ito,et al.  On State Estimation in Switching Environments , 1970 .

[20]  Rangasami L. Kashyap.  Identification of a transition matrix of a Markov chain from noisy measurements of state , 1970, IEEE Trans. Inf. Theory.

[21]  Demetrios G. Lainiotis,et al.  Partitioned estimation algorithms, I: Nonlinear estimation , 1974, Inf. Sci..

[22]  Nasser E. Nahi,et al.  Optimal recursive estimation with uncertain observation , 1969, IEEE Trans. Inf. Theory.

[23]  E. Tse,et al.  On the identifiability of parameters , 1971, CDC 1971.

[24]  D.D. Sworder,et al.  Control of systems subject to sudden change in character , 1976, Proceedings of the IEEE.

[25]  Brian D. O. Anderson,et al.  A note on bounds on solutions of the Riccati equation , 1972 .