Bayesian estimation for jump Markov linear systems with non-homogeneous transition probabilities

Abstract This paper considers the state estimation problem for a class of discrete-time non-homogeneous jump Markov linear systems (JMLSs), where the transition probability matrix (TPM) is assumed to be time-variant and takes value in a finite set randomly at each time step. To show the simplicity brought by the finite-valued hypothesis, the optimal recursion for the posterior TPM probability density functions conditioned on that the TPM belongs to a continuous set is firstly derived. Then, we naturally incorporate the proposed TPM estimation into the recursion of system state. Two interacting multiple-model (IMM)-type approximation stages are employed to avoid the exponential computational requirements. The resulting filter reduces to the IMM filter when the number of candidate TPMs is unity. A meaningful example is presented to illustrate the effectiveness of our method.

[1]  X. R. Li,et al.  Online Bayesian estimation of transition probabilities for Markovian jump systems , 2004, IEEE Transactions on Signal Processing.

[2]  Bruno Sinopoli,et al.  Kalman filtering with intermittent observations , 2004, IEEE Transactions on Automatic Control.

[3]  H.A.P. Blom,et al.  Exact Bayesian and particle filtering of stochastic hybrid systems , 2007, IEEE Transactions on Aerospace and Electronic Systems.

[4]  Biao Huang,et al.  Constrained Bayesian state estimation – A comparative study and a new particle filter based approach , 2010 .

[5]  Vincent Morio,et al.  Flatness-based Hypersonic Reentry Guidance of a Lifting-body Vehicle , 2009 .

[6]  Bruno Sinopoli,et al.  Kalman Filtering With Intermittent Observations: Tail Distribution and Critical Value , 2012, IEEE Transactions on Automatic Control.

[7]  X. Rong Li,et al.  Best Model Augmentation for Variable-Structure Multiple-Model Estimation , 2011, IEEE Transactions on Aerospace and Electronic Systems.

[8]  Inseok Hwang,et al.  State Estimation for Stochastic Linear Hybrid Systems with Continuous-State-Dependent Transitions: An IMM Approach , 2009 .

[9]  Giorgio Battistelli,et al.  A maximum-likelihood Kalman filter for switching discrete-time linear systems , 2010, Autom..

[10]  Liping Pang,et al.  A novel interacting multiple model algorithm , 2009, Signal Process..

[11]  Y. Bar-Shalom,et al.  The interacting multiple model algorithm for systems with Markovian switching coefficients , 1988 .

[12]  Mübeccel Demirekler,et al.  Risk-sensitive filtering for jump Markov linear systems , 2008, Autom..

[13]  P.-C. G. Vassiliou,et al.  Asymptotic behavior of Markov systems , 1982, Journal of Applied Probability.

[14]  Fei Liu,et al.  An adaptive risk-sensitive filtering method for Markov jump linear systems with uncertain parameters , 2012, J. Frankl. Inst..

[15]  Ju H. Park,et al.  Stochastic stability analysis for discrete-time singular Markov jump systems with time-varying delay and piecewise-constant transition probabilities , 2012, J. Frankl. Inst..

[16]  Ali H. Sayed,et al.  A framework for state-space estimation with uncertain models , 2001, IEEE Trans. Autom. Control..

[17]  Fei Liu,et al.  Fuzzy model-based robust H∞ filtering for a class of nonlinear nonhomogeneous Markov jump systems , 2013, Signal Process..

[18]  Agostino Capponi,et al.  A convex optimization approach to filtering in jump linear systems with state dependent transitions , 2010, Autom..

[19]  Refik Soyer,et al.  Bayesian analysis of non‐homogeneous Markov chains: Application to mental health data , 2007, Statistics in medicine.

[20]  M. De la Sen,et al.  A multimodel scheme control for a tunnel-diode trigger circuit , 2006, MELECON 2006 - 2006 IEEE Mediterranean Electrotechnical Conference.

[21]  Lixian Zhang,et al.  H∞ estimation for discrete-time piecewise homogeneous Markov jump linear systems , 2009, Autom..

[22]  Tong Zhou,et al.  Robust state estimation for uncertain discrete-time stochastic systems with missing measurements , 2010, Proceedings of the 29th Chinese Control Conference.

[23]  Vikram Krishnamurthy,et al.  An improvement to the interacting multiple model (IMM) algorithm , 2001, IEEE Trans. Signal Process..

[24]  Arie Dubi,et al.  Monte Carlo applications in systems engineering , 2000 .

[25]  Yingmin Jia,et al.  Rao-Blackwellised unscented particle filtering for jump Markov non-linear systems: an H ∞ approach , 2011 .

[26]  Xia Huang,et al.  Global exponential estimates for uncertain Markovian jump neural networks with reaction-diffusion terms , 2012 .