On Hybrid State Estimation for Stochastic Hybrid Systems

This paper considers the state estimation problem for the general continuous-time Stochastic Hybrid System (SHS) which has various applications. Defined on the hybrid state space, the SHS has the interacting discrete dynamics and continuous dynamics subject to various uncertainties. The hybrid state estimation problem is to estimate both the continuous state and the discrete state of the SHS with the information given by a continuous-time observation process. In this paper, the hybrid state estimation problem is mathematically formulated and the corresponding filtering equations that are stochastic partial differential equations are derived to describe the evolution of the hybrid state estimates conditioned on the observation history. A numerical algorithm based on a finite-difference approach is proposed to solve the filtering equations. A Markov Chain (MC) is constructed on the descretized hybrid state space to approximate the infinitesimal generator of the SHS and then hybrid state estimation for the SHS is reduced to estimating the state of the MC. It is proved that the state estimation results of the MC converge to the solution to the filtering equations as the constructed MC converges to the SHS. An illustrative example of aircraft tracking is used to demonstrate the performance of the proposed algorithm.

[1]  John Lygeros,et al.  A Stochastic Hybrid Model for Air Traffic Control Simulation , 2004, HSCC.

[2]  Alberto L. Sangiovanni-Vincentelli,et al.  Design of Observers for Hybrid Systems , 2002, HSCC.

[3]  David D. Sworder,et al.  Estimation Problems in Hybrid Systems , 1999 .

[4]  Julien Bect.  A unifying formulation of the Fokker-Planck-Kolmogorov equation for general stochastic hybrid systems , 2008 .

[5]  Xuehong Sun,et al.  Hybrid System State Tracking and Fault Detection Using Particle Filters , 2006, IEEE Transactions on Control Systems Technology.

[6]  Xenofon D. Koutsoukos,et al.  Computational Methods for Verification of Stochastic Hybrid Systems , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[7]  Brian C. Williams,et al.  Mode Estimation of Probabilistic Hybrid Systems , 2002, HSCC.

[8]  John B. Moore,et al.  Hidden Markov Models: Estimation and Control , 1994 .

[9]  Henk A. P. Blom,et al.  Stochastic differential equations on hybrid state spaces , 2006 .

[10]  John Lygeros,et al.  Towars a Theory of Stochastic Hybrid Systems , 2000, HSCC.

[11]  Inseok Hwang,et al.  Optimal sensor scheduling for hybrid estimation , 2011, Proceedings of the 2011 American Control Conference.

[12]  Xenofon D. Koutsoukos,et al.  Verification of Biochemical Processes Using Stochastic Hybrid Systems , 2007, 2007 IEEE 22nd International Symposium on Intelligent Control.

[13]  Angelo Alessandri,et al.  Design of Luenberger Observers for a Class of Hybrid Linear Systems , 2001, HSCC.

[14]  H.A.P. Blom,et al.  Particle filtering for stochastic hybrid systems , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[15]  V. Jilkov,et al.  Survey of maneuvering target tracking. Part V. Multiple-model methods , 2005, IEEE Transactions on Aerospace and Electronic Systems.

[16]  Jianghai Hu,et al.  Application of Reachability Analysis for Stochastic Hybrid Systems to Aircraft Conflict Prediction , 2008, IEEE Transactions on Automatic Control.

[17]  M. Morari,et al.  Moving horizon estimation for hybrid systems , 2002, Proceedings of the 2000 American Control Conference. ACC (IEEE Cat. No.00CH36334).

[18]  Thia Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation: Theory, Algorithms and Software , 2001 .

[19]  R. Glowinski,et al.  Approximation of the Zakai¨ equation by the splitting up method , 1990 .

[20]  Weiyi Liu,et al.  Estimation algorithm for stochastic linear hybrid systems with quadratic guard conditions , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[21]  G. Yin,et al.  Hybrid Switching Diffusions , 2010 .

[22]  Eugenio Cinquemani,et al.  Fault detection in a class of stochastic hybrid systems , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[23]  Robert J. Elliott,et al.  A finite-dimensional filter for hybrid observations , 1998, IEEE Trans. Autom. Control..

[24]  Tao Yang,et al.  Interacting multiple model-feedback particle filter for stochastic hybrid systems , 2013, 52nd IEEE Conference on Decision and Control.

[25]  J. Lygeros,et al.  General stochastic hybrid systems: modelling and optimal control , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[26]  J. J. Westman,et al.  State dependent jump models in optimal control , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[27]  S. Shankar Sastry,et al.  Modeling Subtilin Production in Bacillus subtilis Using Stochastic Hybrid Systems , 2004, HSCC.

[28]  J. Quadrat.  Numerical methods for stochastic control problems in continuous time , 1994 .

[29]  Feng Zhao,et al.  Estimation of Distributed Hybrid Systems Using Particle Filtering Methods , 2003, HSCC.

[30]  S. Rodriguez.  Wald Sequential Detection with Non-Guassian Pulsed Radar Data Using the Zakai Equation , 1990 .

[31]  X. Rong Li,et al.  Detection and Localization of Faults in System Dynamics by IMM Estimator , 1999 .

[32]  Vesselin P. Jilkov,et al.  Survey of maneuvering target tracking: III. Measurement models , 2001 .

[33]  P. Spreij.  Probability and Measure , 1996 .

[34]  João Pedro Hespanha,et al.  Stochastic Hybrid Systems: Application to Communication Networks , 2004, HSCC.

[35]  D. Crisan,et al.  Fundamentals of Stochastic Filtering , 2008 .

[36]  S. Aachen.  Stochastic Differential Equations An Introduction With Applications , 2016 .

[37]  Robert J. Elliott,et al.  Exact hybrid filters in discrete time , 1996, IEEE Trans. Autom. Control..

[38]  N. U. Ahmed,et al.  A Powerful Numerical Technique Solving Zakai Equation for Nonlinear Filtering , 1997 .

[39]  D. Laneuville,et al.  Grid Based Solution of Zakai Equation with Adaptive Local Refinement for Bearings-only Tracking , 2008, 2008 IEEE Aerospace Conference.

[40]  Akimichi Takemura,et al.  Lévy’s Zero–One Law in Game-Theoretic Probability , 2009, Journal of Theoretical Probability.

[41]  X. Rong Li,et al.  Variable-Structure Multiple-Model Approach to Fault Detection, Identification, and Estimation , 2008, IEEE Transactions on Control Systems Technology.

[42]  Jie Xiong,et al.  An Introduction to Stochastic Filtering Theory , 2008 .

[43]  Henk A. P. Blom,et al.  The continuous time roots of the Interacting Multiple Model filter , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[44]  John Lygeros,et al.  Toward a General Theory of Stochastic Hybrid Systems , 2006 .

[45]  Xenofon Koutsoukos,et al.  Estimation of hybrid systems using discrete sensors , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[46]  Inseok Hwang,et al.  Stochastic Linear Hybrid Systems: Modeling, Estimation, and Application in Air Traffic Control , 2009, IEEE Transactions on Control Systems Technology.

[47]  S. Sastry,et al.  Towars a Theory of Stochastic Hybrid Systems , 2000, HSCC.

[48]  Kenneth A. Loparo,et al.  Nonlinear filtering for systems with random structure , 1986 .