State estimation and detectability of probabilistic discrete event systems

A probabilistic discrete event system (PDES) is a nondeterministic discrete event system where the probabilities of nondeterministic transitions are specified. State estimation problems of PDES are more difficult than those of non-probabilistic discrete event systems. In our previous papers, we investigated state estimation problems for non-probabilistic discrete event systems. We defined four types of detectabilities and derived necessary and sufficient conditions for checking these detectabilities. In this paper, we extend our study to state estimation problems for PDES by considering the probabilities. The first step in our approach is to convert a given PDES into a nondeterministic discrete event system and find sufficient conditions for checking probabilistic detectabilities. Next, to find necessary and sufficient conditions for checking probabilistic detectabilities, we investigate the "convergence" of event sequences in PDES. An event sequence is convergent if along this sequence, it is more and more certain that the system is in a particular state. We derive conditions for convergence and hence for detectabilities. We focus on systems with complete event observation and no state observation. For better presentation, the theoretical development is illustrated by a simplified example of nephritis diagnosis.

[1]  John B. Moore,et al.  On adaptive HMM state estimation , 1998, IEEE Trans. Signal Process..

[2]  S. Lafortune,et al.  On tolerable and desirable behaviors in supervisory control of discrete event systems , 1990, 29th IEEE Conference on Decision and Control.

[3]  P. Ramadge,et al.  Modular Supervisory Control of Discrete Event Systems , 1988 .

[4]  Arnaud Doucet,et al.  Stochastic sampling algorithms for state estimation of jump Markov linear systems , 2000, IEEE Trans. Autom. Control..

[5]  Jamie S. Evans,et al.  Hidden Markov model state estimation with randomly delayed observations , 1999, IEEE Trans. Signal Process..

[6]  A. Willsky,et al.  Observability of discrete event dynamic systems , 1990 .

[7]  Feng Lin,et al.  On-line control of partially observed discrete event systems , 1994, Discret. Event Dyn. Syst..

[8]  Walter Murray Wonham,et al.  On observability of discrete-event systems , 1988, Inf. Sci..

[9]  Azaria Paz,et al.  Introduction to Probabilistic Automata , 1971 .

[10]  Feng Lin,et al.  Detectability of Discrete Event Systems , 2007, IEEE Transactions on Automatic Control.

[11]  Christophe Andrieu,et al.  Iterative algorithms for optimal state estimation of jump Markov linear systems , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[12]  J. G. Thistle,et al.  Control of Infinite Behavior of Finite Automata , 1994 .

[13]  Mark A. Shayman,et al.  Formulae relating controllability, observability, and co-observability , 1998, Autom..

[14]  Vikram Krishnamurthy,et al.  Optimal sensor scheduling for Hidden Markov models , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[15]  Christos G. Cassandras,et al.  Introduction to Discrete Event Systems , 1999, The Kluwer International Series on Discrete Event Dynamic Systems.

[16]  Feng Lin,et al.  Why Event Observation: Observability Revisited , 1997, Discret. Event Dyn. Syst..

[17]  W. M. Wonham,et al.  The control of discrete event systems , 1989 .

[18]  Robin J. Evans,et al.  State estimation for Markov switching systems with modal observations , 1997, Proceedings of the 36th IEEE Conference on Decision and Control.

[19]  P. Ramadge,et al.  Supervisory control of a class of discrete event processes , 1987 .

[20]  C. Desclaux,et al.  Supervisory control of discrete-event processes with partial observations , 1988 .

[21]  W. M. Wonham,et al.  Modular supervisory control of discrete-event systems , 1988, Math. Control. Signals Syst..

[22]  Malcolm Irving,et al.  Markov chains for multipartitioning large power system state estimation networks , 1998 .