Filters and parameter estimation for a partially observable system subject to random failure with continuous-range observations

We consider a failure-prone system operating in continuous time. Condition monitoring is conducted at discrete time epochs. The state of the system is assumed to evolve as a continuous-time Markov process with a finite state space. The observation process with continuous-range values is stochastically related to the state process, which, except for the failure state, is unobservable. Combining the failure information and the condition monitoring information, we derive a general recursive filter, and, as special cases, we obtain recursive formulae for the state estimation and other quantities of interest. Updated parameter estimates are obtained using the expectation-maximization (EM) algorithm. Some practical prediction problems are discussed and finally an illustrative example is given using a real dataset.

[1]  Edward J. Sondik,et al.  The Optimal Control of Partially Observable Markov Processes over the Infinite Horizon: Discounted Costs , 1978, Oper. Res..

[2]  Guang-Hui Hsu,et al.  Optimal Stopping by Means of Point Process Observations with Applications in Reliability , 1993, Math. Oper. Res..

[3]  Diederik J.D. Wijnmalen,et al.  Optimum condition-based maintenance policies for deteriorating systems with partial information , 1996 .

[4]  A. H. Christer,et al.  A state space condition monitoring model for furnace erosion prediction and replacement , 1997 .

[5]  Viliam Makis,et al.  Optimal Replacement In The Proportional Hazards Model , 1992 .

[6]  Carey Bunks,et al.  CONDITION-BASED MAINTENANCE OF MACHINES USING HIDDEN MARKOV MODELS , 2000 .

[7]  S. Eddy.  Hidden Markov models. , 1996, Current opinion in structural biology.

[8]  Ari Arapostathis,et al.  Analysis of an adaptive control scheme for a partially observed controlled Markov chain , 1990 .

[9]  Shanjian Tang,et al.  General necessary conditions for partially observed optimal stochastic controls , 1995, Journal of Applied Probability.

[10]  M. Puterman,et al.  Maximum-penalized-likelihood estimation for independent and Markov-dependent mixture models. , 1992, Biometrics.

[11]  Jan Nygaard Nielsen,et al.  Parameter estimation in stochastic differential equations: An overview , 2000 .

[12]  J. Movellan.  Tutorial on Hidden Markov Models , 2006 .

[13]  P. Brémaud.  Point Processes and Queues , 1981 .

[14]  Boris Rozovskii,et al.  Recursive Nonlinear Filter for a Continuous-Discrete Time Model: Separation of Parameters and Observations , 1998 .

[15]  Terje Aven.  Condition based replacement policiesa counting process approach , 1996 .

[16]  Subhash Challa,et al.  Nonlinear filter design using Fokker-Planck-Kolmogorov probability density evolutions , 2000, IEEE Trans. Aerosp. Electron. Syst..

[17]  P. Brémaud.  Point processes and queues, martingale dynamics , 1983 .

[18]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[19]  V. Makis,et al.  Recursive filters for a partially observable system subject to random failure , 2003, Advances in Applied Probability.

[20]  Xiaoyue Jiang,et al.  A condition-based maintenance model , 1998 .

[21]  C. White.  Optimal control-limit strategies for a partially observed replacement problem† , 1979 .

[22]  Wolfgang Stadje,et al.  Maximal wearing-out of a deteriorating system: An optimal stopping approach , 1994 .