Optimal condition based maintenance with imperfect information and the proportional hazards model

Condition based maintenance (CBM) is based on collecting observations over time, in order to assess equipment's state, to prevent its failure and to determine the optimal maintenance strategies. In this paper, we derive an optimal CBM replacement policy when the state of equipment is unknown but can be estimated based on observed condition. We use a proportional hazards model (PHM) to represent the system's degradation. Since equipment's state is unknown, the optimization of the optimal maintenance policy is formulated as a partially observed Markov decision process (POMDP), and the problem is solved using dynamic programming. Practical advantages of combining the PHM with the POMDP are shown.

[1]  Donald B. Rosenfield,et al.  Markovian Deterioration with Uncertain Information , 1976, Oper. Res..

[2]  W. Lovejoy.  A survey of algorithmic methods for partially observed Markov decision processes , 1991 .

[3]  T. Ibaraki,et al.  Optimal minimal-repair and replacement problem of discrete-time Markovian deterioration system under incomplete state information , 1994 .

[4]  George E. Monahan,et al.  A Survey of Partially Observable Markov Decision Processes: Theory, Models, and Algorithms , 2007 .

[5]  Edward J. Sondik,et al.  The Optimal Control of Partially Observable Markov Processes over the Infinite Horizon: Discounted Costs , 1978, Oper. Res..

[6]  D. Kumar,et al.  Proportional hazards modeling of time-dependent covariates using linear regression: a case study [mine power cable reliability] , 1996, IEEE Trans. Reliab..

[7]  P. E. Kopp,et al.  Measure, Integral and Probability , 1998 .

[8]  Edward J. Sondik,et al.  The Optimal Control of Partially Observable Markov Processes over a Finite Horizon , 1973, Oper. Res..

[9]  Diederik J.D. Wijnmalen,et al.  Optimum condition-based maintenance policies for deteriorating systems with partial information , 1996 .

[10]  Zilla Sinuany-Stern,et al.  Replacement policy under partially observed Markov process , 1993 .

[11]  Andrew K. S. Jardine,et al.  Proportional hazards analysis of diesel engine failure data , 1989 .

[12]  Bengt Klefsjö,et al.  Proportional hazards model: a review , 1994 .

[13]  Chelsea C. White,et al.  A survey of solution techniques for the partially observed Markov decision process , 1991, Ann. Oper. Res..

[14]  M. Kurano.  SEMI-MARKOV DECISION PROCESSES AND THEIR APPLICATIONS IN REPLACEMENT MODELS , 1985 .

[15]  C. White.  Optimal control-limit strategies for a partially observed replacement problem† , 1979 .

[16]  H. Mine,et al.  AN OPTIMAL INSPECTION AND REPLACEMENT POLICY FOR A DETERIORATING SYSTEM , 1986 .

[17]  X. Jiang,et al.  Optimal Replacement Under Partial Observations , 2003, Math. Oper. Res..

[18]  T. Aven,et al.  Optimal replacement times — a general set-up , 1986, Journal of Applied Probability.

[19]  Martin Newby.  Perspective on Weibull proportional-hazards models , 1994 .

[20]  Viliam Makis,et al.  A Control-Limit Policy And Software For Condition-Based Maintenance Optimization , 2001 .

[21]  W. Wang.  A model to determine the optimal critical level and the monitoring intervals in condition-based maintenance , 2000 .

[22]  Viliam Makis,et al.  Optimal Replacement In The Proportional Hazards Model , 1992 .

[23]  C. White.  Optimal Inspection and Repair of a Production Process Subject to Deterioration , 1978 .

[24]  Henk Tijms,et al.  A Markov decision algorithm for optimal inspections and revisions in a maintenance system with partial information , 1985 .

[25]  James E. Eckles,et al.  Optimum Maintenance with Incomplete Information , 1968, Oper. Res..

[26]  V. Makis,et al.  Recursive filters for a partially observable system subject to random failure , 2003, Advances in Applied Probability.

[27]  G. Monahan.  State of the Art—A Survey of Partially Observable Markov Decision Processes: Theory, Models, and Algorithms , 1982 .

[28]  Terje Aven.  Condition based replacement policiesa counting process approach , 1996 .

[29]  Ulf Westberg,et al.  Maintenance scheduling under age replacement policy using proportional hazards model and TTT-plotting , 1997 .