Marginally monotonic maintenance policies for a multi-state deteriorating machine with probabilistic monitoring, and silent failures

We characterize the structure of optimal policies for maintenance & replacement actions over a finite horizon. The context is machine monitoring when the following are true: 1) The machine can operate in one of N states in S/spl isin/{0,1,...,N-1} where 0 is good, 1 to N-2 represent increasing levels of deterioration (i.e., the system becomes increasingly worn, but is still able to produce usable parts), and N-1 is bad (or failed). 2) Observations are related probabilistically to the state of the process. 3) The machine's state is known with certainty only immediately after a replacement. The last assumption, consistent with "silent" failures, distinguishes our results from others. We prove [using the theory & results of partially observable Markov decision processes (POMDP)] that the policy that minimizes the total expected cost of system maintenance has a "marginally monotonic" structure. The concept of "marginal monotonicity", which requires a component-wise partial ordering, and monotonicity of the expected total cost function with respect to each component of the state space, allows characterization of the policy that minimizes the total expected cost. This feature allows us to represent the optimal policy by a collection of decision rules characterized by at most N functions.

[1]  C. White.  Optimal Inspection and Repair of a Production Process Subject to Deterioration , 1978 .

[2]  Stephen P. Brooks,et al.  Markov Decision Processes. , 1995 .

[3]  J. McCall.  Maintenance Policies for Stochastically Failing Equipment: A Survey , 1965 .

[4]  Edward J. Sondik,et al.  The Optimal Control of Partially Observable Markov Processes over a Finite Horizon , 1973, Oper. Res..

[5]  A. Shiryaev.  On Optimum Methods in Quickest Detection Problems , 1963 .

[6]  David D. Yao,et al.  Markov Decision Programming for Process Control in Batch Production , 1998, Probability in the Engineering and Informational Sciences.

[7]  Chelsea C. White,et al.  A Markov Quality Control Process Subject to Partial Observation , 1977 .

[8]  Hanan Luss,et al.  Inspection Policies for A System which Is Inoperative During Inspection Periods , 1977 .

[9]  William S. Lovejoy,et al.  Some Monotonicity Results for Partially Observed Markov Decision Processes , 1987, Oper. Res..

[10]  David J. Edwards,et al.  A comparative analysis between the multilayer perceptron “neural network” and multiple regression analysis for predicting construction plant maintenance costs , 2000 .

[11]  Julie Elaine Simmons.  Maintenance and replacement policies for a multi-state deteriorating process with probabilistic monitoring. , 1998 .

[12]  C. White.  Bounds on optimal cost for a replacement problem with partial observations , 1979 .

[13]  H. M. Taylor.  Markovian sequential replacement processes , 1965 .

[14]  Wei-Ching Wang.  Detection of process change with non-geometric failure time distribution. , 1995 .

[15]  Stephen M. Pollock,et al.  Classification of spot welds using power factor time profiles , 2001 .

[16]  C. White.  Monotone control laws for noisy, countable-state Markov chains , 1980 .

[17]  Donald B. Rosenfield,et al.  Markovian Deterioration with Uncertain Information , 1976, Oper. Res..

[18]  Kwei Tang,et al.  Using On-Line Sensors in Statistical Process Control , 1997 .

[19]  T. Ibaraki,et al.  Optimal minimal-repair and replacement problem of discrete-time Markovian deterioration system under incomplete state information , 1994 .

[20]  C. Derman.  On Sequential Decisions and Markov Chains , 1962 .

[21]  M. Klein.  Inspection—Maintenance—Replacement Schedules Under Markovian Deterioration , 1962 .

[22]  Demosthenis Teneketzis.  The decentralized quickest detection problem , 1982, 1982 21st IEEE Conference on Decision and Control.

[23]  William P. Pierskalla,et al.  A survey of maintenance models: The control and surveillance of deteriorating systems , 1976 .

[24]  G. Monahan.  State of the Art—A Survey of Partially Observable Markov Decision Processes: Theory, Models, and Algorithms , 1982 .

[25]  S. Christian Albright,et al.  Structural Results for Partially Observable Markov Decision Processes , 1979, Oper. Res..

[26]  Wallace J. Hopp,et al.  Machine Maintenance with Multiple Maintenance Actions , 1990 .

[27]  Hoang Pham,et al.  Some maintenance models and availability withimperfect maintenance in production systems , 1999, Ann. Oper. Res..

[28]  George E. Monahan,et al.  A Survey of Partially Observable Markov Decision Processes: Theory, Models, and Algorithms , 2007 .

[29]  W. Hopp,et al.  Multiaction maintenance under Markovian deterioration and incomplete state information , 1988 .

[30]  Edward J. Sondik,et al.  The Optimal Control of Partially Observable Markov Processes over the Infinite Horizon: Discounted Costs , 1978, Oper. Res..

[31]  Richard M. Feldman,et al.  A survey of preventive maintenance models for stochastically deteriorating single-unit systems , 1989 .