INSPECTION, MAINTENANCE, AND REPAIR WITH PARTIAL OBSERVABILITY

A partially observable Markov decision process (MDP) model is presented that extends beyond completely observable approaches by recognizing that inspections do not yield perfect estimates of the true internal state of system components. The approach permits the exact solution of problems whose output is inspection and maintenance policies that prescribe when to inspect, how to inspect, when to repair and how to repair, so as to minimize discounted life-cycle costs. The extension to accommodate partial observability does, however, exact a significant computational demand. The model is demonstrated with a one-lane, two-girder bridge inspection, maintenance, and repair application.

[1]  Donald B. Rosenfield,et al.  Markovian Deterioration with Uncertain Information , 1976, Oper. Res..

[2]  Moshe E. Ben-Akiva,et al.  Optimal Inspection and Repair Policies for Infrastructure Facilities , 1994, Transp. Sci..

[3]  William S. Lovejoy,et al.  Computationally Feasible Bounds for Partially Observed Markov Decision Processes , 1991, Oper. Res..

[4]  Ram B. Kulkarni,et al.  DYNAMIC DECISION MODEL FOR A PAVEMENT MANAGEMENT SYSTEM , 1984 .

[5]  Frannie Humplick,et al.  HIGHWAY PAVEMENT DISTRESS EVALUATION: MODELING MEASUREMENT ERROR , 1992 .

[6]  Timothy L. Jacobs,et al.  Optimal long term scheduling of bridge deck replacement and rehabilitation , 1992 .

[7]  James N. Eagle.  The Optimal Search for a Moving Target When the Search Path Is Constrained , 1984, Oper. Res..

[8]  Samer Madanat,et al.  OPTIMAL REHABILITATION TIMES FOR CONCRETE BRIDGE DECKS , 1993 .

[9]  Edward J. Sondik,et al.  The Optimal Control of Partially Observable Markov Processes over a Finite Horizon , 1973, Oper. Res..

[10]  Chelsea C. White,et al.  A Markov Quality Control Process Subject to Partial Observation , 1977 .

[11]  William S. Lovejoy.  Technical Note - On the Convexity of Policy Regions in Partially Observed Systems , 1987, Oper. Res..

[12]  James E. Eckles,et al.  Optimum Maintenance with Incomplete Information , 1968, Oper. Res..

[13]  W. Lovejoy.  A survey of algorithmic methods for partially observed Markov decision processes , 1991 .

[14]  Edward J. Sondik,et al.  The Optimal Control of Partially Observable Markov Processes over the Infinite Horizon: Discounted Costs , 1978, Oper. Res..

[15]  Kiran Seth,et al.  A Corrected And Improved Computational Scheme For Finite Horizon Partially Observable Markov Decision Processes , 1991 .

[16]  Karl Johan Åström,et al.  Optimal control of Markov processes with incomplete state information , 1965 .

[17]  Moshe Ben-Akiva,et al.  LATENT PERFORMANCE APPROACH TO INFRASTRUCTURE MANAGEMENT , 1991 .

[18]  G. Monahan.  State of the Art—A Survey of Partially Observable Markov Decision Processes: Theory, Models, and Algorithms , 1982 .

[19]  Samer Madanat.  Incorporating inspection decisions in pavement management , 1993 .

[20]  Kumares C. Sinha,et al.  APPLICATION OF DYNAMIC PROGRAMMING AND OTHER MATHEMATICAL TECHNIQUES TO PAVEMENT MANAGEMENT SYSTEMS , 1988 .

[21]  Moshe Ben-Akiva,et al.  Infrastructure management under uncertainty: Latent performance approach , 1993 .

[22]  Ross B. Corotis,et al.  Reliability-Based Structural Design with Markov Decision Processes , 1995 .

[23]  James V. Carnahan.  Analytical Framework for Optimizing Pavement Maintenance , 1988 .

[24]  J. Satia,et al.  Markovian Decision Processes with Probabilistic Observation of States , 1973 .

[25]  Frannie Humplick.  IDENTIFYING ERROR-GENERATING FACTORS IN INFRASTRUCTURE CONDITION EVALUATIONS (WITH DISCUSSION AND CLOSURE) , 1992 .

[26]  Chelsea C. White,et al.  Solution Procedures for Partially Observed Markov Decision Processes , 1989, Oper. Res..

[27]  Edward J. Sondik,et al.  The optimal control of par-tially observable Markov processes , 1971 .

[28]  Robert C. Wang,et al.  OPTIMAL REPLACEMENT POLICY WITH UNOBSERVABLE STATES , 1977 .

[29]  Samuel H Carpenter,et al.  PAVEMENT PERFORMANCE PREDICTION MODEL USING THE MARKOV PROCESS , 1987 .

[30]  Wayne J. Davis,et al.  Optimal maintenance decisions for pavement management , 1987 .

[31]  Moshe Ben-Akiva,et al.  ESTIMATION OF HIGHWAY PAVEMENT DETERIORATION FROM IN-SERVICE PAVEMENT DATA , 1990 .

[32]  Moshe E. Ben-Akiva,et al.  An Approach for Predicting Latent Infrastructure Facility Deterioration , 1993, Transp. Sci..