Observation-based Decision-making for Infrastructure

The aim of this review paper is to summarize available options for decision-support toward the optimal management of infrastructure systems under consideration of uncertainties. Thereafter, we elaborate on a particular variant, namely Partially Observable Markov Decision Processes (POMDP), as a flexible framework for the incorporation of information from observations (visual inspections, non-destructive testing and monitoring) in the context of optimal inspection and maintenance planning. Examples from the literature are presented, demonstrating the potential of planning under uncertainty and the links to the Value of Information (VoI) from Structural Health Monitoring (SHM).

[1]  Edward J. Sondik,et al.  The Optimal Control of Partially Observable Markov Processes over a Finite Horizon , 1973, Oper. Res..

[2]  Mingxiang Jiang,et al.  Modeling of risk-based inspection, maintenance and life-cycle cost with partially observable Markov decision processes , 2005 .

[3]  Yoshito Itoh,et al.  Multiobjective Optimization of Bridge Deck Rehabilitation Using a Genetic Algorithm , 1997 .

[4]  Eleni Chatzi,et al.  Maintenance planning using continuous-state partially observable Markov decision processes and non-linear action models , 2016 .

[5]  M. Shinozuka,et al.  Planning structural inspection and maintenance policies via dynamic programming and Markov processes. Part II: POMDP implementation , 2014, Reliab. Eng. Syst. Saf..

[6]  S. Ford,et al.  Using POMDP-based state estimation to enhance agent system survivability , 2005, IEEE 2nd Symposium on Multi-Agent Security and Survivability, 2005..

[7]  Hitoshi Furuta,et al.  Life-Cycle Cost Analysis for Infrastructure Systems: Life-Cycle Cost vs. Safety Level vs. Service Life , 2003 .

[8]  Rade Hajdin.  KUBA 4.0: The Swiss Road Structure Management System , 2008 .

[9]  Michael Döhler,et al.  Towards extraction of vibration-based damage indicators , 2016 .

[10]  M. H. Faber.  New Appoaches to Inspection Planning of Fatigue Damaged Offshore Platforms , 2002 .

[11]  David Heckerman,et al.  A Tutorial on Learning with Bayesian Networks , 1999, Innovations in Bayesian Networks.

[12]  R. Bellman.  A Markovian Decision Process , 1957 .

[13]  Adiel Teixeira de Almeida,et al.  A review of the use of multicriteria and multi-objective models in maintenance and reliability , 2015 .

[14]  John Dalsgaard Sørensen,et al.  Framework for Risk-based Planning of Operation and Maintenance for Offshore Wind Turbines , 2009 .

[15]  Thomas L. Saaty,et al.  Multicriteria Decision Making: The Analytic Hierarchy Process: Planning, Priority Setting, Resource Allocation , 1990 .

[16]  Ross B. Corotis,et al.  INSPECTION, MAINTENANCE, AND REPAIR WITH PARTIAL OBSERVABILITY , 1995 .

[17]  Michael I. Jordan,et al.  PEGASUS: A policy search method for large MDPs and POMDPs , 2000, UAI.

[18]  Milad Memarzadeh,et al.  Integrated Inspection Scheduling and Maintenance Planning for Infrastructure Systems , 2016, Comput. Aided Civ. Infrastructure Eng..

[19]  Daniel Straub,et al.  Value of information: A roadmap to quantifying the benefit of structural health monitoring , 2017 .

[20]  Michael Havbro Faber,et al.  On the Treatment of Uncertainties and Probabilities in Engineering Decision Analysis , 2005 .

[21]  J. M. Porta,et al.  Value iteration for continuous-state POMDPs , 2004 .

[22]  R. L. Keeney,et al.  Decisions with Multiple Objectives: Preferences and Value Trade-Offs , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[23]  Konstantinos Papakonstantinou,et al.  Probabilistic model for steel corrosion in reinforced concrete structures of large dimensions considering crack effects , 2013 .

[24]  Rade Hajdin,et al.  Bridging Data Voids: Advanced Statistical Methods for Bridge Management in KUBA , 2008 .

[25]  Craig Boutilier,et al.  VDCBPI: an Approximate Scalable Algorithm for Large POMDPs , 2004, NIPS.

[26]  Ayaho Miyamoto,et al.  Bridge Management System and Maintenance Optimization for Existing Bridges , 2000 .

[27]  R. Bellman,et al.  Dynamic Programming and Markov Processes , 1960 .

[28]  M. Shinozuka,et al.  Planning structural inspection and maintenance policies via dynamic programming and Markov processes. Part I: Theory , 2014, Reliab. Eng. Syst. Saf..

[29]  Moshe E. Ben-Akiva,et al.  Optimal Inspection and Repair Policies for Infrastructure Facilities , 1994, Transp. Sci..