Guided Probabilistic Simulation of Complex Systems Toward Rare and Extreme Events

Simulation-based or dynamic probabilistic risk assessment methodologies were primarily developed for proving a more realistic and complete representation of complex systems accident response. Such simulation-based methodologies have proven to be particularly powerful for systems with control loops and complex interactions between its elements, be they hardware, software, or human, as they provide a natural probabilistic environment to include physical models of system behavior (e.g., coupled neutronics and thermal-hydraulic codes for nuclear power plants), mechanistic models of materials or hardware systems to predict failure, and those of natural hazards. Despite the advancements in simulation-based methodologies, the fundamental challenge still persists as the space of possible probabilistic system trajectories is nearly infinite in size in simulating even systems of relatively low complexity. Existing methodologies that analyze and predict these scenarios, some of which may involve rare events of interest, are either computationally prohibitive for the high-dimensional systems of interest or are only effective for low-dimensional dynamics and cannot capture the large-scale, nonlinear behavior of interconnected complex systems. In this paper, a framework is developed to identify rare and extreme events and enabling the use of reverse trajectories to trace failures (or other system states) to causes for potential mitigation actions. This framework consists of an Intelligent Guidance module, Trajectory Generation module and Physical Simulation module. The Intelligent Guidance module provides planning information to the Trajectory Generation module that creates scenarios by interacting with the Physical Simulation in its environment. In turn, system trajectories or scenarios are created and post-processed to provide updating information to the Intelligent Guidance module or aggregate the results when stopping criteria are met. The objective of guided simulation is to control the growth of the “scenario tree” and to efficiently identify important scenarios that meet single or multiple criteria. We present several solution strategies, both qualitative and data-driven for each module.

[1]  M. Mesbahi,et al.  Formation flying control of multiple spacecraft via graphs, matrix inequalities, and switching , 1999, Proceedings of the 1999 IEEE International Conference on Control Applications (Cat. No.99CH36328).

[2]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[3]  Tarannom Parhizkar,et al.  Degradation based operational optimization model to improve the productivity of energy systems, case study: Solid oxide fuel cell stacks , 2018 .

[4]  E.M. Atkins,et al.  A survey of consensus problems in multi-agent coordination , 2005, Proceedings of the 2005, American Control Conference, 2005..

[5]  Vincent P. Manno,et al.  Diagnostic entropy: a quantitative measure of the effects of signal incompleteness on system diagnosis , 1994 .

[6]  Michael W. Golay,et al.  Use of information theory with discrete models of continuous systems , 2008, Int. J. Gen. Syst..

[7]  Andrea Alfonsi,et al.  RAVEN and Dynamic Probabilistic Risk Assessment: Software overview , 2014 .

[8]  Ramin Roshandel,et al.  A new approach to optimize the operating conditions of a polymer electrolyte membrane fuel cell based on degradation mechanisms , 2013 .

[9]  Yuguo Chen,et al.  Network reliability analysis with link and nodal weights and auxiliary nodes , 2017 .

[10]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[11]  Tom Schaul,et al.  Deep Q-learning From Demonstrations , 2017, AAAI.

[12]  Yadollah Saboohi,et al.  Efficient performance monitoring of building central heating system using Bayesian Network method , 2019 .

[13]  J. Devooght,et al.  Probabilistic Reactor Dynamics —I: The Theory of Continuous Event Trees , 1992 .

[14]  Ramin Roshandel,et al.  Degradation based optimization framework for long term applications of energy systems, case study: Solid oxide fuel cell stacks , 2016 .

[15]  Tarannom Parhizkar,et al.  Evaluation and improvement of energy consumption prediction models using principal component analysis based feature reduction , 2021 .

[16]  Frank J. Groen,et al.  An Entropy-Based Exploration Strategy in Dynamic PRA , 2004 .

[17]  Carol-Sophie Smidts,et al.  Probabilistic reactor dynamics. II: A Monte Carlo study of a fast reactor transient , 1992 .

[18]  Karen Willcox,et al.  Model Reduction for Large-Scale Systems with High-Dimensional Parametric Input Space , 2008, SIAM J. Sci. Comput..

[19]  Ümit V. Çatalyürek,et al.  Development of a code-agnostic computational infrastructure for the dynamic generation of accident progression event trees , 2010, Reliab. Eng. Syst. Saf..

[20]  A. E. Ferdinand A THEORY OF SYSTEM COMPLEXITY , 1974 .

[21]  Jan Erik Vinnem,et al.  Data driven approach to risk management and decision support for dynamic positioning systems , 2020, Reliab. Eng. Syst. Saf..

[22]  Jan Erik Vinnem,et al.  Supervised dynamic probabilistic risk assessment of complex systems, part 2: Application to risk-informed decision making, practice and results , 2021, Reliab. Eng. Syst. Saf..

[23]  Jan Erik Vinnem,et al.  Supervised Dynamic Probabilistic Risk Assessment of Complex Systems, Part 1: General Overview , 2021, Reliab. Eng. Syst. Saf..

[24]  Paolo Gardoni,et al.  Integration of physical infrastructure and social systems in communities' reliability and resilience analysis , 2019, Reliab. Eng. Syst. Saf..

[25]  Ramin Roshandel,et al.  Long term performance degradation analysis and optimization of anode supported solid oxide fuel cell stacks , 2017 .

[26]  Peihui Lin,et al.  Stochastic post-disaster functionality recovery of community building portfolios I: Modeling , 2017 .

[27]  Oliver C. Ibe,et al.  Markov processes for stochastic modeling , 2008 .

[28]  Tom Schaul,et al.  Rainbow: Combining Improvements in Deep Reinforcement Learning , 2017, AAAI.

[29]  Majid Amidpour,et al.  Aging based design and operation optimization of organic rankine cycle systems , 2019, Energy Conversion and Management.

[30]  Alex Graves,et al.  Playing Atari with Deep Reinforcement Learning , 2013, ArXiv.

[31]  Derek Gaston,et al.  MOOSE: A parallel computational framework for coupled systems of nonlinear equations , 2009 .

[32]  Ali Mosleh,et al.  Guided simulation for dynamic probabilistic risk assessment of complex systems: Concept, method, and application , 2022, Reliab. Eng. Syst. Saf..

[33]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[34]  Nikolaos Kazantzis,et al.  Model reduction and coarse-graining approaches for multiscale phenomena , 2006 .

[35]  Jan Erik Vinnem,et al.  Dynamic probabilistic risk assessment of decision-making in emergencies for complex systems, case study: Dynamic positioning drilling unit , 2021 .

[36]  Magnus Egerstedt,et al.  Controllability of Multi-Agent Systems from a Graph-Theoretic Perspective , 2009, SIAM J. Control. Optim..

[37]  Yadollah Saboohi,et al.  Efficient health monitoring of buildings using failure modes and effects analysis case study: Air handling unit system , 2020 .

[38]  Ali Mosleh,et al.  Hierarchical planning and multi-level scheduling for simulation-based probabilistic risk assessment , 2007, 2007 Winter Simulation Conference.