Sensitivity Analysis of Continuous Time Bayesian Network Reliability Models

We show how to perform sensitivity analysis on continuous time Bayesian networks (CTBNs) as applied specifically to reliability models. Sensitivity analysis of these models can be used, for example, to measure how uncertainty in the failure rates impact the reliability of the modeled system. The CTBN can be thought of as a type of factored Markov process that separates a system into a set of interdependent subsystems. The factorization allows CTBNs to model more complex systems than single Markov processes. However, the state-space of the CTBN is exponential in the number of subsystems. Therefore, existing methods for sensitivity analysis of Markov processes, when applied directly to the CTBN, become intractable. Sensitivity analysis of CTBNs, while borrowing from techniques for Markov processes, must be adapted to take advantage of the factored nature of the network if it is to remain feasible. To address this, we show how to extend the perturbation realization method for Markov processes to the CTBN. We...

[1]  Enrique F. Castillo,et al.  Sensitivity analysis in discrete Bayesian networks , 1997, IEEE Trans. Syst. Man Cybern. Part A.

[2]  Nir Friedman,et al.  Probabilistic Graphical Models - Principles and Techniques , 2009 .

[3]  Y. Ho,et al.  An infinitesimal perturbation analysis algorithm for a multiclass G/G/1 queue , 1990 .

[4]  Peter W. Glynn,et al.  Likelihood Ratio Sensitivity Analysis for Markovian Models of Highly Dependable Systems , 1994, Oper. Res..

[5]  Yu Fan,et al.  Learning Continuous-Time Social Network Dynamics , 2009, UAI.

[6]  C. Cassandras,et al.  Observable augmented systems for sensitivity analysis of Markov and semi-Markov processes , 1989 .

[7]  Nir Friedman,et al.  Mean Field Variational Approximation for Continuous-Time Bayesian Networks , 2009, J. Mach. Learn. Res..

[8]  Jing Xu,et al.  Intrusion Detection using Continuous Time Bayesian Networks , 2010, J. Artif. Intell. Res..

[9]  Xi-Ren Cao,et al.  Algorithms for sensitivity analysis of Markov systems through potentials and perturbation realization , 1998, IEEE Trans. Control. Syst. Technol..

[10]  Paul Glasserman,et al.  Derivative Estimates from Simulation of Continuous-Time Markov Chains , 1992, Oper. Res..

[11]  John W. Sheppard,et al.  Factored Performance Functions with Structural Representation in Continuous Time Bayesian Networks , 2014, FLAIRS.

[12]  C. Cassandras,et al.  On-line sensitivity analysis of Markov chains , 1989 .

[13]  Nir Friedman,et al.  Continuous-Time Belief Propagation , 2010, ICML.

[14]  Zikuan Liu,et al.  Single sample path-based sensitivity analysis of Markov processes using uniformization , 1999, IEEE Trans. Autom. Control..

[15]  Eric Horvitz,et al.  Continuous Time Bayesian Networks for Inferring Users’ Presence and Activities with Extensions for Modeling and Evaluation , 2003 .

[16]  Daphne Koller,et al.  Continuous Time Bayesian Networks , 2012, UAI.

[17]  Alan Weiss,et al.  Sensitivity analysis via likelihood ratios , 1986, WSC '86.

[18]  Xi-Ren Cao,et al.  Perturbation realization, potentials, and sensitivity analysis of Markov processes , 1997, IEEE Trans. Autom. Control..

[19]  John W. Sheppard,et al.  Inference Complexity in Continuous Time Bayesian Networks , 2014, UAI.

[20]  Adnan Darwiche,et al.  Sensitivity Analysis in Bayesian Networks: From Single to Multiple Parameters , 2004, UAI.

[21]  Luigi Portinale,et al.  Supporting reliability engineers in exploiting the power of Dynamic Bayesian Networks , 2010, Int. J. Approx. Reason..

[22]  Dingzhou Cao,et al.  Novel models and algorithms for systems reliability modeling and optimization , 2011 .

[23]  Y. Ho,et al.  Structural infinitesimal perturbation analysis (SIPA) for derivative estimation of discrete-event dynamic systems , 1995, IEEE Trans. Autom. Control..

[24]  C. Cassandras,et al.  An "Augmented chain " approach for on-line sensitivity analysis of Markov process , 1987, 26th IEEE Conference on Decision and Control.

[25]  Xi-Ren Cao.  Potential based sensitivity analysis of Markov chains , 1996, Proceedings of 35th IEEE Conference on Decision and Control.

[26]  Mariëlle Stoelinga,et al.  Dynamic Fault Tree Analysis Using Input/Output Interactive Markov Chains , 2007, 37th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN'07).

[27]  Yu Fan,et al.  Sampling for Approximate Inference in Continuous Time Bayesian Networks , 2008, ISAIM.

[28]  Jing Xu,et al.  Continuous Time Bayesian Network Reasoning and Learning Engine , 2010, J. Mach. Learn. Res..

[29]  Xi-Ren Cao,et al.  A single sample path-based performance sensitivity formula for Markov chains , 1996, IEEE Trans. Autom. Control..

[30]  Fabio Stella,et al.  A continuous time Bayesian network model for cardiogenic heart failure , 2012 .

[31]  Daphne Koller,et al.  Expectation Propagation for Continuous Time Bayesian Networks , 2005, UAI.

[32]  Li Xia,et al.  Relationship Between Perturbation Realization Factors With Queueing Models and Markov Models , 2006, IEEE Transactions on Automatic Control.