MCMC for inference on phase-type and masked system lifetime models

Commonly reliability data consist of lifetimes (or censoring information) on all components and systems under examination. However, masked system lifetime data represents an important class of problems where the information available for statistical analysis is more limited: one only has failure times for the system as a whole, but no data on the component lifetimes directly, or even which components had failed. For example, such data can arise when system autopsy is impractical or cost prohibitive. The problem of statistical inference with such masked system lifetime data is considered in the situation where component repair is and is not possible. Continuous-time Markov chains are widely-used models for repairable systems with redundancy, with an absorbing state representing failure. The failure time is then the first passage time to the absorbing state, which is modelled by a Phase-type distribution. Bayesian inference via MCMC for Phase-type distributions when data consist only of absorption times is considered. Extensions to the existing methodology of Bladt et al. (2003) are presented which accommodate censored data, enable a structure to be imposed on the underlying continuous-time Markov process and expand computational tractability to a wider class of situations. This part of the research is also broadly applicable outside the reliability interpretation presented in this thesis. For non-repairable systems, a novel signature based data augmentation scheme is presented which enables inference for a wide class of component lifetime models for an exchangeable population of systems. It is shown that the approach can be extended to enable topological inference of the underlying system design. Finally, two R packages (‘PhaseType’ and ‘ReliabilityTheory’) are provided which enable reliability practitioners to make use of the theoretical contributions of this research easily.

[1]  J. Kalbfleisch,et al.  The Statistical Analysis of Failure Time Data , 1980 .

[2]  James P. Hobert,et al.  The Data Augmentation Algorithm: Theory and Methodology , 2011 .

[3]  Charles J. Geyer,et al.  Introduction to Markov Chain Monte Carlo , 2011 .

[4]  W. Wong,et al.  The calculation of posterior distributions by data augmentation , 1987 .

[5]  L. Devroye Non-Uniform Random Variate Generation , 1986 .

[6]  W. Gilks,et al.  Adaptive Rejection Metropolis Sampling Within Gibbs Sampling , 1995 .

[7]  Yoseph Shpungin,et al.  Network Reliability and Resilience , 2011, Springer Briefs in Electrical and Computer Engineering.

[8]  Asger Hobolth,et al.  SIMULATION FROM ENDPOINT-CONDITIONED, CONTINUOUS-TIME MARKOV CHAINS ON A FINITE STATE SPACE, WITH APPLICATIONS TO MOLECULAR EVOLUTION. , 2009, The annals of applied statistics.

[9]  Simon P. Wilson,et al.  The exponentiation formula of reliability and survival: Does it always hold? , 1995, Lifetime data analysis.

[10]  L. J. Savage The Foundations of Statistical Inference. , 1963 .

[11]  E. Kaplan,et al.  Nonparametric Estimation from Incomplete Observations , 1958 .

[12]  D. Rubin,et al.  Inference from Iterative Simulation Using Multiple Sequences , 1992 .

[13]  Marcel F. Neuts,et al.  Generating random variates from a distribution of phase type , 1981, WSC '81.

[14]  Philip Heidelberger,et al.  Simulation Run Length Control in the Presence of an Initial Transient , 1983, Oper. Res..

[15]  Christian P. Robert,et al.  Monte Carlo Statistical Methods , 2005, Springer Texts in Statistics.

[16]  Brian D. Ripley,et al.  How computing has changed statistics , 2005 .

[17]  Murali Haran,et al.  Markov chain Monte Carlo: Can we trust the third significant figure? , 2007, math/0703746.

[18]  Steven Roman Advanced Linear Algebra , 1992 .

[19]  David R. Cox,et al.  PRINCIPLES OF STATISTICAL INFERENCE , 2017 .

[20]  L. Kuo,et al.  Bayesian reliability modeling for masked system lifetime data , 2000 .

[21]  A. Cumani On the canonical representation of homogeneous markov processes modelling failure - time distributions , 1982 .

[22]  Jorge Navarro,et al.  Computations of Signatures of Coherent Systems with Five Components , 2009, Commun. Stat. Simul. Comput..

[23]  M. Neuts,et al.  On the use of phase type distributions in reliability modelling of systems with two components , 1981 .

[24]  G. Grimmett,et al.  Probability and random processes , 2002 .

[25]  M. Dehon,et al.  A geometric interpretation of the relations between the exponential and generalized Erlang distributions , 1982, Advances in Applied Probability.

[26]  John Odentrantz,et al.  Markov Chains: Gibbs Fields, Monte Carlo Simulation, and Queues , 2000, Technometrics.

[27]  G. Casella,et al.  Explaining the Gibbs Sampler , 1992 .

[28]  Yadolah Dodge,et al.  Celebrating Statistics: Papers in honour of Sir David Cox on his 80th birthday , 2005 .

[29]  A. O'Hagan,et al.  Statistical Methods for Eliciting Probability Distributions , 2005 .

[30]  Adrian F. M. Smith,et al.  Sampling-Based Approaches to Calculating Marginal Densities , 1990 .

[31]  Marvin Zelen,et al.  Mathematical Theory of Reliability , 1965 .

[32]  F. Samaniego,et al.  The signature of a coherent system and its application to comparisons among systems , 1999 .

[33]  John Geweke,et al.  Evaluating the accuracy of sampling-based approaches to the calculation of posterior moments , 1991 .

[34]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[35]  Ren Asmussen,et al.  Fitting Phase-type Distributions via the EM Algorithm , 1996 .

[36]  J. Koh,et al.  An algorithm for generating minimal cutsets of undirected graphs , 1998 .

[37]  John D. Kalbfleisch,et al.  The Statistical Analysis of Failure Data , 1986, IEEE Transactions on Reliability.

[38]  J. Kalbfleisch,et al.  The Statistical Analysis of Failure Time Data , 1980 .

[39]  Simon P. Wilson,et al.  Statistical methods in software engineering , 1999 .

[40]  John Quigley,et al.  Sensitivity analysis of a reliability system using Gaussian processes , 2008 .

[41]  R. Fisher,et al.  On the Mathematical Foundations of Theoretical Statistics , 1922 .

[42]  A. Gelman Prior distributions for variance parameters in hierarchical models (comment on article by Browne and Draper) , 2004 .

[43]  Galin L. Jones,et al.  Fixed-Width Output Analysis for Markov Chain Monte Carlo , 2006, math/0601446.

[44]  Frank M. Guess,et al.  Bayesian inference for masked system lifetime data , 1995 .

[45]  Galin L. Jones,et al.  Honest Exploration of Intractable Probability Distributions via Markov Chain Monte Carlo , 2001 .

[46]  Marcel F. Neuts,et al.  Matrix-geometric solutions in stochastic models - an algorithmic approach , 1982 .

[47]  D.,et al.  Regression Models and Life-Tables , 2022 .

[48]  Francisco J. Samaniego,et al.  Abraham Wald's Work on Aircraft Survivability , 1984 .

[49]  Steffen L. Lauritzen,et al.  The estimation of phase-type related functionals using Markov chain Monte Carlo methods , 2003 .

[50]  A. Brix Bayesian Data Analysis, 2nd edn , 2005 .

[51]  Andrew Gelman,et al.  Handbook of Markov Chain Monte Carlo , 2011 .

[52]  A. Hobolth,et al.  Summary Statistics for Endpoint-Conditioned Continuous-Time Markov Chains , 2011, Journal of Applied Probability.

[53]  Richard Wesley Butterworth A set theoretic treatment of coherent systems , 1972 .

[54]  J. Lawless,et al.  Frequentist prediction intervals and predictive distributions , 2005 .

[55]  J. Besag Spatial Interaction and the Statistical Analysis of Lattice Systems , 1974 .

[56]  Nicholas J. Higham,et al.  Functions of matrices - theory and computation , 2008 .

[57]  Avinash Agrawal,et al.  A Survey of Network Reliability and Domination Theory , 1984, Oper. Res..

[58]  Narayanaswamy Balakrishnan,et al.  Signature Representation and Preservation Results for Engineered Systems and Applications to Statistical Inference , 2012 .

[59]  Mogens Bladt,et al.  Fisher information and statistical inference for phase-type distributions , 2011, Journal of Applied Probability.

[60]  P. Green Reversible jump Markov chain Monte Carlo computation and Bayesian model determination , 1995 .

[61]  J. Rosenthal,et al.  General state space Markov chains and MCMC algorithms , 2004, math/0404033.

[62]  P. Diaconis,et al.  The cutoff phenomenon in finite Markov chains. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[63]  N. Higham Functions of Matrices: Theory and Computation (Other Titles in Applied Mathematics) , 2008 .

[64]  H. Jeffreys An invariant form for the prior probability in estimation problems , 1946, Proceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences.

[65]  Richard L. Tweedie,et al.  Markov Chains and Stochastic Stability , 1993, Communications and Control Engineering Series.

[66]  M. Neuts,et al.  Repairable models with operating and repair times governed by phase type distributions , 2000, Advances in Applied Probability.

[67]  M. A. Arcones,et al.  Nonparametric Estimation of a Distribution Subject to a Stochastic Precedence Constraint , 2002 .

[68]  Anne Berry,et al.  Generating All the Minimal Separators of a Graph , 1999, Int. J. Found. Comput. Sci..

[69]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[70]  J. Hammersley,et al.  Monte Carlo Methods , 1965 .

[71]  J. A. Bondy,et al.  Graph Theory , 2008, Graduate Texts in Mathematics.

[72]  Javier M. Moguerza,et al.  Bayesian Reliability, Availability, and Maintainability Analysis for Hardware Systems Described Through Continuous Time Markov Chains , 2010, Technometrics.

[73]  Persi Diaconis,et al.  The Markov chain Monte Carlo revolution , 2008 .

[74]  Richard E. Barlow,et al.  Statistical Theory of Reliability and Life Testing: Probability Models , 1976 .

[75]  S. Chib,et al.  Understanding the Metropolis-Hastings Algorithm , 1995 .

[76]  A. Gelman,et al.  Weak convergence and optimal scaling of random walk Metropolis algorithms , 1997 .

[77]  Z. Birnbaum,et al.  Multi-Component Systems and Structures and Their Reliability , 1961 .

[78]  Moshe Shaked,et al.  On the Comparison of Reliability Experiments Based on the Convolution Order , 2003 .

[79]  Søren Asmussen,et al.  Matrix‐analytic Models and their Analysis , 2000 .

[80]  F. Samaniego On Closure of the IFR Class Under Formation of Coherent Systems , 1985, IEEE Transactions on Reliability.

[81]  Francisco J. Samaniego,et al.  System Signatures and Their Applications in Engineering Reliability , 2007 .

[82]  George Casella,et al.  A Short History of Markov Chain Monte Carlo: Subjective Recollections from Incomplete Data , 2008, 0808.2902.

[83]  D. Cox A use of complex probabilities in the theory of stochastic processes , 1955, Mathematical Proceedings of the Cambridge Philosophical Society.

[84]  Jeremy E. Oakley,et al.  Uncertain Judgements: Eliciting Experts' Probabilities , 2006 .

[85]  Mario Vento,et al.  An Improved Algorithm for Matching Large Graphs , 2001 .

[86]  B. M. Hill,et al.  Theory of Probability , 1990 .

[87]  Pauline Coolen-Schrijner,et al.  Nonparametric predictive inference in reliability , 2002, Reliab. Eng. Syst. Saf..

[88]  Donald Geman,et al.  Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images , 1984 .

[89]  Bent Natvig,et al.  Bayesian inference based on partial monitoring of components with applications to preventive system maintenance , 2001 .

[90]  T. E. Sterne,et al.  Inverse Probability , 1930, Nature.

[91]  Cleve B. Moler,et al.  Nineteen Dubious Ways to Compute the Exponential of a Matrix, Twenty-Five Years Later , 1978, SIAM Rev..

[92]  David Lindley,et al.  Fiducial Distributions and Bayes' Theorem , 1958 .

[93]  Francisco J. Samaniego,et al.  Characterizations of the Relative Behavior of Two Systems via Properties of Their Signature Vectors , 2006 .

[94]  Gábor Csárdi,et al.  The igraph software package for complex network research , 2006 .

[95]  Creasy Problem,et al.  Reference Posterior Distributions for Bayesian Inference , 1979 .

[96]  G. C. Tiao,et al.  Bayesian inference in statistical analysis , 1973 .

[97]  Narayanaswamy Balakrishnan,et al.  Parametric inference from system lifetime data under a proportional hazard rate model , 2012 .

[98]  T. Bayes An essay towards solving a problem in the doctrine of chances , 2003 .

[99]  Frank P. A. Coolen,et al.  Nonparametric predictive inference for failure times of systems with exchangeable components , 2012 .

[100]  Edward B. Fowlkes,et al.  Risk analysis of the space shuttle: Pre-Challenger prediction of failure , 1989 .

[101]  W. K. Hastings,et al.  Monte Carlo Sampling Methods Using Markov Chains and Their Applications , 1970 .

[102]  David R. Cox,et al.  Principles of Applied Statistics , 2011 .