Bayesian Risk Analysis

Uncertainty in the behavior of quantities of interest causes risk. Therefore statistics is used to estimate these quantities and assess their variability. Classical statistical inference does not allow to incorporate expert knowledge or to assess the influence of modeling assumptions on the resulting estimates. This is however possible when following a Bayesian approach which therefore has gained increasing attention in recent years. The advantage over a classical approach is that the uncertainty in quantities of interest can be quantified through the posterior distribution. We first introduce the Bayesian approach and illustrate its use in simple examples, including linear regression models. For more complex statistical models Markov Chain Monte Carlo methods are needed to obtain an approximate sample from the posterior distribution. Due to the increase in computing power over the last years such methods become more and more attractive for solving complex problems which are intractable using classical statistics, for instance spam e-mail filtering or the analysis of gene expression data. We illustrate why these methods work and introduce two most commonly used algorithms: the Gibbs sampler and Metropolis Hastings algorithms. Both methods are derived and applied to statistical models useful in risk analysis. In particular a Gibbs sampler is developed for a change point detection in yearly counts of events and for a regression model with time dependence, while a Metropolis Hastings algorithm is derived for modeling claim frequencies in an insurance context.

[1]  A. Brix Bayesian Data Analysis, 2nd edn , 2005 .

[2]  W. K. Hastings,et al.  Monte Carlo Sampling Methods Using Markov Chains and Their Applications , 1970 .

[3]  David P. M. Scollnik,et al.  Actuarial Modeling with MCMC and BUGs , 2001 .

[4]  J. Pickands Statistical Inference Using Extreme Order Statistics , 1975 .

[5]  Gareth O. Roberts,et al.  Convergence assessment techniques for Markov chain Monte Carlo , 1998, Stat. Comput..

[6]  R. Durrett Probability: Theory and Examples , 1993 .

[7]  W. Gilks Markov Chain Monte Carlo , 2005 .

[8]  P. Guttorp Stochastic modeling of scientific data , 1995 .

[9]  Dani Gamerman,et al.  Markov Chain Monte Carlo: Stochastic Simulation for Bayesian Inference , 1997 .

[10]  S. Frühwirth-Schnatter,et al.  Bayesian estimation of stochastic volatility models based on OU processes with marginal Gamma law , 2009 .

[11]  C. Robert,et al.  Bayesian Modeling Using WinBUGS , 2009 .

[12]  J. Berger Statistical Decision Theory and Bayesian Analysis , 1988 .

[13]  E. Nummelin General irreducible Markov chains and non-negative operators: Notes and comments , 1984 .

[14]  G. Roberts,et al.  Bayesian inference for non‐Gaussian Ornstein–Uhlenbeck stochastic volatility processes , 2004 .

[15]  Richard L. Tweedie,et al.  Markov Chains and Stochastic Stability , 1993, Communications and Control Engineering Series.

[16]  Richard L. Smith,et al.  Models for exceedances over high thresholds , 1990 .

[17]  Bradley P. Carlin,et al.  Markov Chain Monte Carlo conver-gence diagnostics: a comparative review , 1996 .

[18]  Sylvia Richardson,et al.  Markov Chain Monte Carlo in Practice , 1997 .

[19]  S. Chib,et al.  Understanding the Metropolis-Hastings Algorithm , 1995 .

[20]  David B. Dunson,et al.  Bayesian Data Analysis , 2010 .

[21]  Adrian F. M. Smith,et al.  Sampling-Based Approaches to Calculating Marginal Densities , 1990 .

[22]  H. Jeffreys A Treatise on Probability , 1922, Nature.

[23]  E. Nummelin General irreducible Markov chains and non-negative operators: List of symbols and notation , 1984 .

[24]  Adrian F. M. Smith,et al.  Hierarchical Bayesian Analysis of Changepoint Problems , 1992 .

[25]  Adrian F. M. Smith,et al.  Bayesian computation via the gibbs sampler and related markov chain monte carlo methods (with discus , 1993 .

[26]  David J. Lunn,et al.  The BUGS Book: A Practical Introduction to Bayesian Analysis , 2013 .

[27]  S. Resnick Adventures in stochastic processes , 1992 .

[28]  G. Casella,et al.  Explaining the Gibbs Sampler , 1992 .

[29]  William M. Bolstad,et al.  Introduction to Bayesian Statistics , 2004 .

[30]  Stephen P. Brooks,et al.  Assessing Convergence of Markov Chain Monte Carlo Algorithms , 2007 .

[31]  Richard L. Smith Extreme Value Analysis of Environmental Time Series: An Application to Trend Detection in Ground-Level Ozone , 1989 .

[32]  Adrian F. M. Smith,et al.  Simple conditions for the convergence of the Gibbs sampler and Metropolis-Hastings algorithms , 1994 .

[33]  Jean-Michel Marin,et al.  Bayesian Core: A Practical Approach to Computational Bayesian Statistics , 2010 .

[34]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[35]  W. M. Bolstad Introduction to Bayesian Statistics , 2004 .

[36]  Peter D. Hoff,et al.  A First Course in Bayesian Statistical Methods , 2009 .

[37]  L. Joseph,et al.  Bayesian Statistics: An Introduction , 1989 .

[38]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.