Sequential Refined Partitioning for Probabilistic Dependence Assessment

Modeling dependence probabilistically is crucial for many applications in risk assessment and decision making under uncertainty. Neglecting dependence between multivariate uncertainties can distort model output and prevent a proper understanding of the overall risk. Whenever relevant data for quantifying and modeling dependence between uncertain variables are lacking, expert judgment might be sought to assess a joint distribution. Key challenges for the use of expert judgment for dependence modeling are over‐ and underspecification. An expert can provide assessments that are infeasible, i.e., not consistent with any probability distribution (overspecification), and on the other hand, without making very restrictive parametric assumptions an expert cannot fully define a probability distribution (underspecification). The sequential refined partitioning method addresses over‐ and underspecification while allowing for flexibility about which part of a joint distribution is assessed and its level of detail. Potential overspecification is avoided by ensuring low cognitive complexity for experts through eliciting single conditioning sets and by offering feasible assessment ranges. The feasible range of any (sequential) assessment can be derived by solving a linear programming problem. Underspecification is addressed by modeling the density of directly and indirectly assessed distribution parts as minimally informative given their constraints. Hence, our method allows for modeling the whole distribution feasibly and in accordance with experts' information. A nonparametric way of assessing and modeling dependence flexibly in such detail has not been presented in the expert judgment literature for probabilistic dependence models so far. We provide an example of assessing terrorism risk in insurance underwriting.

[1]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[2]  R. A. Leibler,et al.  On Information and Sufficiency , 1951 .

[3]  Bruno de Finetti,et al.  Logical foundations and measurement of subjective probability , 1970 .

[4]  Carl-Axel S. Staël von Holstein,et al.  Exceptional Paper---Probability Encoding in Decision Analysis , 1975 .

[5]  S. Kaplan,et al.  On The Quantitative Definition of Risk , 1981 .

[6]  Robert L. Winkler State of the Art: RESEARCH DIRECTIONS IN DECISION MAKING UNDER UNCERTAINTY* , 1982 .

[7]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[8]  R. Cooke Experts in Uncertainty: Opinion and Subjective Probability in Science , 1991 .

[9]  R. Cooke Parameter fitting for uncertain models: modelling uncertainty in small models , 1994 .

[10]  Adrianus M. H. Meeuwissen,et al.  Minimally informative distributions with given rank correlation for use in uncertainty analysis , 1997 .

[11]  R. Cooke,et al.  Procedures Guide for Structural Expert Judgement in Accident Consequence Modelling , 2000 .

[12]  P. Embrechts,et al.  Risk Management: Correlation and Dependence in Risk Management: Properties and Pitfalls , 2002 .

[13]  G. Woo Quantitative Terrorism Risk Assessment , 2002 .

[14]  Seth D. Guikema,et al.  Probabilistic Modeling of Terrorist Threats: A Systems Analysis Approach to Setting Priorities Among Countermeasures , 2002 .

[15]  Perspectives on the Use of Risk Assessment to Address Terrorism , 2002 .

[16]  B John Garrick Perspectives on the use of risk assessment to address terrorism. , 2002, Risk analysis : an official publication of the Society for Risk Analysis.

[17]  T. Bedford,et al.  Vines: A new graphical model for dependent random variables , 2002 .

[18]  The Aftermath of September 11: The Impact on and Systemic Risk to the Insurance Industry , 2003 .

[19]  Thorsten Rheinländer Risk Management: Value at Risk and Beyond , 2003 .

[20]  Detlof von Winterfeldt,et al.  Anniversary Article: Decision Analysis in Management Science , 2004, Manag. Sci..

[21]  John C. McDonald,et al.  Confronting the risks of terrorism: making the right decisions , 2004, Reliab. Eng. Syst. Saf..

[22]  M. Tribus,et al.  Probability theory: the logic of science , 2003 .

[23]  H. Kunreuther,et al.  Catastrophe modeling : a new approach to managing risk , 2013 .

[24]  Tim Bedford,et al.  Probabilistic Inversion of Expert Judgments in the Quantification of Model Uncertainty , 2005, Manag. Sci..

[25]  Gerd Gigerenzer,et al.  “A 30% Chance of Rain Tomorrow”: How Does the Public Understand Probabilistic Weather Forecasts? , 2005, Risk analysis : an official publication of the Society for Risk Analysis.

[26]  Roger M. Cooke,et al.  Uncertainty Analysis with High Dimensional Dependence Modelling: Kurowicka/Uncertainty Analysis with High Dimensional Dependence Modelling , 2006 .

[27]  J. Eric Bickel,et al.  Optimal Sequential Exploration: A Binary Learning Model , 2006, Decis. Anal..

[28]  Ali E. Abbas,et al.  Entropy methods for joint distributions in decision analysis , 2006, IEEE Transactions on Engineering Management.

[29]  Christine M. Anderson-Cook,et al.  Book review: quantitative risk management: concepts, techniques and tools, revised edition, by A.F. McNeil, R. Frey and P. Embrechts. Princeton University Press, 2015, ISBN 978-0-691-16627-8, xix + 700 pp. , 2017, Extremes.

[30]  E. Michel‐Kerjan,et al.  How Does the Corporate World Cope With Mega-Terrorism? Puzzling Evidence from Terrorism Insurance Markets , 2006 .

[31]  Detlof von Winterfeldt,et al.  Should We Protect Commercial Airplanes Against Surface-to-Air Missile Attacks by Terrorists? , 2006, Decis. Anal..

[32]  Yuval Rabani,et al.  Linear Programming , 2007, Handbook of Approximation Algorithms and Metaheuristics.

[33]  V. Bier Choosing What to Protect , 2007, Risk analysis : an official publication of the Society for Risk Analysis.

[34]  D von Winterfeldt,et al.  A Risk and Economic Analysis of Dirty Bomb Attacks on the Ports of Los Angeles and Long Beach , 2007, Risk analysis : an official publication of the Society for Risk Analysis.

[35]  George E. Apostolakis,et al.  Identification of critical locations across multiple infrastructures for terrorist actions , 2007, Reliab. Eng. Syst. Saf..

[36]  Henry H. Willis Guiding Resource Allocations Based on Terrorism Risk , 2007, Risk analysis : an official publication of the Society for Risk Analysis.

[37]  A. Clauset,et al.  On the Frequency of Severe Terrorist Events , 2006, physics/0606007.

[38]  P. Embrechts,et al.  Dependence modeling with copulas , 2007 .

[39]  L. Cox Some limitations of "Risk = Threat x Vulnerability x Consequence" for risk analysis of terrorist attacks. , 2008, Risk analysis : an official publication of the Society for Risk Analysis.

[40]  Louis Anthony Tony Cox,et al.  Some Limitations of “Risk = Threat × Vulnerability × Consequence” for Risk Analysis of Terrorist Attacks , 2008 .

[41]  Improving risk-based decision making for terrorism applications. , 2009, Risk analysis : an official publication of the Society for Risk Analysis.

[42]  Jr. Louis Anthony Cox,et al.  Game Theory and Risk Analysis , 2009 .

[43]  Adversarial Risk Analysis , 2009 .

[44]  C. Genest,et al.  The Advent of Copulas in Finance , 2009 .

[45]  Yacov Y Haimes,et al.  On the Complex Definition of Risk: A Systems‐Based Approach , 2009, Risk analysis : an official publication of the Society for Risk Analysis.

[46]  Martin Eling,et al.  Modeling and Management of Nonlinear Dependencies - Copulas in Dynamic Financial Analysis , 2009 .

[47]  Louis Anthony Cox Improving risk-based decision making for terrorism applications. , 2009, Risk analysis : an official publication of the Society for Risk Analysis.

[48]  R. Cooke,et al.  The Unholy Trinity: Fat Tails, Tail Dependence, and Micro-Correlations , 2009 .

[49]  Game Theory and Risk Analysis , 2009 .

[50]  Modeling and Management of Nonlinear Dependencies - Copulas in Dynamic Financial Analysis , 2009 .

[51]  John A. Sokolowski,et al.  Probabilistic Risk Analysis and Terrorism Risk , 2010, Risk analysis : an official publication of the Society for Risk Analysis.

[52]  A. Shapiro,et al.  National Consortium for the Study of Terrorism and Responses to Terrorism , 2010 .

[53]  D. von Winterfeldt,et al.  Identifying and Structuring the Objectives of Terrorists , 2010, Risk analysis : an official publication of the Society for Risk Analysis.

[54]  Seth D. Guikema,et al.  Assessing risk from intelligent attacks: A perspective on approaches , 2010, Reliab. Eng. Syst. Saf..

[55]  Gerald G. Brown,et al.  How Probabilistic Risk Assessment Can Mislead Terrorism Risk Analysts , 2011, Risk analysis : an official publication of the Society for Risk Analysis.

[56]  Elisabeth Paté-Cornell,et al.  On “Black Swans” and “Perfect Storms”: Risk Analysis and Management When Statistics Are Not Enough , 2012, Risk analysis : an official publication of the Society for Risk Analysis.

[57]  Terje Aven,et al.  The risk concept - historical and recent development trends , 2012, Reliab. Eng. Syst. Saf..

[58]  Jesus Rios,et al.  Adversarial Risk Analysis for Counterterrorism Modeling , 2012, Risk analysis : an official publication of the Society for Risk Analysis.

[59]  J. Eric Bickel,et al.  A Simulation-Based Approach to Decision Making with Partial Information , 2012, Decis. Anal..

[60]  J. Eric Bickel,et al.  Approximating Joint Probability Distributions Given Partial Information , 2013, Decis. Anal..

[61]  T. Bedford,et al.  On the construction of minimum information bivariate copula families , 2014 .

[62]  Tim Bedford,et al.  Assessing parameter uncertainty on coupled models using minimum information methods , 2014, Reliab. Eng. Syst. Saf..

[63]  Benjamin M. Rottman,et al.  Reasoning about causal relationships: Inferences on causal networks. , 2014, Psychological bulletin.

[64]  James V. Ray,et al.  Can callous-unemotional traits enhance the understanding, diagnosis, and treatment of serious conduct problems in children and adolescents? A comprehensive review. , 2014, Psychological bulletin.

[65]  Terje Aven,et al.  A new perspective on how to understand, assess and manage risk and the unforeseen , 2014, Reliab. Eng. Syst. Saf..

[66]  George P. Gao,et al.  Tail Risk Concerns Everywhere , 2015, Manag. Sci..

[67]  T. Aven,et al.  On the Concept and Definition of Terrorism Risk , 2015, Risk analysis : an official publication of the Society for Risk Analysis.

[68]  Gyunyoung Heo,et al.  Development of a cyber security risk model using Bayesian networks , 2015, Reliab. Eng. Syst. Saf..

[69]  C. Sempi,et al.  Principles of Copula Theory , 2015 .

[70]  Oswaldo Morales-Nápoles,et al.  Non-parametric Bayesian networks: Improving theory and reviewing applications , 2015, Reliab. Eng. Syst. Saf..

[71]  David Banks,et al.  Adversarial Risk Analysis , 2015, IWSPA@CODASPY.

[72]  J. Schreiber Foundations Of Statistics , 2016 .

[73]  Claudia Czado,et al.  Evading the curse of dimensionality in nonparametric density estimation with simplified vine copulas , 2015, J. Multivar. Anal..

[74]  M. Haugh,et al.  An Introduction to Copulas , 2016 .

[75]  F. Ramsey Truth and Probability , 2016 .

[76]  Tim Bedford,et al.  Approximate Uncertainty Modeling in Risk Analysis with Vine Copulas , 2015, Risk analysis : an official publication of the Society for Risk Analysis.

[77]  Richard S. John,et al.  Identifying and Structuring the Objectives of the Islamic State of Iraq and the Levant (ISIL) and Its Followers , 2016, Decis. Anal..

[78]  Is it Better to Elicit Quantile or Probability Judgments? A Comparison of Direct and Calibrated Procedures for Estimating a Continuous Distribution , 2017 .

[79]  John Quigley,et al.  Elicitation : The Science and Art of Structuring Judgement , 2017 .

[80]  O. M. Nápoles,et al.  Delft University of Technology Characterization of Precipitation through Copulas and Expert Judgement for Risk Assessment of Infrastructure , 2017 .

[81]  Roger M. Cooke,et al.  Expert judgement for dependence in probabilistic modelling: A systematic literature review and future research directions , 2017, Eur. J. Oper. Res..

[82]  Mark A. Burgman,et al.  IDEA for Uncertainty Quantification , 2018 .

[83]  John Quigley,et al.  Elicitation in the Classical Model , 2018 .

[84]  David Ríos Insua,et al.  Critical networked infrastructure protection from adversaries , 2016, Reliab. Eng. Syst. Saf..

[85]  John Paul Gosling,et al.  SHELF: The Sheffield Elicitation Framework , 2018 .

[86]  Oswaldo Morales-Nápoles,et al.  Eliciting Multivariate Uncertainty from Experts: Considerations and Approaches Along the Expert Judgement Process , 2018 .

[87]  Susan Maret,et al.  Global Terrorism Database , 2018 .

[88]  Asa B. Palley,et al.  Is It Better To Elicit Quantile Or Probability Judgments to Estimate a Continuous Distribution? Elicit Both and Create an Inner Crowd. , 2019 .

[89]  Xiaomeng Lu,et al.  Tail Risk Concerns Everywhere , 2019, Manag. Sci..