Mapping conditional scenarios for knowledge structuring in (tail) dependence elicitation

Abstract In decision and risk analysis together with operational research methods, probabilistic modelling of uncertainties provides essential information for decision-makers. As uncertainties are typically not isolated and simplifying assumptions (such as independence) are often not justifiable, methods that model their dependence are being developed. A common challenge is that relevant historical data for specifying and quantifying a model are lacking. In this case, the dependence information should be elicited from experts. Guidance for eliciting dependence is sparse whereas particularly little research addresses the structuring of experts’ knowledge about dependence relationships prior to a quantitative elicitation. However, such preparation is crucial for developing confidence in the resulting judgements, mitigating biases and ensuring transparency, especially when assessing tail dependence. Therefore, we introduce a qualitative risk analysis method based on our definition of conditional scenarios that structures experts’ knowledge about (tail) dependence prior to its assessment. In an illustrative example, we show how to elicit conditional scenarios that support the assessment of a quantitative model for the complex risks of the UK higher education sector.

[1]  K. Wiesner,et al.  What is a complex system? , 2012, European Journal for Philosophy of Science.

[2]  J. Morecroft,et al.  System Dynamics , 2020, Systems Approaches to Making Change: A Practical Guide.

[3]  Peter Checkland,et al.  Soft Systems Methodology , 2020, Systems Approaches to Making Change: A Practical Guide.

[4]  Enrico Zio,et al.  Comprehensiveness of scenarios in the safety assessment of nuclear waste repositories , 2019, Reliab. Eng. Syst. Saf..

[5]  S. Schwarcz,et al.  Systemic Risk , 2008 .

[6]  John Quigley,et al.  Sequential Refined Partitioning for Probabilistic Dependence Assessment , 2018, Risk analysis : an official publication of the Society for Risk Analysis.

[7]  Enrico Zio,et al.  Scenario Analysis for the Safety Assessment of Nuclear Waste Repositories: A Critical Review , 2017, Risk analysis : an official publication of the Society for Risk Analysis.

[8]  John Quigley,et al.  Elicitation in the Classical Model , 2018 .

[9]  Mark A. Burgman,et al.  IDEA for Uncertainty Quantification , 2018 .

[10]  Oswaldo Morales-Nápoles,et al.  Eliciting Multivariate Uncertainty from Experts: Considerations and Approaches Along the Expert Judgement Process , 2018 .

[11]  John Quigley,et al.  Elicitation : The Science and Art of Structuring Judgement , 2017 .

[12]  Roger M. Cooke,et al.  Expert judgement for dependence in probabilistic modelling: A systematic literature review and future research directions , 2017, Eur. J. Oper. Res..

[13]  Ashraf Labib,et al.  From vicious to virtuous circles: problem structuring for quantified decision making in operationalization of corporate social responsibility , 2017, J. Oper. Res. Soc..

[14]  Kristof De Witte,et al.  Efficiency in education: a review of literature and a way forward , 2017, J. Oper. Res. Soc..

[15]  Mark A. Burgman,et al.  I nvestigate D iscuss E stimate A ggregate for structured expert judgement , 2017 .

[16]  Danielle C. Morais,et al.  Analysing the use of cognitive maps in an experiment on a group decision process , 2016, J. Oper. Res. Soc..

[17]  Mike Yearworth,et al.  Guiding interventions in a multi-organisational context: combining the Viable System Model and Hierarchical Process Modelling for use as a Problem Structuring Method , 2016, J. Oper. Res. Soc..

[18]  F. Fidler,et al.  InvestigateDiscussEstimateAggregate for structured expert judgement , 2016 .

[19]  Jill Johnes,et al.  Operational Research in education , 2015, Eur. J. Oper. Res..

[20]  Simon French,et al.  Cynefin: uncertainty, small worlds and scenarios , 2015, J. Oper. Res. Soc..

[21]  John Quigley,et al.  Systemic risk elicitation: Using causal maps to engage stakeholders and build a comprehensive view of risks , 2014, Eur. J. Oper. Res..

[22]  Donald MacKenzie,et al.  ‘The formula that killed Wall Street’: The Gaussian copula and modelling practices in investment banking , 2014, Social studies of science.

[23]  W. H. Pun,et al.  Statistical Decision Theory , 2014 .

[24]  Theodor J. Stewart,et al.  Integrating multicriteria decision analysis and scenario planning—Review and extension , 2013 .

[25]  D. Lagnado,et al.  Does the “Why” Tell Us the “When”? , 2013, Psychological science.

[26]  Fran Ackermann,et al.  Project risk: systemicity, cause mapping and a scenario approach , 2013 .

[27]  Joslin L. Moore,et al.  Improving visual estimation through active feedback , 2013 .

[28]  Ilan Yaniv,et al.  Exploiting the Wisdom of Others to Make Better Decisions: Suspending Judgment Reduces Egocentrism and Increases Accuracy , 2012 .

[29]  Elisabeth Paté-Cornell,et al.  On “Black Swans” and “Perfect Storms”: Risk Analysis and Management When Statistics Are Not Enough , 2012, Risk analysis : an official publication of the Society for Risk Analysis.

[30]  Felix Salmon The formula that killed Wall Street , 2012 .

[31]  Donald MacKenzie,et al.  ‘The Formula That Killed Wall Street’? The Gaussian Copula and the Material Cultures of Modelling , 2012 .

[32]  Jonathan Crook,et al.  Checking for asymmetric default dependence in a credit card portfolio: A copula approach , 2011 .

[33]  Yacov Y Haimes,et al.  On the Complex Definition of Risk: A Systems‐Based Approach , 2009, Risk analysis : an official publication of the Society for Risk Analysis.

[34]  P. Goodwin,et al.  Decision making and planning under low levels of predictability: enhancing the scenario method , 2009 .

[35]  Steven A. Sloman,et al.  A Causal Model Theory of the Meaning of Cause, Enable, and Prevent , 2009, Cogn. Sci..

[36]  P. Embrechts,et al.  Dependence modeling with copulas , 2007 .

[37]  P. Altbach,et al.  The Internationalization of Higher Education: Motivations and Realities , 2007 .

[38]  Peter C. Bishop,et al.  The current state of scenario development: an overview of techniques , 2007 .

[39]  Fran Ackermann,et al.  Systemic risk assessment: a case study , 2007, J. Oper. Res. Soc..

[40]  Christine M. Anderson-Cook,et al.  Book review: quantitative risk management: concepts, techniques and tools, revised edition, by A.F. McNeil, R. Frey and P. Embrechts. Princeton University Press, 2015, ISBN 978-0-691-16627-8, xix + 700 pp. , 2017, Extremes.

[41]  Roger M. Cooke,et al.  Towards a causal model for air transport safety—an ongoing research project , 2006 .

[42]  Jeremy E. Oakley,et al.  Uncertain Judgements: Eliciting Experts' Probabilities , 2006 .

[43]  Valerie Belton,et al.  Causal maps and the evaluation of decision options—a review , 2006, J. Oper. Res. Soc..

[44]  Jonathan Rosenhead,et al.  Past, present and future of problem structuring methods , 2006, J. Oper. Res. Soc..

[45]  Yacov Y Haimes,et al.  On the Definition of Vulnerabilities in Measuring Risks to Infrastructures , 2006, Risk analysis : an official publication of the Society for Risk Analysis.

[46]  L. Alberto Franco,et al.  Forms of conversation and problem structuring methods: a conceptual development , 2006, J. Oper. Res. Soc..

[47]  George Wright,et al.  The origins and evolution of scenario techniques in long range business planning , 2005 .

[48]  Ronald A. Howard,et al.  Influence Diagrams , 2005, Decis. Anal..

[49]  Clifton A. Ericson,et al.  Hazard Analysis Techniques for System Safety , 2005 .

[50]  R. Cooke,et al.  Expert judgement elicitation for risk assessments of critical infrastructures , 2004 .

[51]  Jonathan Rosenhead,et al.  Problem structuring methods in action , 2004, Eur. J. Oper. Res..

[52]  John Haigh,et al.  Probabilistic Risk Analysis: Foundations and Methods , 2003 .

[53]  David J. Mayston,et al.  Measuring and managing educational performance , 2003, J. Oper. Res. Soc..

[54]  W. Ulrich,et al.  Beyond methodology choice: critical systems thinking as critically systemic discourse , 2003, J. Oper. Res. Soc..

[55]  D. Kahneman,et al.  Heuristics and Biases: The Psychology of Intuitive Judgment , 2002 .

[56]  D. Kahneman,et al.  Representativeness revisited: Attribute substitution in intuitive judgment. , 2002 .

[57]  Howard Raiffa Decision Analysis: A Personal Account of How It Got Started and Evolved , 2002, Oper. Res..

[58]  George Wright,et al.  Expert Opinions in Forecasting: The Role of the Delphi Technique , 2001 .

[59]  Samuel E. Bodily,et al.  Structured risk management: filling a gap in decision analysis education , 2000, J. Oper. Res. Soc..

[60]  David C. Lane,et al.  Diagramming conventions in system dynamics , 2000, J. Oper. Res. Soc..

[61]  Fran Ackermann,et al.  The role of GDSS in scenario development and strategy making , 1999, 6th International Symposium on String Processing and Information Retrieval. 5th International Workshop on Groupware (Cat. No.PR00268).

[62]  R. Fildes Scenarios: The Art of Strategic Conversation , 1996, J. Oper. Res. Soc..

[63]  Alan W. Brown,et al.  Current State , 2019, ECE Energy Series.

[64]  Stan Kaplan,et al.  The Words of Risk Analysis , 1997 .

[65]  H. Schneider Failure mode and effect analysis : FMEA from theory to execution , 1996 .

[66]  Diana White,et al.  APPLICATION OF SYSTEMS THINKING TO RISK MANAGEMENT:: A REVIEW OF THE LITERATURE , 1995 .

[67]  Simon French,et al.  Uncertainty and Imprecision: Modelling and Analysis , 1995 .

[68]  F. Paul Wilson,et al.  Root Cause Analysis : A Tool for Total Quality Management , 1993 .

[69]  Ahti Salo,et al.  Forecasting with scenarios , 1993 .

[70]  John L. Anderson Horizon Mission Methodology - A tool for the study of technology innovation and new paradigms , 1993 .

[71]  Gerald Midgley,et al.  The sacred and profane in critical systems thinking , 1992 .

[72]  William J. Burns,et al.  The Social Amplification of Risk: Theoretical Foundations and Empirical Applications , 1992 .

[73]  R. Cooke Experts in Uncertainty: Opinion and Subjective Probability in Science , 1991 .

[74]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[75]  Ronald A. Howard,et al.  Knowledge Maps , 1989 .

[76]  Ross D. Shachter Probabilistic Inference and Influence Diagrams , 1988, Oper. Res..

[77]  J. Kagan,et al.  Rational choice in an uncertain world , 1988 .

[78]  R. Hogarth,et al.  Judging probable cause. , 1986 .

[79]  L. Phillips A theory of requisite decision models , 1984 .

[80]  S. Kaplan,et al.  On The Quantitative Definition of Risk , 1981 .

[81]  G. Ducot,et al.  A typology for scenarios , 1980 .

[82]  C. Churchman Operations Research as a Profession , 1970 .

[83]  H. Kahn,et al.  The Year 2000: A Framework for Speculation on the Next Thirty-Three Years, , 1967 .

[84]  Helly Grundbegriffe der Wahrscheinlichkeitsrechnung , 1936 .