Cynefin: uncertainty, small worlds and scenarios

Uncertainty, its modelling and analysis have been discussed across many literatures including statistics and operational research, knowledge management and philosophy: (i) adherents to Bayesian approaches have usually argued that uncertainty should either be modelled by probabilities or resolved by discussion that clarifies meaning; (ii) some have followed Knight in distinguishing between contexts of risk and of uncertainty: the former admitting modelling and analysis through probability; the latter not; (iii) there are also host of approaches in the literatures stemming from Zadeh’s concept of a fuzzy set; (iv) theories of sense-making in the philosophy and management literatures see knowledge and uncertainty as opposite extremes of human understanding and discuss the resolution of uncertainty accordingly. Here I provide a personal perspective, taking a Bayesian stance. However, I adopt a softer position than conventional and recognise the concerns in other approaches. In particular, I use the Cynefin framework of decision contexts to reflect on processes of modelling and analysis in statistical, risk and decision analysis. The approach builds on several recent strands of discussion that argue for a convergence of qualitative scenario planning ideas and more quantitative approaches to analysis. I discuss how these suggestions and discussions relate to some earlier thinking on the methodology of modelling and, in particular, the concept of a ‘small world’ articulated by Savage.

[1]  David J Spiegelhalter,et al.  Don't know, can't know: embracing deeper uncertainties when analysing risks , 2011, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[2]  Lutz E. Schlange Scenarios: The art of strategic conversation , 1997 .

[3]  C. Churchman,et al.  The design of inquiring systems: basic concepts of systems and organization , 1971 .

[4]  Robert Fildes Scenarios: The Art of Strategic Conversation , 1998, J. Oper. Res. Soc..

[5]  David Snowden,et al.  The First Age: Information for Decision Support 1995: the Transition to the Second Age Complex Acts of Knowing: Paradox and Descriptive Self-awareness , 2022 .

[6]  Samuel Holtzman,et al.  Intelligent decision systems , 1988 .

[7]  Jonathan Rosenhead,et al.  Rational Analysis for a Problematic World Revisited , 2001 .

[8]  A. P. Dawid,et al.  Parameter inference for stochastic kinetic models of bacterial gene regulation : a Bayesian approach to systems biology , 2010 .

[9]  George Wright,et al.  Future‐focussed thinking: combining scenario planning with decision analysis , 1999 .

[10]  L. Phillips A theory of requisite decision models , 1984 .

[11]  Rebecca A. Kelly,et al.  A formal framework for scenario development in support of environmental decision-making , 2009, Environ. Model. Softw..

[12]  S. French Decision Theory: An Introduction to the Mathematics of Rationality , 1986 .

[13]  S Rios Decision Theory and Decision Analysis: Trends and Challenges , 1997 .

[14]  Louis Anthony Cox,et al.  Confronting Deep Uncertainties in Risk Analysis , 2012, Risk analysis : an official publication of the Society for Risk Analysis.

[15]  Simon French,et al.  Modelling, making inferences and making decisions: The roles of sensitivity analysis , 2003 .

[16]  N. McGlynn Thinking fast and slow. , 2014, Australian veterinary journal.

[17]  Ramon J. Aldag,et al.  Decision Making: A Psychological Analysis of Conflict , 1980 .

[18]  M. Braga,et al.  Exploratory Data Analysis , 2018, Encyclopedia of Social Network Analysis and Mining. 2nd Ed..

[19]  Theodor J. Stewart,et al.  Integrating multicriteria decision analysis and scenario planning—Review and extension , 2013 .

[20]  Yogesh Kumar Dwivedi,et al.  A profile of OR research and practice published in the Journal of the Operational Research Society , 2010, J. Oper. Res. Soc..

[21]  Simon French,et al.  Aggregating expert judgement , 2011 .

[22]  J. Lygeros,et al.  Decision Making I , 2014 .

[23]  P. Schoemaker MULTIPLE SCENARIO DEVELOPMENT: ITS CONCEPTUAL AND BEHAVIORAL FOUNDATION , 1993 .

[24]  Jerzy Neyman,et al.  Proceedings of the Third Berkeley Symposium on Mathematical Statistics and Probability : held at the Statistical Laboratory, University of California, December, 1954, July and August, 1955 , 1958 .

[25]  Alec Morton,et al.  Extending the use of scenario planning and MCDA for the evaluation of strategic options , 2011, J. Oper. Res. Soc..

[26]  H. Bandemer Savage, L. J.: Foundations of Statistics. Dover Publ., Inc,. New York 1972. 310 S. , 1974 .

[27]  Simon French,et al.  Believe in the Model: Mishandle the Emergency , 2005 .

[28]  Simon French,et al.  Decision Behaviour, Analysis and Support , 2009 .

[29]  Cynthia F. Kurtz,et al.  The new dynamics of strategy: sense-making in a complex and complicated world , 2003, IEEE Engineering Management Review.

[30]  J. Schreiber Foundations Of Statistics , 2016 .

[31]  C. Goodeve Operational Research , 1948, Nature.

[32]  T. Kuhn,et al.  The Structure of Scientific Revolutions. , 1964 .

[33]  S. French On the axiomatisation of subjective probabilities , 1982 .

[34]  G. Shafer Savage revisited , 1990 .

[35]  L. J. Savage,et al.  The Foundations of Statistics , 1955 .

[36]  I. Janis,et al.  Decision Making: A Psychological Analysis of Conflict, Choice, and Commitment , 1977 .

[37]  Simon French,et al.  Towards a constructive approach to act-conditional subjective expected utility models , 1997 .

[38]  F. Knight The economic nature of the firm: From Risk, Uncertainty, and Profit , 2009 .

[39]  Michael Pidd,et al.  Tools for Thinking—Modelling in Management Science , 1997 .

[40]  Simon French,et al.  Decision analytic perspectives on nuclear sustainability , 2010 .

[41]  Simon French,et al.  A Perspective on Recent Developments in Utility Theory , 1994 .

[42]  Simon French,et al.  Uncertainty and Imprecision: Modelling and Analysis , 1995 .

[43]  Astrid Maute,et al.  Expert Knowledge and Multivariate Emulation: The Thermosphere–Ionosphere Electrodynamics General Circulation Model (TIE-GCM) , 2009, Technometrics.

[44]  H. Carr Tractatus Logico-Philosophicus , 1923, Nature.

[45]  Simon French,et al.  Cynefin, statistics and decision analysis , 2013, J. Oper. Res. Soc..

[46]  Elizabeth C. Hirschman,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[47]  G. C. Tiao,et al.  Bayesian inference in statistical analysis , 1973 .

[48]  Russell L. Ackoff,et al.  Scientific Method: Optimizing Applied Research Decisions , 1963 .

[49]  M. Goldstein,et al.  Bayesian policy support for adaptive strategies using computer models for complex physical systems , 2012, J. Oper. Res. Soc..

[50]  G. Burt,et al.  Towards the integration of system modelling with scenario planning to support strategy: the case of the UK energy industry , 2011, J. Oper. Res. Soc..

[51]  A. Tversky,et al.  Foundations of Measurement, Vol. I: Additive and Polynomial Representations , 1991 .

[52]  Gilberto Montibeller,et al.  Combining scenario planning and multi-criteria decision analysis in practice , 2006 .

[53]  E. Barankin Toward an Objectivistic Theory of Probability , 1956 .

[54]  James O. Berger,et al.  External Bayesian analysis for computer simulators , 2010 .

[55]  James H. Lambert,et al.  Scenario‐based multiple criteria analysis for infrastructure policy impacts and planning , 2011 .

[56]  Detlof von Winterfeldt,et al.  Advances in decision analysis : from foundations to applications , 2007 .

[57]  Simon French,et al.  E-Democracy: A Group Decision and Negotiation Perspective , 2010 .

[58]  D. Kahneman Thinking, Fast and Slow , 2011 .

[59]  M. Kane Measurement theory. , 1980, NLN publications.

[60]  Anthony J. Culyer,et al.  Problem Structuring Methods , 2014 .

[61]  A. OHagan,et al.  Bayesian analysis of computer code outputs: A tutorial , 2006, Reliab. Eng. Syst. Saf..

[62]  Peter Checkland,et al.  Soft Systems Methodology , 2020, Systems Approaches to Making Change: A Practical Guide.

[63]  W. H. Pun,et al.  Statistical Decision Theory , 2014 .

[64]  N. Chater,et al.  Précis of Bayesian Rationality: The Probabilistic Approach to Human Reasoning , 2009, Behavioral and Brain Sciences.

[65]  Alice H. Eagly,et al.  Heuristic and systematic information processing within and beyond the persuasion context. , 1989 .

[66]  Jaap Van Brakel,et al.  Foundations of measurement , 1983 .

[67]  M. Weggeman Sensemaking in organisations , 1996 .

[68]  Robert F. Bordley,et al.  Nonlinear utility models arising from unmodelled small world intercorrelations , 1992 .

[69]  Francisco J. Samaniego,et al.  The Practice of Bayesian Analysis , 1999, Technometrics.

[70]  L. Alberto Franco,et al.  Taking problem structuring methods forward , 2007, J. Oper. Res. Soc..

[71]  Michael W. Nicholson,et al.  Rational Analysis for a Problematic World , 1990 .

[72]  L. Alberto Franco,et al.  Problem structuring methods: new directions in a problematic world , 2006, J. Oper. Res. Soc..