Risk and resilience for unknown, unquantifiable, systemic, and unlikely/catastrophic threats

Risk and resilience are important paradigms for analyzing and guiding decisions about uncertain threats. Resilience has sometimes been favored for threats that are unknown, unquantifiable, systemic, and unlikely/catastrophic. This paper addresses the suitability of each paradigm for such threats, finding that they are comparably suitable. Threats are rarely completely unknown or unquantifiable; what limited information is typically available enables the use of both paradigms. Either paradigm can in practice mishandle systemic or unlikely/catastrophic threats, but this is inadequate implementation of the paradigms, not inadequacy of the paradigms themselves. Three examples are described: (a) Venice in the Black Death plague, (b) artificial intelligence (AI), and (c) extraterrestrials. The Venice example suggests effectiveness for each paradigm for certain unknown, unquantifiable, systemic, and unlikely/catastrophic threats. The AI and extraterrestrials examples suggest how increasing resilience may be less effective, and reducing threat probability may be more effective, for certain threats that are significantly unknown, unquantifiable, and unlikely/catastrophic.

[1]  Terje Aven,et al.  On Some Recent Definitions and Analysis Frameworks for Risk, Vulnerability, and Resilience , 2011, Risk analysis : an official publication of the Society for Risk Analysis.

[2]  Y. Haimes,et al.  A Survey of Approaches for Assessing and Managing the Risk of Extremes , 1999 .

[3]  G. Lemarchand Contact with Alien Civilizations: Our Hopes and Fears about Encountering Extraterrestrials, M.A.G. Michaud. Copernicus Books, New York (2007), (xiii+460 pp., $27.50, ISBN:0-387-28598-9) , 2007 .

[4]  Igor Linkov,et al.  Measurable resilience for actionable policy. , 2013, Environmental science & technology.

[5]  Joy Bill,et al.  Why the future doesn’t need us , 2003 .

[6]  Jason G Matheny,et al.  Reducing the Risk of Human Extinction , 2007, Risk analysis : an official publication of the Society for Risk Analysis.

[7]  钟琦,et al.  Nature Climate Change政策和市场关注要览 , 2011 .

[8]  Collectif Advances in Computers , 2015 .

[9]  Seth D. Baum,et al.  Adaptation to and Recovery from Global Catastrophe , 2013 .

[10]  M. Ćirković Small Theories and Large Risks—Is Risk Analysis Relevant for Epistemology? , 2012, Risk analysis : an official publication of the Society for Risk Analysis.

[11]  Karim Jebari,et al.  Existential Risks: Exploring a Robust Risk Reduction Strategy , 2014, Science and Engineering Ethics.

[12]  Igor Linkov,et al.  Resilience metrics for cyber systems , 2013, Environment Systems and Decisions.

[13]  I. Linkov,et al.  Integrating Risk and Resilience Approaches to Catastrophe Management in Engineering Systems , 2013, Risk analysis : an official publication of the Society for Risk Analysis.

[14]  Amnon H. Eden,et al.  Singularity Hypotheses: A Scientific and Philosophical Assessment , 2013 .

[15]  E. Weber Experience-Based and Description-Based Perceptions of Long-Term Risk: Why Global Warming does not Scare us (Yet) , 2006 .

[16]  I. J. Good,et al.  Speculations Concerning the First Ultraintelligent Machine , 1965, Adv. Comput..

[17]  M. A. Michaud Contact with Alien Civilizations , 2007 .

[18]  Zachary A. Collier,et al.  Metrics for energy resilience , 2014 .

[19]  Yacov Y Haimes,et al.  On the Definition of Resilience in Systems , 2009, Risk analysis : an official publication of the Society for Risk Analysis.

[20]  Eliezer Yudkowsky,et al.  Complex Value Systems in Friendly AI , 2011, AGI.

[21]  S. Baum,et al.  Would contact with extraterrestrials benefit or harm humanity? A scenario analysis , 2011, 1104.4462.

[22]  S. G. Wallenhorst The Drake Equation Reexamined , 1981 .

[23]  Christopher W. Karvetski,et al.  Flood Protection Diversification to Reduce Probabilities of Extreme Losses , 2012, Risk analysis : an official publication of the Society for Risk Analysis.

[24]  Nick Bostrom,et al.  Future progress in artificial intelligence: a poll among experts , 2014, SIGAI.

[25]  James H. Lambert,et al.  Diversification of infrastructure projects for emergent and unknown non‐systematic risks , 2011 .

[26]  I. Linkov,et al.  Changing the resilience paradigm , 2014 .

[27]  M. Zoback,et al.  Disaster Resilience: A National Imperative , 2013 .

[28]  Yacov Y Haimes,et al.  On the Complex Definition of Risk: A Systems‐Based Approach , 2009, Risk analysis : an official publication of the Society for Risk Analysis.

[29]  Nick Bostrom,et al.  Superintelligence: Paths, Dangers, Strategies , 2014 .

[30]  James H. Lambert,et al.  Extreme Event Scenarios for Planning of Infrastructure Projects , 2002 .

[31]  Ben Goertzel,et al.  How long until human-level AI? Results from an expert assessment , 2011 .

[32]  S. Baum,et al.  Integrating the Planetary Boundaries and Global Catastrophic Risk Paradigms , 2014 .

[33]  Igor Linkov,et al.  Risk and resilience lessons from Venice , 2014, Environment Systems and Decisions.

[34]  Stephen Webb If the Universe Is Teeming with Aliens ... WHERE IS EVERYBODY?: Fifty Solutions to the Fermi Paradox and the Problem of Extraterrestrial Life , 2002 .

[35]  S. Kaplan,et al.  On The Quantitative Definition of Risk , 1981 .

[36]  S. Baum,et al.  Double catastrophe: intermittent stratospheric geoengineering induced by societal collapse , 2013, Environment Systems & Decisions.

[37]  G. Hertzler,et al.  How real options and ecological resilience thinking can assist in environmental risk management , 2012 .

[38]  Richard A. Posner,et al.  Catastrophe: Risk and Response , 2004 .

[39]  M. Adler Why De Minimis? , 2007 .

[40]  Jacob Haqq-Misra,et al.  The Benefits and Harm of Transmitting Into Space , 2012, 1207.5540.

[41]  Milan M Cirković The temporal aspect of the drake equation and SETI. , 2004, Astrobiology.

[42]  B. Selman,et al.  Interim Report from the Panel Chairs: AAAI Presidential Panel on Long-Term AI Futures , 2012 .

[43]  J. Romportl,et al.  Beyond AI: Artificial Dreams , 2012 .

[44]  Ulrich W. Eisenecker,et al.  AI: The Tumultuous History of the Search for Artificial Intelligence , 1995 .

[45]  Stuart Armstrong,et al.  How We're Predicting AI - or Failing to , 2015 .

[46]  James H. Lambert,et al.  Evaluating deep uncertainties in strategic priority‐setting with an application to facility energy investments , 2012, Syst. Eng..