Superintelligence Skepticism as a Political Tool

This paper explores the potential for skepticism about artificial superintelligence to be used as a tool for political ends. Superintelligence is AI that is much smarter than humans. Superintelligence does not currently exist, but it has been proposed that it could someday be built, with massive and potentially catastrophic consequences. There is substantial skepticism about superintelligence, including whether it will be built, whether it would be catastrophic, and whether it is worth current attention. To date, superintelligence skepticism appears to be mostly honest intellectual debate, though some of it may be politicized. This paper finds substantial potential for superintelligence skepticism to be (further) politicized, due mainly to the potential for major corporations to have a strong profit motive to downplay concerns about superintelligence and avoid government regulation. Furthermore, politicized superintelligence skepticism is likely to be quite successful, due to several factors including the inherent uncertainty of the topic and the abundance of skeptics. The paper’s analysis is based on characteristics of superintelligence and the broader AI sector, as well as the history and ongoing practice of politicized skepticism on other science and technology issues, including tobacco, global warming, and industrial chemicals. The paper contributes to literatures on politicized skepticism and superintelligence governance.

[1]  M. Stirling Merchants of Consensus: A Public Battle Against Exxon , 2017 .

[2]  Victor W. Pickard,et al.  Media Failures in the Age of Trump , 2017 .

[3]  Seth D. Baum,et al.  Climate Change: Evidence of Human Causes and Arguments for Emissions Reduction , 2012, Sci. Eng. Ethics.

[4]  N. Oreskes The Scientific Consensus on Climate Change , 2004, Science.

[5]  Kristinn R. Thórisson,et al.  Safe Baby AGI , 2015, AGI.

[6]  S. Baum A Survey of Artificial General Intelligence Projects for Ethics, Risk, and Policy , 2017 .

[7]  P. Slovic The perception gap: Radiation and risk , 2012 .

[8]  N. Oreskes,et al.  Assessing ExxonMobil’s climate change communications (1977–2014) , 2017 .

[9]  Seth D. Baum,et al.  On the promotion of safe and socially beneficial artificial intelligence , 2017, AI & SOCIETY.

[10]  James A. Hendler,et al.  Avoiding Another AI Winter , 2008, IEEE Intelligent Systems.

[11]  Nicholas J. L. Brown,et al.  Science and the Public: Debate, Denial, and Skepticism , 2016 .

[12]  Samuel Butler Darwin Among the Machines , 2018 .

[13]  Peter Jacques,et al.  The organisation of denial: Conservative think tanks and environmental scepticism , 2008 .

[15]  Roman V Yampolskiy,et al.  Safety Engineering for Artificial General Intelligence , 2012, Topoi.

[16]  Gilles E. Gignac,et al.  The pivotal role of perceived scientific consensus in acceptance of science , 2013 .

[17]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[18]  David E. Broockman,et al.  The Political Behavior of Wealthy Americans: Evidence from Technology Entrepreneurs , 2017 .

[19]  Akop P. Nazaretyan A. H. Eden, J. H. Moor, J. H. Søraker and E. Steinhart (eds): Singularity Hypotheses: A Scientific and Philosophical Assessment , 2014, Minds and Machines.

[20]  D. Lindenmayer Merchants of Doubt. How a Handful of Scientists Obscured the Truth on Issues from Tobacco Smoke to Global Warming , 2012 .

[21]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[22]  Seth D. Baum Reconciliation between factions focused on near-term and long-term artificial intelligence , 2017, AI & SOCIETY.

[23]  S. Legg,et al.  Machine super intelligence , 2008 .

[24]  D. Chalmers The Singularity: a Philosophical Analysis , 2010 .

[25]  Seth D. Baum,et al.  The great downside dilemma for risky emerging technologies , 2014 .

[26]  Stephan Lewandowsky,et al.  Motivated Rejection of Science , 2016 .

[27]  Cynthia Selin Expectations and the Emergence of Nanotechnology , 2007 .

[28]  G. Marshall Don't Even Think About It: Why Our Brains Are Wired to Ignore Climate Change , 2014 .

[29]  Roman V. Yampolskiy,et al.  Modeling and Interpreting Expert Disagreement About Artificial Superintelligence , 2017, Informatica.

[30]  Thomas M. Nichols,et al.  The Death of Expertise: The Campaign against Established Knowledge and Why it Matters , 2017 .

[31]  Nick Bostrom,et al.  Superintelligence: Paths, Dangers, Strategies , 2014 .

[32]  I. J. Good,et al.  Speculations Concerning the First Ultraintelligent Machine , 1965, Adv. Comput..

[33]  Tim Menzies,et al.  Guest Editor's Introduction: 21st Century AI--Proud, Not Smug , 2003, IEEE Intell. Syst..

[34]  K. Crawford Artificial Intelligence's White Guy Problem , 2016 .

[35]  Roman V Yampolskiy,et al.  Responses to catastrophic AGI risk: a survey , 2014 .

[36]  P. Grandjean Only One Chance: How Environmental Pollution Impairs Brain Development -- and How to Protect the Brains of the Next Generation , 2013 .

[37]  Ben Goertzel,et al.  Superintelligence: Fears, Promises and Potentials Reflections on Bostrom's Superintelligence, Yudkowsky's From AI to Zombies, and Weaver and Veitas's "Open-Ended Intelligence" , 2015 .

[38]  M. Boykoff,et al.  Balance as bias: global warming and the US prestige press☆ , 2004 .

[39]  Ahti-Veikko Pietarinen What Your Computer Still Can't Know: A Refutation of Bringsjord's Refutation of Searle's Refutation of Bostrom and Floridi , 2016, Robophilosophy/TRANSOR.

[40]  Christopher Marquis,et al.  Scrutiny, Norms, and Selective Disclosure: A Global Study of Greenwashing , 2015, Organ. Sci..

[41]  Ulrich W. Eisenecker,et al.  AI: The Tumultuous History of the Search for Artificial Intelligence , 1995 .

[42]  Unidentified The Debunking Handbook , 2012 .

[43]  Anders Sandberg,et al.  An Overview of Models of Technological Singularity , 2013 .

[44]  Ben Goertzel,et al.  Artificial General Intelligence: Concept, State of the Art, and Future Prospects , 2009, J. Artif. Gen. Intell..

[45]  Jop de Vrieze 'Science wars' veteran has a new mission. , 2017, Science.

[46]  Dolores Albarracín,et al.  Debunking: A Meta-Analysis of the Psychological Efficacy of Messages Countering Misinformation , 2017, Psychological science.