AI Extenders: The Ethical and Societal Implications of Humans Cognitively Extended by AI

Humans and AI systems are usually portrayed as separate systems that we need to align in values and goals. However, there is a great deal of AI technology found in non-autonomous systems that are used as cognitive tools by humans. Under the extended mind thesis, the functional contributions of these tools become as essential to our cognition as our brains. But AI can take cognitive extension towards totally new capabilities, posing new philosophical, ethical and technical challenges. To analyse these challenges better, we define and place AI extenders in a continuum between fully-externalized systems, loosely coupled with humans, and fully internalized processes, with operations ultimately performed by the brain, making the tool redundant. We dissect the landscape of cognitive capabilities that can foreseeably be extended by AI and examine their ethical implications.We suggest that cognitive extenders using AI be treated as distinct from other cognitive enhancers by all relevant stakeholders, including developers, policy makers, and human users.

[1]  Vicente Julián,et al.  Cognitive assistants , 2018, Int. J. Hum. Comput. Stud..

[2]  E. D. Di Paolo.  Extended Life , 2008 .

[3]  D. C. Englebart,et al.  Augmenting human intellect: a conceptual framework , 1962 .

[4]  Paul R. Smart,et al.  Human-extended machine cognition , 2018, Cognitive Systems Research.

[5]  Donald A. Norman,et al.  Cognitive artifacts , 1991 .

[6]  Nick Bostrom,et al.  Cognitive Enhancement : Methods , Ethics , Regulatory Challenges ( 2006 ) , 2006 .

[7]  John Danaher,et al.  Toward an Ethics of AI Assistants: an Initial Framework , 2018, Philosophy & Technology.

[8]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[9]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[10]  A. Clark,et al.  The Extended Mind , 1998, Analysis.

[11]  Austin Henderson,et al.  Interaction design: beyond human-computer interaction , 2002, UBIQ.

[12]  Gerard Casey.  Minds and machines , 1992 .

[13]  Richard Menary.  Cognitive integration: mind and cognition unbounded , 2007 .

[14]  José Hernández-Orallo,et al.  The Measure of All Minds: Evaluating Natural and Artificial Intelligence , 2017 .

[15]  Shan Carter,et al.  Using Artificial Intelligence to Augment Human Intelligence , 2017 .

[16]  James C. Spohrer,et al.  Cognition as a Service: An Industry Perspective , 2015, AI Mag..

[17]  Marvin Minsky,et al.  Semantic Information Processing , 1968 .

[18]  François Bry,et al.  Human computation , 2018, it Inf. Technol..

[19]  Evan Selinger,et al.  Re-Engineering Humanity , 2018 .

[20]  R. Samuels.  Mind: Introduction to Cognitive Science, Paul Thagard, MIT Press (1996), ISBN: 0 262 20106 2 , 1997 .

[21]  Shelley E. Taylor,et al.  Social Cognition, from Brains to Culture , 1984 .

[22]  Klaus-Robert Müller,et al.  Explainable Artificial Intelligence: Understanding, Visualizing and Interpreting Deep Learning Models , 2017, ArXiv.

[23]  Danna Zhou,et al.  d. , 1934, Microbial pathogenesis.

[24]  Julie A. Jacko,et al.  Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies, and Emerging Applications, Third Edition , 2012 .

[25]  Richard Heersmink,et al.  Extended mind and cognitive enhancement: moral aspects of cognitive artifacts , 2017 .

[26]  Nathalie Bonnardel,et al.  The Impact of Technology on Creativity in Design: An Enhancement? , 2010 .

[27]  Allen Newell,et al.  The Prospects for Psychological Science in Human-Computer Interaction , 1985, Hum. Comput. Interact..

[28]  A. Hama,et al.  The Invisible Gorilla: And Other Ways Our Intuitions Deceive Us , 2010 .

[29]  J. Adam Carter,et al.  THE ETHICS OF EXTENDED COGNITION : IS HAVING YOUR COMPUTER COMPROMISED A PERSONAL ASSAULT ? , 2016 .

[30]  Mark Rowlands,et al.  The New Science of the Mind: From Extended Mind to Embodied Phenomenology , 2010 .

[31]  Adrian Weller,et al.  Motivations and Risks of Machine Ethics , 2019, Proceedings of the IEEE.

[33]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[34]  C. Bishop.  The MIT Encyclopedia of the Cognitive Sciences , 1999 .

[35]  M. Cole,et al.  Mind in society: The development of higher psychological processes. L. S. Vygotsky. , 1978 .

[36]  J. Jacko,et al.  The human-computer interaction handbook: fundamentals, evolving technologies and emerging applications , 2002 .

[37]  William B. Rouse,et al.  Automating versus augmenting intelligence , 2018 .

[38]  Jonathan A. Fugelsang,et al.  The brain in your pocket: Evidence that Smartphones are used to supplant thinking , 2015, Comput. Hum. Behav..

[39]  J. Sutton.  Distributed cognition: domains and dimensions , 2006 .

[40]  Evan F. Risko,et al.  Cognitive Offloading , 2016, Trends in Cognitive Sciences.

[41]  Spyridon Orestis Palermos,et al.  Loops, constitution, and cognitive extension , 2014, Cognitive Systems Research.

[42]  J. ADAM CARTER,et al.  Is Having Your Computer Compromised a Personal Assault? The Ethics of Extended Cognition , 2016, Journal of the American Philosophical Association.

[43]  B. Sparrow,et al.  Google Effects on Memory: Cognitive Consequences of Having Information at Our Fingertips , 2011, Science.

[44]  Karina Vold,et al.  Overcoming Deadlock: Scientific and Ethical Reasons to Embrace the Extended Mind Thesis , 2018 .

[45]  J. C. R. Licklider,et al.  Man-Computer Symbiosis , 1960 .