Artificial Artificial Intelligence: Measuring Influence of AI 'Assessments' on Moral Decision-Making

Given AI's growing role in modeling and improving decision-making, how and when to present users with feedback is an urgent topic to address. We empirically examined the effect of feedback from false AI on moral decision-making about donor kidney allocation. We found some evidence that judgments about whether a patient should receive a kidney can be influenced by feedback about participants' own decision-making perceived to be given by AI, even if the feedback is entirely random. We also discovered different effects between assessments presented as being from human experts and assessments presented as being from AI.

[1]  Petter Johansson,et al.  False Beliefs and Confabulation Can Lead to Lasting Changes in Political Attitudes , 2018, Journal of experimental psychology. General.

[2]  Adrian Furnham,et al.  Accepting personality test feedback: A review of the Barnum effect , 1987 .

[3]  Michal Reifen Tagar,et al.  Ideological uncertainty and investment of the self in politics , 2019, Journal of Experimental Social Psychology.

[4]  Jonathan Baron,et al.  Social responsibility, personal responsibility, and prognosis in public judgments about transplant allocation. , 1999, Bioethics.

[5]  Petter Johansson,et al.  How the Polls Can Be Both Spot On and Dead Wrong: Using Choice Blindness to Shift Political Attitudes and Voter Intentions , 2013, PloS one.

[6]  R. A. Bradley,et al.  RANK ANALYSIS OF INCOMPLETE BLOCK DESIGNS , 1952 .

[7]  Daphna Oyserman,et al.  Identity‐based motivation and consumer behavior , 2009 .

[8]  John Dunlosky,et al.  Belief in Corrective Feedback for Common Misconceptions: Implications for Knowledge Revision , 2017, Journal of experimental psychology. Learning, memory, and cognition.

[9]  Vincent Conitzer,et al.  Handbook of Computational Social Choice , 2016 .

[10]  Maarten J. IJzerman,et al.  A Systematic Review to Identify the Use of Preference Elicitation Methods in Healthcare Decision Making , 2014, Pharmaceutical Medicine.

[11]  Daphna Oyserman,et al.  Identity-Based Motivation , 2015 .

[12]  Daphna Oyserman,et al.  Possible selves: From content to process. , 2008 .

[13]  On Amir,et al.  Choice Construction versus Preference Construction: The Instability of Preferences Learned in Context , 2007 .

[14]  K. Arrow.  Social Choice and Individual Values , 1951 .

[15]  Vincent Conitzer,et al.  Adapting a Kidney Exchange Algorithm to Align with Human Values , 2018, AAAI.

[16]  Tuomas Sandholm,et al.  Preference elicitation in combinatorial auctions , 2001, AAMAS '02.

[17]  Jonathan Baron,et al.  Social Acceptability, Personal Responsibility, and Prognosis in Public Judgments and Transplant Allocation , 1999 .

[18]  Joel Huber,et al.  The Effectiveness of Alternative Preference Elicitation Procedures in Predicting Choice , 1993 .