An Ethics Evaluation Tool for Automating Ethical Decision-Making in Robots and Self-Driving Cars

ABSTRACT As we march down the road of automation in robotics and artificial intelligence, we will need to automate an increasing amount of ethical decision-making in order for our devices to operate independently from us. But automating ethical decision-making raises novel questions for engineers and designers, who will have to make decisions about how to accomplish that task. For example, some ethical decision-making involves hard moral cases, which in turn requires user input if we are to respect established norms surrounding autonomy and informed consent. The author considers this and other ethical considerations that accompany the automation of ethical decision-making. He proposes some general ethical requirements that should be taken into account in the design room, and sketches a design tool that can be integrated into the design process to help engineers, designers, ethicists, and policymakers decide how best to automate certain forms of ethical decision-making.

[1]  Albert R. Jonsen,et al.  A Short History of Medical Ethics , 2000 .

[2]  Cynthia Breazeal,et al.  Designing sociable robots , 2002 .

[3]  A C Bonacci,et al.  Living with complexity. , 1986, American journal of hospital pharmacy.

[4]  Sherry Turkle The Internal Cardiac Defibrillator , 2008 .

[5]  B. Latour Pandora's Hope: Essays on the Reality of Science Studies , 1999 .

[6]  Ruth Chang,et al.  The Possibility of Parity* , 2002, Ethics.

[7]  Alan Borning,et al.  Value Sensitive Design and Information Systems , 2020, The Ethics of Information Technologies.

[8]  Alan Borning,et al.  Value Sensitive Design: Theory and Methods , 2002 .

[9]  Diane Proudfoot,et al.  Anthropomorphism and AI: Turingʼs much misunderstood imitation game , 2011, Artif. Intell..

[10]  P. H. Kahn,et al.  Human values, ethics, and design , 2002 .

[11]  Y. Khaliq,et al.  Tri-Council Policy Statement: Ethical Conduct for Research Involving Humans , 2012 .

[12]  L. Riek,et al.  A Code of Ethics for the Human-Robot Interaction Profession , 2014 .

[13]  P. Verbeek,et al.  Materializing Morality , 2006 .

[14]  Aimee van Wynsberghe,et al.  Designing Robots for Care: Care Centered Value-Sensitive Design , 2013, Sci. Eng. Ethics.

[15]  Jason Millar,et al.  Technology as Moral Proxy: Autonomy and Paternalism by Design , 2015, IEEE Technology and Society Magazine.

[16]  Colin Potts,et al.  Design of Everyday Things , 1988 .

[17]  J. Edwards,et al.  Rethinking Expertise , 2008 .

[18]  Peter-Paul Verbeek,et al.  Moralizing Technology: Understanding and Designing the Morality of Things , 2011 .

[19]  K. Darling 'Who's Johnny?' Anthropomorphic Framing in Human-Robot Interaction, Integration, and Policy , 2015 .

[20]  Brian R. Duffy,et al.  Anthropomorphism and the social robot , 2003, Robotics Auton. Syst..

[21]  Aimee van Wynsberghe,et al.  The Leadership Role of the Ethicist: Balancing between the Authoritative and the Passive , 2014, Int. J. Technoethics.

[22]  Desmond Ka Ho Joseph Ngai,et al.  Turning Off the Implantable Cardioverter Defibrillator to Prevent Pre-Death Electrical Shocks: An Exercise and Right in the Refusal of Medical Treatment , 2010 .

[23]  Ruth Chang,et al.  ARE HARD CHOICES CASES OF INCOMPARABILITY , 2012 .

[24]  Aimee van Wynsberghe,et al.  Ethicist as Designer: A Pragmatic Approach to Ethics in the Lab , 2014, Sci. Eng. Ethics.