Embedded ethics: some technical and ethical challenges

This paper pertains to research works aiming at linking ethics and automated reasoning in autonomous machines. It focuses on a formal approach that is intended to be the basis of an artificial agent’s reasoning that could be considered by a human observer as an ethical reasoning. The approach includes some formal tools to describe a situation and models of ethical principles that are designed to automatically compute a judgement on possible decisions that can be made in a given situation and explain why a given decision is ethically acceptable or not. It is illustrated on three ethical frameworks—utilitarian ethics, deontological ethics and the Doctrine of Double effect whose formal models are tested on ethical dilemmas so as to examine how they respond to those dilemmas and to highlight the issues at stake when a formal approach to ethical concepts is considered. The whole approach is instantiated on the drone dilemma, a thought experiment we have designed; this allows the discrepancies that exist between the judgements of the various ethical frameworks to be shown. The final discussion allows us to highlight the different sources of subjectivity of the approach, despite the fact that concepts are expressed in a more rigorous way than in natural language: indeed, the formal approach enables subjectivity to be identified and located more precisely.

[1]  Paul McNamara,et al.  Deontic logic , 2006, Logic and the Modalities in the Twentieth Century.

[2]  Vincent Conitzer,et al.  Moral Decision Making Frameworks for Artificial Intelligence , 2017, ISAIM.

[3]  P. Foot.  The Problem of Abortion and the Doctrine of the Double Effect , 2020, The Doctrine of Double Effect.

[4]  Raymond Reiter,et al.  Temporal Reasoning in Logic Programming: A Case for the Situation Calculus , 1993, ICLP.

[5]  M. Clarke,et al.  The Doctrine of Double Effect , 2020, Forum Philosophicum.

[6]  Jeffrey Alan Johnson,et al.  From open data to information justice , 2014, Ethics and Information Technology.

[7]  Jean-Gabriel Ganascia,et al.  Modelling Moral Reasoning and Ethical Responsibility with Logic Programming , 2015, LPAR.

[8]  R. Reiter.  On Closed World Data Bases , 1987, Logic and Data Bases.

[9]  Trevor J. M. Bench-Capon.  Value-based argumentation frameworks , 2002, NMR.

[10]  P. Ricoeur,et al.  Éthique et morale , 1990 .

[11]  Knud Thomsen,et al.  Ethics for Artificial Intelligence, Ethics for All , 2019, Paladyn J. Behav. Robotics.

[12]  T. Abeles.  Moral Machines: Teaching Robots Right from Wrong , 2010 .

[13]  Raja Chatila,et al.  Ethics in Robotics Research: CERNA Mission and Context , 2017, IEEE Robotics & Automation Magazine.

[14]  L. Tribe,et al.  Confirmation bias , 2009 .

[15]  Gauthier Picard,et al.  Dealing with Ethical Conflicts in Autonomous Agents and Multi-Agent Systems , 2015, AAAI Workshop: AI and Ethics.

[16]  Fred Kröger,et al.  Temporal Logic of Programs , 1987, EATCS Monographs on Theoretical Computer Science.

[17]  Levent Yilmaz,et al.  Coherence-driven Reflective Equilibrium model of ethical decision-making , 2016, 2016 IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision Support (CogSIMA).

[18]  Claudette Cayrol,et al.  Management of Preferences in Assumption-Based Reasoning , 1992, IPMU.

[19]  Iyad Rahwan,et al.  The social dilemma of autonomous vehicles , 2015, Science.

[20]  P. Kleingeld,et al.  The Stanford Encyclopedia of Philosophy , 2013 .

[21]  Don Marquis,et al.  Doctrine of Double Effect , 2013 .

[22]  Matthias Scheutz,et al.  Sacrifice One For the Good of Many? People Apply Different Moral Norms to Human and Robot Agents , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[23]  Ugo Pagallo,et al.  Even Angels Need the Rules: AI, Roboethics, and the Law , 2016, ECAI.

[24]  John P. Sullins.  RoboWarfare: can robots be more ethical than humans on the battlefield? , 2010, Ethics and Information Technology.

[25]  Frédéric Dehais,et al.  Authority Management and Conflict Solving in Human-Machine Systems , 2012 .

[26]  Vincent Bonnemains,et al.  How Ethical Frameworks Answer to Ethical Dilemmas: Towards a Formal Model , 2016, EDIA@ECAI.

[27]  Henry Prakken,et al.  Contrary-to-duty obligations , 1996, Stud Logica.

[28]  Michael Anderson,et al.  MedEthEx: Toward a Medical Ethics Advisor , 2005, AAAI Fall Symposium: Caring Machines.

[29]  A. Macintyre,et al.  A Short History of Ethics: A History of Moral Philosophy from the Homeric Age to the Twentieth Century , 1997 .

[30]  E. Feser,et al.  Teleology , 1977, Medical History.

[31]  T. Beauchamp,et al.  Principles of biomedical ethics , 1991 .

[32]  R. Pohl.  Cognitive illusions : a handbook on fallacies and biases in thinking, judgement and memory , 2004 .

[33]  Spyros G. Tzafestas,et al.  Roboethics: A Navigating Overview , 2015 .

[34]  Patrick Lin,et al.  Autonomous Military Robotics: Risk, Ethics, and Design , 2008 .

[35]  Susan M. Haack,et al.  Robot Ethics: The Ethical and Social Implications of Robotics , 2016 .

[36]  Jean-Gabriel Ganascia,et al.  Modelling ethical rules of lying with Answer Set Programming , 2007, Ethics and Information Technology.

[37]  Olivier Boissier,et al.  Ethical Judgment of Agents' Behaviors in Multi-Agent Systems , 2016, AAMAS.

[38]  Ronald C. Arkin,et al.  Governing lethal behavior: Embedding ethics in a hybrid deliberative/reactive robot architecture part I: Motivation and philosophy , 2008, 2008 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[39]  James H. Moor,et al.  The Nature, Importance, and Difficulty of Machine Ethics , 2006, IEEE Intelligent Systems.

[40]  J. Baron.  Judgment Misguided: Intuition and Error in Public Decision Making , 1998 .

[41]  Jean-Gabriel Ganascia,et al.  Ethics in robotics research: CERNA recommendations , 2017 .

[42]  Michael Anderson,et al.  A Prima Facie Duty Approach to Machine Ethics and Its Application to Elder Care , 2011, Human-Robot Interaction in Elder Care.

[43]  Michael Anderson,et al.  Case-Supported Principle-Based Behavior Paradigm , 2015, A Construction Manual for Robots' Ethical Systems.

[44]  Patrick Lin,et al.  The Divine-Command Approach to Robot Ethics , 2012 .

[45]  Trevor J. M. Bench-Capon,et al.  Value Based Reasoning and the Actions of Others , 2016, ECAI.

[46]  M A Aroskar,et al.  Anatomy of an Ethical Dilemma: THE THEORY , 1980, The American journal of nursing.

[47]  Gaële Simon,et al.  Formal Verification of Ethical Properties in Multiagent Systems , 2016, EDIA@ECAI.