Epistemic Reasoning for Machine Ethics with Situation Calculus

With the rapid development of autonomous machines such as selfdriving vehicles and social robots, there is increasing realisation that machine ethics is important for widespread acceptance of autonomous machines. Our objective is to encode ethical reasoning into autonomous machines following well-defined ethical principles and behavioural norms. We provide an approach to reasoning about actions that incorporates ethical considerations. It builds on Scherl and Levesque's [29, 30] approach to knowledge in the situation calculus. We show how reasoning about knowledge in a dynamic setting can be used to guide ethical and moral choices, aligned with consequentialist and deontological approaches to ethics. We apply our approach to autonomous driving and social robot scenarios, and provide an implementation framework.

[1]  Wolfgang Faber,et al.  A logic programming approach to knowledge-state planning: Semantics and complexity , 2004, TOCL.

[2]  Kush R. Varshney,et al.  Teaching AI Agents Ethical Values Using Reinforcement Learning and Policy Orchestration , 2019, IJCAI.

[3]  Maurice Pagnucco,et al.  Non-monotonic Reasoning for Machine Ethics with Situation Calculus , 2020, Australasian Conference on Artificial Intelligence.

[4]  Raymond Reiter,et al.  The Frame Problem in the Situation Calculus: A Simple Solution (Sometimes) and a Completeness Result for Goal Regression , 1991, Artificial and Mathematical Theory of Computation.

[5]  Jean-Gabriel Ganascia,et al.  Ethical System Formalization using Non-Monotonic Logics , 2007 .

[6]  Hector J. Levesque,et al.  Knowledge, action, and the frame problem , 2003, Artif. Intell..

[7]  Gaële Simon,et al.  Formal Verification of Ethical Properties in Multiagent Systems , 2016, EDIA@ECAI.

[8]  Hector J. Levesque,et al.  The Frame Problem and Knowledge-Producing Actions , 1993, AAAI.

[9]  Martin Gebser,et al.  The Potsdam Answer Set Solving Collection 5.0 , 2018, KI - Künstliche Intelligenz.

[10]  Vincent Berenz,et al.  A Value-Driven Eldercare Robot: Virtual and Physical Instantiations of a Case-Supported Principle-Based Behavior Paradigm , 2019, Proceedings of the IEEE.

[11]  David Hume.  A Treatise of Human Nature: Being an Attempt to introduce the experimental Method of Reasoning into Moral Subjects , 1972 .

[12]  S. Toulmin.  The Language of Morals , 1954, Philosophy.

[13]  Selmer Bringsjord,et al.  On Automating the Doctrine of Double Effect , 2017, IJCAI.

[14]  Robert Young,et al.  An Essay on Free Will , 2009 .

[15]  Robert C. Moore.  Reasoning About Knowledge and Action , 1977, IJCAI.

[16]  Robert C. Moore.  A Formal Theory of Knowledge and Action , 1984 .

[17]  Torsten Schaub,et al.  Generalized Answer Set Planning with Incomplete Information , 2017, ASPOCP@LPNMR.

[18]  Jean-Gabriel Ganascia,et al.  A Declarative Modular Framework for Representing and Applying Ethical Principles , 2017, AAMAS.

[19]  A. Smajdor,et al.  Consequentialism , 2021, Oxford Handbook of Medical Ethics and Law.

[20]  Michael L. Littman,et al.  Reinforcement Learning as a Framework for Ethical Decision Making , 2016, AAAI Workshop: AI, Ethics, and Society.

[21]  Michael Fisher,et al.  On Proactive, Transparent, and Verifiable Ethical Reasoning for Robots , 2019, Proceedings of the IEEE.

[22]  Justin Svegliato,et al.  Ethically Compliant Planning in Moral Autonomous Systems , 2020, AISafety@IJCAI.

[23]  Vladimir Lifschitz,et al.  Answer set programming and plan generation , 2002, Artif. Intell..

[24]  Alex M. Andrew,et al.  Knowledge in Action: Logical Foundations for Specifying and Implementing Dynamical Systems , 2002 .

[25]  Vincent Conitzer,et al.  Moral Decision Making Frameworks for Artificial Intelligence , 2017, ISAIM.

[26]  Shou-De Lin,et al.  A Low-Cost Ethics Shaping Approach for Designing Reinforcement Learning Agents , 2017, AAAI.

[27]  Thomas M. Powers.  Prospects for a Kantian Machine , 2006, IEEE Intelligent Systems.

[28]  Michael Fisher,et al.  Formal verification of ethical choices in autonomous systems , 2016, Robotics Auton. Syst..

[29]  Gervase Vernon,et al.  Virtue ethics. , 2003, The British journal of general practice : the journal of the Royal College of General Practitioners.

[30]  Bernhard Nebel,et al.  Evaluation of the moral permissibility of action plans , 2020, Artif. Intell..