Motivations and Risks of Machine Ethics

This paper surveys reasons for and against pursuing the field of machine ethics, understood as research aiming to build “ethical machines.” We clarify the nature of this goal, why it is worth pursuing, and the risks involved in its pursuit. First, we survey and clarify some of the philosophical issues surrounding the concept of an “ethical machine” and the aims of machine ethics. Second, we argue that while there are good prima facie reasons for pursuing machine ethics, including the potential to improve the ethical alignment of both humans and machines, there are also potential risks that must be considered. Third, we survey these potential risks and point to where research should be devoted to clarifying and managing potential risks. We conclude by making some recommendations about the questions that future work could address.

[1]  Michael Anderson,et al.  Guest Editors' Introduction: Machine Ethics , 2006, IEEE Intelligent Systems.

[2]  Mirosław Żelazny,et al.  The Groundwork of the Metaphysic of Morals , 2011 .

[3]  Jeff McMahan,et al.  The ethics of killing : problems at the margins of life , 2002 .

[4]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[5]  D. Field,et al.  Machine Ethics: What Can AI Do for Ethics? , 1996 .

[6]  Colin Allen,et al.  Prolegomena to any future artificial moral agent , 2000, J. Exp. Theor. Artif. Intell..

[7]  W. Marsden.  I and J , 2012 .

[8]  Adrian Weller,et al.  Challenges for Transparency , 2017, ArXiv.

[9]  Miles Brundage,et al.  Limitations and risks of machine ethics , 2014, J. Exp. Theor. Artif. Intell..

[10]  John P. Sullins.  When Is a Robot a Moral Agent , 2006 .

[11]  John Harris,et al.  Abortion and Infanticide , 1985 .

[12]  Tim Crane,et al.  Intentionality as the Mark of the Mental , 1998, Royal Institute of Philosophy Supplement.

[13]  Paulo J. G. Lisboa,et al.  Interpretability in Machine Learning - Principles and Practice , 2013, WILF.

[14]  MARK DIESENDORF.  Is science value-free? , 1985, Nature.

[15]  John R. Searle,et al.  Minds, brains, and programs , 1980, Behavioral and Brain Sciences.

[16]  Georg Wilhelm Friedrich Hegel,et al.  Elements of the Philosophy of Right , 1820 .

[17]  Dai Mu-cai,et al.  Political Legitimacy , 2019 .

[18]  A. White.  Essays on Actions and Events. , 1981 .

[19]  T Delamothe,et al.  The crooked timber of humanity , 2009, BMJ : British Medical Journal.

[20]  M. Miller.  Agency , 2010 .

[21]  S. Brison.  The Intentional Stance , 1989 .

[22]  Logan Engstrom,et al.  Synthesizing Robust Adversarial Examples , 2017, ICML.

[23]  P. Pettit.  Akrasia, collective and individual , 2001 .

[24]  Chris Russell,et al.  Counterfactual Explanations Without Opening the Black Box: Automated Decisions and the GDPR , 2017, ArXiv.

[25]  Robert B. Talisse.  Value Pluralism , 2015 .

[26]  William Charlton,et al.  Weakness of will , 1988 .

[27]  Michael Anderson,et al.  An Approach to Computing Ethics , 2006, IEEE Intelligent Systems.

[28]  R. Binns,et al.  Algorithmic Accountability and Public Reason , 2017, Philosophy & Technology.

[29]  I. Berlin.  The Crooked Timber of Humanity , 1990 .

[30]  Warren S. Quinn,et al.  Abortion: identity and loss. , 1984, Philosophy & public affairs.

[31]  Thomas M. Powers,et al.  Incremental Machine Ethics , 2011, IEEE Robotics & Automation Magazine.

[32]  Joanna Bryson,et al.  Standardizing Ethical Design for Artificial Intelligence and Autonomous Systems , 2017, Computer.

[33]  H. Dreyfus.  Why Heideggerian AI Failed and How Fixing it Would Require Making it More Heideggerian , 2007 .

[34]  James H. Moor,et al.  The Nature, Importance, and Difficulty of Machine Ethics , 2006, IEEE Intelligent Systems.

[35]  C. Allen,et al.  Moral Machines: Teaching Robots Right from Wrong , 2008 .

[36]  Susan Leigh Anderson.  Machine Ethics: How Machines Might Help Us Achieve Breakthroughs in Ethical Theory and Inspire Us to Behave Better , 2011 .

[37]  Hubert L. Dreyfus,et al.  Why Heideggerian AI Failed and How Fixing it Would Require Making it More Heideggerian , 2007, Artif. Intell..

[38]  Liliana Albertazzi,et al.  Psychology from an empirical standpoint , 2006 .

[39]  Emilio Mordini,et al.  [Weakness of will]. , 2002, Annali dell'Istituto superiore di sanita.

[40]  Michael Fisher,et al.  Towards Moral Autonomous Systems , 2017, ArXiv.

[41]  David Carr,et al.  Plural and Conflicting Values , 1991 .

[42]  Baran Çürüklü,et al.  Robots: ethical by design , 2011, Ethics and Information Technology.

[43]  J. Searle.  Intentionality: An Essay in the Philosophy of Mind , 1983 .

[44]  Luciano Floridi,et al.  On the Morality of Artificial Agents , 2004, Minds and Machines.

[45]  Philip Kitcher,et al.  Science in a Democratic Society , 2011 .

[46]  Susan Leigh Anderson,et al.  Robot be good. , 2010, Scientific American.

[47]  Wendell Wallach,et al.  Why Machine Ethics? , 2006, IEEE Intelligent Systems.

[48]  Ryan Tonkens,et al.  A Challenge for Machine Ethics , 2009, Minds and Machines.

[49]  L. Burton.  Intention , 2011 .

[50]  Alan F. T. Winfield,et al.  The Dark Side of Ethical Robots , 2016, AIES.

[51]  Lori Gruen,et al.  Ethics and Animals: Why animals matter , 2011 .

[52]  C. Allen,et al.  Artificial Morality: Top-down, Bottom-up, and Hybrid Approaches , 2005, Ethics and Information Technology.

[53]  John Rawls,et al.  政治自由主义 = Political liberalism , 2000 .

[54]  Philip Pettit,et al.  Groups with minds of their own , 2001 .

[55]  M. Solms,et al.  What Is Consciousness? , 1997, Journal of the American Psychoanalytic Association.

[56]  J. Bryson.  Robots should be slaves , 2010 .

[57]  Julia Annas,et al.  Ancient Ethics and Modern Morality , 1992 .

[58]  John Danaher,et al.  The rise of the robots and the crisis of moral patiency , 2019, AI & SOCIETY.

[59]  Axel Cleeremans,et al.  Connecting Conscious and Unconscious Processing , 2014, Cogn. Sci..

[60]  Oliver Bendel,et al.  Towards Machine Ethics. , 2013 .

[61]  S. Bennett.  Brainchildren: Essays on Designing Minds , 1999 .

[62]  Julie Tannenbaum,et al.  The Grounds of Moral Status , 2013 .

[63]  Christof Koch,et al.  What Is Consciousness? , 2018, Nature.

[64]  K. Himma.  Artificial agency, consciousness, and the criteria for moral agency: what properties must an artificial agent have to be a moral agent? , 2009, Ethics and Information Technology.

[65]  Philip Pettit,et al.  Rationality, Reasoning and Group Agency , 2007 .

[66]  S. Dehaene,et al.  What is consciousness, and could machines have it? , 2017, Science.

[67]  A. Denis.  Rationality , 2012, Encyclopedia of Evolutionary Psychological Science.

[68]  Stephen D. Schwarz.  The Right and the Good , 1992 .

[69]  Michael Tooley,et al.  Abortion and Infanticide , 1974, Rights and Wrongs of Abortion.

[70]  David Wiggins,et al.  XV—Weakness of Will Commensurability, and the Objects of Deliberation and Desire , 1979 .

[71]  Daniel T. Levin,et al.  If asimo thinks, does roomba feel? , 2016 .

[72]  R S Downie,et al.  Ethics and the Limits of Philosophy , 1986, Ethics Beyond the Limits.