On the moral responsibility of military robots

This article discusses mechanisms and principles for assignment of moral responsibility to intelligent robots, with special focus on military robots. We introduce the concept autonomous power as a new concept, and use it to identify the type of robots that call for moral considerations. It is furthermore argued that autonomous power, and in particular the ability to learn, is decisive for assignment of moral responsibility to robots. As technological development will lead to robots with increasing autonomous power, we should be prepared for a future when people blame robots for their actions. It is important to, already today, investigate the mechanisms that control human behavior in this respect. The results may be used when designing future military robots, to control unwanted tendencies to assign responsibility to the robots. Independent of the responsibility issue, the moral quality of robots’ behavior should be seen as one of many performance measures by which we evaluate robots. How to design ethics based control systems should be carefully investigated already now. From a consequentialist view, it would indeed be highly immoral to develop robots capable of performing acts involving life and death, without including some kind of moral framework.

[1]  Pamela J. Hinds,et al.  Whose Job Is It Anyway? A Study of Human-Robot Interaction in a Collaborative Task , 2004, Hum. Comput. Interact..

[2]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[3]  Peter F. Strawson,et al.  Freedom and resentment, and other essays , 1974 .

[4]  Iris Marion Young,et al.  Responsibility and Global Labor Justice , 2004 .

[5]  Ronald C. Arkin,et al.  Ethical robots in warfare , 2009, IEEE Technology and Society Magazine.

[6]  Aristotle,et al.  THE NICOMACHEAN ETHICS , 1990 .

[7]  Thomas B. Sheridan,et al.  Telerobotics, Automation, and Human Supervisory Control , 2003 .

[8]  Christopher Bolkcom,et al.  Unmanned Aerial Vehicles: Background and Issues for Congress , 2003 .

[9]  William Bechtel,et al.  ATTRIBUTING RESPONSIBILITY TO COMPUTER SYSTEMS , 1985 .

[10]  Arthur C. Graesser,et al.  Is it an Agent, or Just a Program?: A Taxonomy for Autonomous Agents , 1996, ATAL.

[11]  Ronald C. Arkin,et al.  Governing Lethal Behavior in Autonomous Robots , 2009 .

[12]  W. Connolly The terms of political discourse , 1974 .

[13]  Batya Frieainan "It's the Computer's Fault" -- Reasoning About Computers as Moral Agents , 1995 .

[14]  Brian Yamauchi,et al.  PackBot: a versatile platform for military robotics , 2004, SPIE Defense + Commercial Sensing.

[15]  Batya Friedman Moral Responsibility and Computer Technology. , 1990 .

[16]  Clifford Nass,et al.  Are computers scapegoats? Attributions of responsibility in human-computer interaction , 1998, Int. J. Hum. Comput. Stud..

[17]  Wendell Wallach,et al.  Why Machine Ethics? , 2006, IEEE Intelligent Systems.

[18]  Michael Walzer,et al.  Just and Unjust Wars: A Moral Argument with Historical Illustrations , 1978 .

[19]  Deborah G. Johnson Computer systems: Moral entities but not moral agents , 2006, Ethics and Information Technology.

[20]  D. Dennett When HAL kills, who's to blame? : computer ethics. , 2014 .

[21]  Bernd Carsten Stahl,et al.  Responsible Management of Information Systems , 2003 .

[22]  Nienke Grossman,et al.  Rehabilitation or Revenge: Prosecuting Child Soldiers for Human Rights Violations , 2007 .

[23]  J. Stevens,et al.  Animal Intelligence , 1883, Nature.

[24]  Lynette I. Millett,et al.  Reasoning about computers as moral agents: a research note , 1997 .

[25]  M. Durrant,et al.  FREEDOM AND RESENTMENT, AND OTHER ESSAYS , 1975 .

[26]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[27]  Pamela J. Hinds,et al.  Whose job is it anyway? a study of human-robot interaction in a collaborative task , 2004 .

[28]  Patrick Lin,et al.  Autonomous Military Robotics: Risk, Ethics, and Design , 2008 .

[29]  Virgínia,et al.  News release , 1984 .

[30]  Pamela J. Hinds,et al.  Who Should I Blame? Effects of Autonomy and Transparency on Attributions in Human-Robot Interaction , 2006, ROMAN 2006 - The 15th IEEE International Symposium on Robot and Human Interactive Communication.

[31]  M. Walzer,et al.  JUST AND UNJUST WARS: A MORAL ARGUMENT WITH HISTORICAL ILLUSTRATIONS; THE GREAT WAR AND MODERN MEMORY , 1978 .

[32]  Batya Friedman,et al.  “It's the computer's fault”: reasoning about computers as moral agents , 1995, CHI 95 Conference Companion.

[33]  Gordana Dodig-Crnkovic,et al.  Sharing Moral Responsibility with Robots: A Pragmatic Approach , 2008, SCAI.

[34]  Jeffrey D. Barton,et al.  Guidance and Navigation in the Global Engagement Department , 2010 .

[35]  Deborah K. W. Modrak Terence Irwin, trans. , Aristotle, Nicomachean Ethics . Reviewed by , 1986 .

[36]  Andreas Matthias,et al.  The responsibility gap: Ascribing responsibility for the actions of learning automata , 2004, Ethics and Information Technology.

[37]  Christopher D. Wickens,et al.  A model for types and levels of human interaction with automation , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[38]  Keith W. Miller,et al.  Moral Responsibility for Computing Artifacts: "The Rules" , 2011, IT Prof..