The Dark Side of Ethical Robots

Concerns over the risks associated with advances in Artificial Intelligence have prompted calls for greater efforts toward robust and beneficial AI, including machine ethics. Recently, roboticists have responded by initiating the development of so-called ethical robots. These robots would, ideally, evaluate the consequences of their actions and morally justify their choices. This emerging field promises to develop extensively over the next few years. However, in this paper, we point out an inherent limitation of the emerging field of ethical robots. We show that building ethical robots also inevitably enables the construction of unethical robots. In three experiments, we show that it is remarkably easy to modify an ethical robot so that it behaves competitively, or even aggressively. The reason for this is that the cognitive machinery required to make an ethical robot can always be corrupted to make unethical robots. We discuss the implications of this finding to the governance of ethical robots. We conclude that the risks that unscrupulous actors might compromise a robot's ethics are so great as to raise serious doubts over the wisdom of embedding ethical decision making in real-world safety-critical robots, such as driverless cars.

[1]  Patrick Lin,et al.  A Body to Kick, but Still No Soul to Damn: Legal Perspectives on Robotics , 2012 .

[2]  Patrick Lin,et al.  Robot Ethics: The Ethical and Social Implications of Robotics , 2011 .

[3]  Jesse Russell,et al.  The Ethics of Artificial Intelligence , 2021, Bots and Beasts.

[4]  Christian Blum,et al.  Towards an Ethical Robot: Internal Models, Consequences and Ethical Action Selection , 2014, TAROS.

[5]  Alan Winfield Roboethics –for humans , 2011 .

[6]  Matthias Scheutz,et al.  "Sorry, I Can't Do That": Developing Mechanisms to Appropriately Reject Directives in Human-Robot Interactions , 2015, AAAI Fall Symposia.

[7]  B. Lenz,et al.  Autonomes Fahren: Technische, rechtliche und gesellschaftliche Aspekte , 2015 .

[8]  R. Arkin The Case for Ethical Autonomy in Unmanned Systems , 2010 .

[9]  Raja Chatila,et al.  The IEEE Global Initiative on Ethics of Autonomous and Intelligent Systems , 2019, Robotics and Well-Being.

[10]  Alan F. T. Winfield,et al.  An architecture for ethical robots , 2016, ArXiv.

[11]  Stuart J. Russell,et al.  Research Priorities for Robust and Beneficial Artificial Intelligence , 2015, AI Mag..

[12]  JOHN F. Young Machine Intelligence , 1971, Nature.

[13]  Stuart J. Russell,et al.  Robotics: Ethics of artificial intelligence , 2015, Nature.

[14]  Marina Jirotka,et al.  Ethical governance is essential to building trust in robotics and artificial intelligence systems , 2018, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[15]  Robin R. Murphy,et al.  Beyond Asimov: The Three Laws of Responsible Robotics , 2009, IEEE Intelligent Systems.

[16]  James H. Moor,et al.  The Nature, Importance, and Difficulty of Machine Ethics , 2006, IEEE Intelligent Systems.

[17]  C. Allen,et al.  Moral Machines: Teaching Robots Right from Wrong , 2008 .

[18]  Michael Fisher,et al.  Towards Verifiably Ethical Robot Behaviour , 2015, AAAI Workshop: AI and Ethics.

[19]  Vincent Berenz,et al.  A Value Driven Agent: Instantiation of a Case-Supported Principle-Based Behavior Paradigm , 2017, AAAI Workshops.

[20]  Boer Deng,et al.  Machine ethics: The robot’s dilemma , 2015, Nature.

[21]  Alan F. T. Winfield,et al.  An architecture for ethical robots inspired by the simulation theory of cognition , 2018, Cognitive Systems Research.

[22]  J. Stilgoe,et al.  Developing a framework for responsible innovation* , 2013, The Ethics of Nanotechnology, Geoengineering and Clean Energy.

[23]  Tom Rodden,et al.  Principles of robotics: regulating robots in the real world , 2017, Connect. Sci..

[24]  Hyrum S. Anderson,et al.  The Malicious Use of Artificial Intelligence: Forecasting, Prevention, and Mitigation , 2018, ArXiv.

[25]  Susan Leigh Anderson,et al.  Robot be good. , 2010, Scientific American.

[26]  Patrick Lin,et al.  Contemporary Governance Architecture Regarding Robotics Technologies: An Assessment , 2012 .

[27]  Iyad Rahwan,et al.  The social dilemma of autonomous vehicles , 2015, Science.

[28]  Noel Sharkey,et al.  The Ethical Frontiers of Robotics , 2008, Science.