Attributing Agency to Automated Systems: Reflections on Human–Robot Collaborations and Responsibility-Loci

Many ethicists writing about automated systems (e.g. self-driving cars and autonomous weapons systems) attribute agency to these systems. Not only that; they seemingly attribute an autonomous or independent form of agency to these machines. This leads some ethicists to worry about responsibility-gaps and retribution-gaps in cases where automated systems harm or kill human beings. In this paper, I consider what sorts of agency it makes sense to attribute to most current forms of automated systems, in particular automated cars and military robots. I argue that whereas it indeed makes sense to attribute different forms of fairly sophisticated agency to these machines, we ought not to regard them as acting on their own, independently of any human beings. Rather, the right way to understand the agency exercised by these machines is in terms of human–robot collaborations, where the humans involved initiate, supervise, and manage the agency of their robotic collaborators. This means, I argue, that there is much less room for justified worries about responsibility-gaps and retribution-gaps than many ethicists think.

[1]  Robert W. Peterson,et al.  New Technology - Old Law: Autonomous Vehicles and California's Insurance Framework , 2012 .

[2]  Julian Nida-Rümelin,et al.  Responsibility for Crashes of Autonomous Vehicles: An Ethical Analysis , 2014, Science and Engineering Ethics.

[3]  Jeffrey M. Bradshaw,et al.  The Seven Deadly Myths of "Autonomous Systems" , 2013, IEEE Intelligent Systems.

[4]  Patrick Lin Why Ethics Matters for Autonomous Cars , 2016 .

[5]  Kue Young,et al.  A Tragic Loss , 2014, International journal of circumpolar health.

[6]  R. J. van Loon,et al.  Automated Driving and its Effect on the Safety Ecosystem: How do Compatibility Issues Affect the Transition Period?☆ , 2015 .

[7]  R. Arkin The Case for Ethical Autonomy in Unmanned Systems , 2010 .

[8]  Jeffrey K. Gurney Driving Into the Unknown: Examining the Crossroads of Criminal Law and Autonomous Vehicles , 2015 .

[9]  Jeffrey K. Gurney Crashing into the Unknown: An Examination of Crash-Optimization Algorithms Through the Two Lanes of Ethics and Law , 2016 .

[10]  Lily Frank,et al.  From sex robots to love robots: is mutual love with a robot possible? , 2017 .

[11]  Hin-Yan Liu,et al.  Autonomous Weapons Systems: Law, Ethics, Policy , 2016 .

[12]  Jeffrey K. Gurney Sue My Car Not Me: Products Liability and Accidents Involving Autonomous Vehicles , 2013 .

[13]  Sven Nyholm,et al.  The Ethics of Accident-Algorithms for Self-Driving Cars: an Applied Trolley Problem? , 2016, Ethical Theory and Moral Practice.

[14]  Robert Bitmead,et al.  Our Robots, Ourselves: Robotics and the Myths of Autonomy [Bookshelf] , 2016, IEEE Control Systems.

[15]  N. Richards The Ethics of Parenthood , 2010 .

[16]  Jan Gogoll,et al.  Autonomous Cars: In Favor of a Mandatory Ethics Setting , 2016, Science and Engineering Ethics.

[17]  Margaret Gilbert,et al.  Walking Together: A Paradigmatic Social Phenomenon , 1990 .

[18]  D. Davidson Essays on actions and events , 1980 .

[19]  John Danaher,et al.  Robots, law and the retribution gap , 2016, Ethics and Information Technology.

[20]  Noah J. Goodall,et al.  Ethical Decision Making during Automated Vehicle Crashes , 2014, ArXiv.

[21]  Mark Coeckelbergh,et al.  Responsibility and the Moral Phenomenology of Using Self-Driving Cars , 2016, Appl. Artif. Intell..

[22]  Ryan Jenkins,et al.  Autonomous Machines, Moral Judgment, and Acting for the Right Reasons , 2015 .

[23]  Joe Doty,et al.  Command Responsibility and Accountability , 2012 .

[24]  P. Pettit Responsibility Incorporated* , 2007, Ethics.

[25]  Gary E. Marchant,et al.  The Coming Collision Between Autonomous Vehicles and the Liability System , 2012 .

[26]  Frank Dignum,et al.  From autistic to social agents , 2014, AAMAS.

[27]  P. Pettit The Reality of Rule-Following , 1990 .

[28]  F. S. D. Sio,et al.  Drones and Responsibility , 2016 .