Autonomous surgical robotic systems and the liability dilemma

Background Advances in machine learning and robotics have allowed the development of increasingly autonomous robotic systems which are able to make decisions and learn from experience. This distribution of decision-making away from human supervision poses a legal challenge for determining liability. Methods The iRobotSurgeon survey aimed to explore public opinion towards the issue of liability with robotic surgical systems. The survey included five hypothetical scenarios where a patient comes to harm and the respondent needs to determine who they believe is most responsible: the surgeon, the robot manufacturer, the hospital, or another party. Results A total of 2,191 completed surveys were gathered evaluating 10,955 individual scenario responses from 78 countries spanning 6 continents. The survey demonstrated a pattern in which participants were sensitive to shifts from fully surgeon-controlled scenarios to scenarios in which robotic systems played a larger role in decision-making such that surgeons were blamed less. However, there was a limit to this shift with human surgeons still being ascribed blame in scenarios of autonomous robotic systems where humans had no role in decision-making. Importantly, there was no clear consensus among respondents where to allocate blame in the case of harm occurring from a fully autonomous system. Conclusions The iRobotSurgeon Survey demonstrated a dilemma among respondents on who to blame when harm is caused by a fully autonomous surgical robotic system. Importantly, it also showed that the surgeon is ascribed blame even when they have had no role in decision-making which adds weight to concerns that human operators could act as “moral crumple zones” and bear the brunt of legal responsibility when a complex autonomous system causes harm.

[1]  H. Marcus,et al.  Exploring public opinion about liability and responsibility in surgical robotics , 2020, Nat. Mach. Intell..

[2]  Ralf Krestel,et al.  Explainable AI under contract and tort law: legal incentives and technical challenges , 2020, Artificial Intelligence and Law.

[3]  Douglas J. Gillan,et al.  Attributing Blame to Robots: I. The Influence of Robot Autonomy , 2019, Hum. Factors.

[4]  Ari M. Blitz,et al.  First spine surgery utilizing real-time image-guided robotic assistance , 2019, Computer assisted surgery.

[5]  Iyad Rahwan,et al.  Blaming humans in autonomous vehicle accidents: Shared responsibility across levels of automation , 2018, ArXiv.

[6]  Zheng Li,et al.  Robotic Endoscopy , 2018, Visceral Medicine.

[7]  Peter Kazanzides,et al.  Medical robotics—Regulatory, ethical, and legal considerations for increasing levels of autonomy , 2017, Science Robotics.

[8]  Ryan S. Decker,et al.  Supervised autonomous robotic soft tissue surgery , 2016, Science Translational Medicine.

[9]  M. C. Elish,et al.  Moral Crumple Zones: Cautionary Tales in Human-Robot Interaction , 2019, Engaging Science, Technology, and Society.

[10]  Pamela J. Hinds,et al.  Who Should I Blame? Effects of Autonomy and Transparency on Attributions in Human-Robot Interaction , 2006, ROMAN 2006 - The 15th IEEE International Symposium on Robot and Human Interactive Communication.

[11]  Kenneth S. Abraham,et al.  The forms and functions of tort law , 1999 .

[12]  Nick Hounsell,et al.  Public Views towards Implementation of Automated Vehicles in Urban Areas , 2016 .

[13]  Jason Husgen Product liability suits involving drug or device manufacturers and physicians: the learned intermediary doctrine and the physician's duty to warn. , 2014, Missouri medicine.