Robot Accident Investigation: a case study in Responsible Robotics

Robot accidents are inevitable. Although rare, they have been happening since assembly-line robots were first introduced in the 1960s. But a new generation of social robots are now becoming commonplace. Often with sophisticated embedded artificial intelligence (AI) social robots might be deployed as care robots to assist elderly or disabled people to live independently. Smart robot toys offer a compelling interactive play experience for children and increasingly capable autonomous vehicles (AVs) the promise of hands-free personal transport and fully autonomous taxis. Unlike industrial robots which are deployed in safety cages, social robots are designed to operate in human environments and interact closely with humans; the likelihood of robot accidents is therefore much greater for social robots than industrial robots. This paper sets out a draft framework for social robot accident investigation; a framework which proposes both the technology and processes that would allow social robot accidents to be investigated with no less rigour than we expect of air or rail accident investigations. The paper also places accident investigation within the practice of responsible robotics, and makes the case that social robotics without accident investigation would be no less irresponsible than aviation without air accident investigation.

[1]  Richard Owen,et al.  The UK Engineering and Physical Sciences Research Council's commitment to a framework for responsible innovation , 2014 .

[2]  Heikki Summala,et al.  Sleep-related fatal vehicle accidents: characteristics of decisions made by multidisciplinary investigation teams. , 2004, Sleep.

[3]  Marina Jirotka,et al.  Human-robot relationships and the development of responsible social robots , 2019, HTTF.

[4]  Marina Jirotka,et al.  The Case for an Ethical Black Box , 2017, TAROS.

[5]  Rodolphe Gelin,et al.  A Mass-Produced Sociable Humanoid Robot: Pepper: The First Machine of Its Kind , 2018, IEEE Robotics & Automation Magazine.

[6]  R. Fisher,et al.  Memory-Enhancing Techniques for Investigative Interviewing: The Cognitive Interview , 1992 .

[7]  Tom Rodden,et al.  Principles of robotics: regulating robots in the real world , 2017, Connect. Sci..

[8]  M. C. Elish,et al.  Moral Crumple Zones: Cautionary Tales in Human-Robot Interaction , 2019, Engaging Science, Technology, and Society.

[9]  Raja Chatila,et al.  The IEEE Global Initiative on Ethics of Autonomous and Intelligent Systems , 2019, Robotics and Well-Being.

[10]  Guy H. Walker,et al.  Human Factors Methods: A Practical Guide for Engineering and Design , 2012 .

[11]  Patrick Waterson,et al.  Systems thinking, the Swiss Cheese Model and accident analysis: a comparative systemic analysis of the Grayrigg train derailment using the ATSB, AcciMap and STAMP models. , 2014, Accident; analysis and prevention.

[12]  Alan Frank. Winfield,et al.  Ethical standards in robotics and AI , 2019, Nature Electronics.

[13]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[14]  Roger K. Moore.  A Bayesian explanation of the ‘Uncanny Valley’ effect and related psychological phenomena , 2012, Scientific Reports.

[15]  Hampton C. Gabler,et al.  Crash Severity: A Comparison of Event Data Recorder Measurements with Accident Reconstruction Estimates , 2004 .

[16]  Charles Vincent,et al.  Investigating for Improvement: Building a National Safety Investigator for Healthcare , 2017 .

[17]  Carl Macrae,et al.  Making risks visible: Identifying and interpreting threats to airline flight safety , 2009 .

[18]  Anna Jobin,et al.  The global landscape of AI ethics guidelines , 2019, Nature Machine Intelligence.

[19]  Sarah Spiekermann,et al.  Value-based Engineering for Ethics by Design , 2020, ArXiv.

[20]  Joanna Bryson,et al.  Standardizing Ethical Design for Artificial Intelligence and Autonomous Systems , 2017, Computer.

[21]  Carl Macrae,et al.  The problem with incident reporting , 2015, BMJ Quality & Safety.

[22]  Timo Malm,et al.  Safety of Interactive Robotics—Learning from Accidents , 2010, Int. J. Soc. Robotics.

[23]  Ravishankar K. Iyer,et al.  Adverse Events in Robotic Surgery: A Retrospective Study of 14 Years of FDA Data , 2015, PloS one.

[24]  Marina Jirotka,et al.  Ethical governance is essential to building trust in robotics and artificial intelligence systems , 2018, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[25]  E. Broadbent.  Interactions With Robots: The Truths We Reveal About Ourselves , 2017, Annual review of psychology.

[26]  Carl Macrae,et al.  Close Calls: Managing Risk and Resilience in Airline Flight Safety , 2014 .