Human-robot relationships and the development of responsible social robots

The contemporary development of social robots has been accompanied by concerns over their capacity to cause harm to humans. Our RoboTIPS study sets out to design and trial an innovative design feature that will advance the safe operation of social robots and foster societal trust. The Ethical Black Box (EBB) collects data about a robot's actions in real time and in context; when an incident occurs, this data can be used within a wider investigation process to determine what went wrong and prevent similar adverse events. In this paper we draw on Lucy Suchman's groundbreaking work on human-machine relationships to elucidate the goals, practices and potential impact of our study. We align with Suchman's positioning of safety as an accomplishment of situated action and draw on her analysis to describe the actions of the EBB-enhanced social robot as contingent on context and the robot's status as a social agent. We also describe shared priorities in our methodological approaches. We close with observations on how participatory design and an ethnomethodologically-informed stance towards data collection and analysis can contribute to the field of responsible innovation (RI), which seeks to ensure that innovations are undertaken in the public interest and provide societal value.

[1]  Bengt Sandblad,et al.  Human-Computer Interaction (HCI) , 2013 .

[2]  D. Mccormick Normal Accidents , 1991, Bio/Technology.

[3]  Eric Laurier,et al.  The "Studies in Ethnomethodology" Are a Way of Understanding and Handling Empirical Materials and Thoughts. Eric Laurier in Conversation With Hannes Krämer, Dominik Gerst & René Salomon , 2019 .

[4]  A. R. Mathew,et al.  Human-Computer Interaction (HCI): An overview , 2011, 2011 IEEE International Conference on Computer Science and Automation Engineering.

[5]  Marina Jirotka,et al.  Ethical governance is essential to building trust in robotics and artificial intelligence systems , 2018, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[6]  Christian Heath,et al.  Documents and professional practice: “bad” organisational reasons for “good” clinical records , 1996, CSCW '96.

[7]  Christian Heath,et al.  The Naturalistic Experiment , 2018 .

[8]  R. V. Schomberg A Vision of Responsible Research and Innovation , 2013 .

[9]  Morana Alaăź,et al.  Social robots: Things or agents? , 2016 .

[10]  Morana Alac,et al.  Social robots: Things or agents? , 2015, AI & SOCIETY.

[11]  Wiebe E. Bijker,et al.  Science in action : how to follow scientists and engineers through society , 1989 .

[12]  H. Garfinkel Studies in Ethnomethodology , 1968 .

[13]  Krishna M Kavi,et al.  Beyond the black box , 2010, IEEE Spectrum.

[14]  L. Suchman Human-Machine Reconfigurations: Plans and situated actions (2nd edition). , 2007 .

[15]  Marina Jirotka,et al.  Towards a closer dialogue between policy and practice: responsible design in HCI , 2014, CHI.

[16]  Robert Caverly,et al.  Responsible Innovation: Managing the Responsible Emergence of Science and Innovation in Society , 2013 .

[17]  Lucy Suchman,et al.  Human-Machine Reconfigurations: Plans and Situated Actions , 2006 .

[18]  Marina Jirotka,et al.  The Case for an Ethical Black Box , 2017, TAROS.

[19]  Lucy Suchman Plans and situated actions: the problem of human-machine communication , 1987 .

[20]  Takayuki Kanda,et al.  Human-Robot Interaction in Social Robotics , 2012 .