He said, she said, it said: Effects of robot group membership and human authority on people's willingness to follow their instructions

Research in HRI indicates that people follow a robot's instructions even when they are incorrect. However, when a robot's instructions or requests contradict those of a human (e.g. an authoritative experimenter), people obey the human instead. This might be due to the experimenter's perceived ingroup status, or to their higher presumed authority compared to the robot. This study manipulated experimenter authority (high, low) and robot group membership (ingroup, neutral) to test how they affected responses to conflicting orders from the two agents depending on the request's importance (big, small). While there was no main effect of group membership and authority on most participant behavior, when experimenter authority was low and the robot an ingroup member, participants defied the experimenter's instructions to turn off an ingroup robot at the end of the experiment, following the robot's instructions instead. Further, request importance affected participant behavior. Participants typically followed the robot's low-importance requests (e.g., moving from one chair to another), but not high-importance requests (e.g., how to perform a simulated task of diagnosing and talking to patients).

[1]  M. Hogg,et al.  Knowing what to think by knowing who you are: self-categorization and the nature of norm formation, conformity and group polarization. , 1990, The British journal of social psychology.

[2]  Brian Scassellati,et al.  The effect of presence on human-robot interaction , 2008, RO-MAN 2008 - The 17th IEEE International Symposium on Robot and Human Interactive Communication.

[3]  H. Tajfel,et al.  Social categorization and intergroup behaviour , 1971 .

[4]  S. Milgram Obedience to Authority: An Experimental View , 1975 .

[5]  S. Milgram BEHAVIORAL STUDY OF OBEDIENCE. , 1963, Journal of abnormal psychology.

[6]  Christoph Bartneck,et al.  “Daisy, daisy, give me your answer do!” switching off a robot , 2007, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[7]  Alan R. Wagner,et al.  Overtrust of robots in emergency evacuation scenarios , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[8]  L. Doob The psychology of social norms. , 1937 .

[9]  F. Eyssel,et al.  Social categorization of social robots: anthropomorphism as a function of robot group membership. , 2012, The British journal of social psychology.

[10]  C.D. Martin,et al.  The Media Equation: How People Treat Computers, Television and New Media Like Real People and Places [Book Review] , 1997, IEEE Spectrum.

[11]  N. Haslam,et al.  Attributing and denying humanness to others , 2008 .

[12]  F. H. Hankins,et al.  The Psychology of Social Norms , 1937 .

[13]  Selma Sabanovic,et al.  Teammates first: Favoring ingroup robots over outgroup humans , 2017, 2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[14]  S. Asch Forming impressions of personality. , 1946, Journal of Abnormal Psychology.

[15]  E. Miller Handbook of Social Psychology , 1946, Mental Health.

[16]  D. Mackie,et al.  Intergroup relations. , 2019, Annual Review of Psychology.

[17]  Heather Pon-Barry,et al.  Prosodic manifestations of confidence and uncertainty in spoken language , 2008, INTERSPEECH.

[18]  Sara B. Kiesler,et al.  The advisor robot: tracing people's mental model from a robot's physical attributes , 2006, HRI '06.

[19]  Clifford Nass,et al.  The media equation - how people treat computers, television, and new media like real people and places , 1996 .