Agent Appearance Modulates Mind Attribution and Social Attention in Human-Robot Interaction

Gaze following occurs automatically in social interactions, but the degree to which we follow gaze strongly depends on whether an agent is believed to have a mind and is therefore socially relevant for the interaction. The current paper investigates whether the social relevance of a robot can be manipulated via its physical appearance and whether there is a linear relationship between appearance and gaze following in a counter-predictive gaze cueing paradigm (i.e., target appears with a high likelihood opposite of the gazed-at location). Results show that while robots are capable of inducing gaze following, the degree to which gaze is passively followed does not linearly decrease with physical human-likeness. Rather, the relationship between appearance and gaze following is best described by an inverted u-shaped pattern, with automatic cueing effects (i.e., attending to the cued location) for agents of mixed human-likeness and reversed cueing effects (i.e., attending to the predicted location) for agents of either full human-likeness (100% human) or full robot-likeness (100% robot). The results are interpreted with regard to cognitive resource theory and design implications are discussed.

[1]  J. V. Bavel,et al.  Group membership alters the threshold for mind perception: The role of social identity, collective identification, and intergroup threat , 2014 .

[2]  M. Posner,et al.  Orienting of Attention* , 1980, The Quarterly journal of experimental psychology.

[3]  N. Clayton,et al.  Mental-state attribution drives rapid, reflexive gaze following , 2010, Attention, perception & psychophysics.

[4]  N. Kawai.  Attentional shift by eye gaze requires joint attention: Eye gaze cues are unique to shift attention1 , 2011 .

[5]  C. Frith,et al.  Development and neurophysiology of mentalizing. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[6]  A. Kingstone,et al.  The eyes have it! Reflexive orienting is triggered by nonpredictive gaze , 1998 .

[7]  Illah R. Nourbakhsh,et al.  A survey of socially interactive robots , 2003, Robotics Auton. Syst..

[8]  C. Frith,et al.  The Neural Basis of Mentalizing , 2006, Neuron.

[9]  Christian A. Gonzalez,et al.  Seeing Minds in Others – Can Agents with Robotic Appearance Have Human-Like Preferences? , 2016, PloS one.

[10]  Nicola S. Clayton,et al.  Social Cognition Modulates the Sensory Coding of Observed Gaze Direction , 2009, Current Biology.

[11]  Brian Scassellati,et al.  Robot gaze does not reflexively cue human attention , 2011, CogSci.

[12]  Thalia Wheatley,et al.  Social Connection Modulates Perceptions of Animacy , 2014, Psychological science.

[13]  P. Rabbitt,et al.  Reflexive and voluntary orienting of visual attention: time course of activation and resistance to interruption , 1989 .

[14]  Alan Kingstone,et al.  Taking control of reflexive social attention , 2005, Cognition.

[15]  Jan Zwickel,et al.  I See What You Mean: How Attentional Selection Is Shaped by Ascribing Intentions to Others , 2012, PloS one.

[16]  D. Lundqvist,et al.  Karolinska Directed Emotional Faces , 2015 .

[17]  K. LaBar,et al.  Please Scroll down for Article Visual Cognition Modulation of Reflexive Orienting to Gaze Direction by Facial Expressions , 2022 .

[18]  Eunil Park,et al.  The effect of robot's behavior vs. appearance on communication with humans , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[19]  M. Peterson,et al.  Watch out! Directional threat-related postures cue attention and the eyes , 2016, Cognition & emotion.

[20]  E. Wiese,et al.  Beliefs about the Minds of Others Influence How We Process Sensory Information , 2014, PloS one.

[21]  Amy M. Shapiro,et al.  The Relationship between Prior Knowledge and Interactive Overviews during Hypermedia-Aided Learning , 1999 .