Investigating the effect of cardio-visual synchrony on prosocial behavior towards a social robot

Background: Robots are being designed to alleviate the burden of social isolation and loneliness, particularly among older adults for whom these issues are more widespread. While good intentions underpin these developments, the reality is that many of these robots are abandoned within a short period of time. To encourage the longer-term use and utility of such robots, researchers are exploring ways to increase robot likeability and facilitate attachment. Results from experimental psychology suggest that interpersonal synchrony (the overlap of movement/sensation between two agents) increases the extent to which people like one another. Methods: To investigate the possibility that synchrony could facilitate people’s liking towards a robot, we undertook a between-subjects experiment in which participants interacted with a robot programmed to illuminate at the same rate, or 20% slower, than their heart rate. To quantify the impact of cardio-visual synchrony on prosocial attitudes and behaviors toward this robot, participants completed self-report questionnaires, a gaze-cueing task, and were asked to strike the robot with a mallet. Results: Contrary to pre-registered hypotheses, results revealed no differences in self-reported liking of the robot, gaze cueing effects, or the extent to which participants hesitated to hit the robot between the synchronous and asynchronous groups. Conclusions: The quantitative data described above, as well as qualitative data collected in semi-structured interviews, provided rich insights into people’s behaviours and thoughts when socially engaging with a humanoid social robot, and call into question the use of the broad “Likeability” measurement, and the appropriateness of the ‘hesitance to hit’ paradigm as a measure of attachment to a robotic system.

[1]  J. Kilner,et al.  People can identify the likely owner of heartbeats by looking at individuals’ faces , 2022, Cortex.

[2]  M. Tsakiris,et al.  From ‘gut feelings’ to first impressions: Phase dependent cardio-visual signals bias the perceived trustworthiness of faces , 2022 .

[3]  Yuhan Xiong,et al.  The use of social robots in classrooms: A review of field-based studies , 2021 .

[4]  Emily S. Cross,et al.  “Hit the Robot on the Head With This Mallet” – Making a Case for Including More Open Questions in HRI Research , 2020, Frontiers in Robotics and AI.

[5]  Kyveli Kompatsiari,et al.  It’s in the Eyes: The Engaging Role of Eye Contact in HRI , 2019, Int. J. Soc. Robotics.

[6]  Z. Wang Building Experiments with PsychoPy , 2021, Eye-Tracking with Python and Pylink.

[7]  R. Gilder,et al.  The effect of PARO robotic seals for hospitalized patients with dementia: A feasibility study. , 2020, Geriatric nursing.

[8]  Ron Chrisley A Human-Centered Approach to AI Ethics , 2020 .

[9]  Emily S. Cross,et al.  Social Cognition in the Age of Human–Robot Interaction , 2020, Trends in Neurosciences.

[10]  Daniel H. Grollman,et al.  An Experimental Ethics Approach to Robot Ethics Education , 2020, AAAI.

[11]  Russell H. Taylor,et al.  Combating COVID-19—The role of robotics in managing public health and infectious diseases , 2020, Science Robotics.

[12]  Serge Thill,et al.  Longitudinal Diary Data: Six Months Real-world Implementation of Affordable Companion Robots for Older People in Supported Living , 2020, HRI.

[13]  Emily S. Cross,et al.  No evidence for enhanced likeability and social motivation towards robots after synchrony experience , 2020, Interaction Studies.

[14]  C. Willemse,et al.  At first sight: robots’ subtle eye movement parameters affect human attentional engagement, spontaneous attunement and perceived human-likeness , 2020, Paladyn J. Behav. Robotics.

[15]  Rosalind W. Picard,et al.  Engineering Music to Slow Breathing and Invite Relaxed Physiology , 2019, 2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII).

[16]  T. Tanioka Nursing and Rehabilitative Care of the Elderly Using Humanoid Robots. , 2019, The journal of medical investigation : JMI.

[17]  Jordi Albo-Canals,et al.  “I’ll take care of you,” said the robot , 2019, Paladyn J. Behav. Robotics.

[18]  G. Metta,et al.  On the role of eye contact in gaze cueing , 2018, Scientific Reports.

[19]  Emily S. Cross,et al.  From automata to animate beings: the scope and limits of attributing socialness to artificial agents , 2018, Annals of the New York Academy of Sciences.

[20]  O. Blanke,et al.  Cardio-visual full body illusion alters bodily self-consciousness and tactile processing in somatosensory cortex , 2018, Scientific Reports.

[21]  Emily S. Cross,et al.  The Perception of Emotion in Artificial Agents , 2018, IEEE Transactions on Cognitive and Developmental Systems.

[22]  Daniel T. Smith,et al.  Mental State Attributions Mediate the Gaze Cueing Effect , 2018, Vision.

[23]  Felix D. Schönbrodt,et al.  Bayes factor design analysis: Planning for compelling evidence , 2016, Psychonomic Bulletin & Review.

[24]  Joseph A. Bulbulia,et al.  To be in synchrony or not? A meta-analysis of synchrony's effects on behavior, perception, cognition and affect , 2017 .

[25]  James Everett Young,et al.  Wizard of Awwws: Exploring Psychological Impact on the Researchers in Social HRI Experiments , 2017, HRI.

[26]  Päivi Heikkilä,et al.  A Social Service Robot in a Shopping Mall: Expectations of the Management, Retailers and Consumers , 2017, HRI.

[27]  Steven J. Stroessner,et al.  The Robotic Social Attributes Scale (RoSAS): Development and Validation , 2017, 2017 12th ACM/IEEE International Conference on Human-Robot Interaction (HRI.

[28]  M. Brosnan,et al.  The Development and Validation of the Empathy Components Questionnaire (ECQ) , 2017, PloS one.

[29]  John P. A. Ioannidis,et al.  A manifesto for reproducible science , 2017, Nature Human Behaviour.

[30]  M. Tsakiris,et al.  Heartfelt Self: Cardio‐Visual Integration Affects Self‐Face Recognition and Interoceptive Cortical Processing , 2016, Cerebral cortex.

[31]  D. Caligiore,et al.  Designing Socially Assistive Robot (SAR) for Cognitive Child-Robot Interaction (CCRI) with children with Autism Spectrum Disorder - The case of “+me” , 2017 .

[32]  Oliver Lemon,et al.  The MuMMER Project: Engaging Human-Robot Interaction in Real-World Public Spaces , 2016, ICSR.

[33]  A. Göritz,et al.  Prosocial Consequences of Interpersonal Synchrony , 2016, Zeitschrift fur Psychologie.

[34]  G. Cheng,et al.  Embodied artificial agents for understanding human social cognition , 2016, Philosophical Transactions of the Royal Society B: Biological Sciences.

[35]  Denise Y. Geiskkovitch,et al.  Please continue, we need more data: an exploration of obedience to robots , 2016 .

[36]  Kerstin Dautenhahn,et al.  In Good Company? Perception of Movement Synchrony of a Non-Anthropomorphic Robot , 2015, PloS one.

[37]  Cynthia Breazeal,et al.  Empathic concern and the effect of stories in human-robot interaction , 2015, 2015 24th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[38]  Takanori Shibata,et al.  Comparison of Verbal and Emotional Responses of Elderly People with Mild/Moderate Dementia and Those with Severe Dementia in Responses to Seal Robot, PARO , 2014, Front. Aging Neurosci..

[39]  Lazelle E Benefield,et al.  Aging in place: merging desire with reality. , 2014, The Nursing clinics of North America.

[40]  S. Hirche,et al.  Rhythm Patterns Interaction - Synchronization Behavior for Human-Robot Joint Action , 2014, PloS one.

[41]  L. Langley,et al.  Reflexive orienting in response to short- and long-duration gaze cues in young, young-old, and old-old adults , 2014, Attention, perception & psychophysics.

[42]  H. Critchley,et al.  Multisensory integration across exteroceptive and interoceptive domains modulates self-experience in the rubber-hand illusion , 2013, Neuropsychologia.

[43]  Ana Paiva,et al.  Social Robots for Long-Term Interaction: A Survey , 2013, International Journal of Social Robotics.

[44]  Antoine Piau,et al.  Aging society and gerontechnology: A solution for an independent living? , 2013, The journal of nutrition, health & aging.

[45]  Leif D. Nelson,et al.  A 21 Word Solution , 2012 .

[46]  Jan Zwickel,et al.  I See What You Mean: How Attentional Selection Is Shaped by Ascribing Intentions to Others , 2012, PloS one.

[47]  K. Covinsky,et al.  Loneliness in older persons: a predictor of functional decline and death. , 2012, Archives of internal medicine.

[48]  H. O’connell,et al.  Loneliness and cognition in older people: The Dublin Healthy Ageing study , 2012, Aging & mental health.

[49]  Jodi L. Whitaker,et al.  “Remain Calm. Be Kind.” Effects of Relaxing Video Games on Aggressive and Prosocial Behavior , 2012 .

[50]  Leif D. Nelson,et al.  False-Positive Psychology , 2011, Psychological science.

[51]  Laurel D. Riek,et al.  Exposure to Cinematic Depictions of Robots and Attitudes Towards Them , 2011 .

[52]  G. Fink,et al.  Minds Made for Sharing: Initiating Joint Attention Recruits Reward-related Neurocircuitry , 2010, Journal of Cognitive Neuroscience.

[53]  J. Cacioppo,et al.  Who Sees Human? , 2010, Perspectives on psychological science : a journal of the Association for Psychological Science.

[54]  N. Clayton,et al.  Mental-state attribution drives rapid, reflexive gaze following , 2010, Attention, perception & psychophysics.

[55]  G. Fink,et al.  It's in your eyes--using gaze-contingent stimuli to create truly interactive paradigms for social cognitive and affective neuroscience. , 2010, Social cognitive and affective neuroscience.

[56]  Michael J. Hove,et al.  It's all in the timing: Interpersonal synchrony increases affiliation , 2009 .

[57]  Takayuki Kanda,et al.  My robotic doppelgänger - a critical look at the Uncanny Valley , 2009, RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication.

[58]  Nicola S. Clayton,et al.  Social Cognition Modulates the Sensory Coding of Observed Gaze Direction , 2009, Current Biology.

[59]  Anthony F. Norcio,et al.  A Systematic Review of Technologies Designed to Improve and Assist Cognitive Decline for Both the Current and Future Aging Populations , 2009, HCI.

[60]  Louise C Hawkley,et al.  Loneliness predicts reduced physical activity: cross-sectional & longitudinal analyses. , 2009, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[61]  J. Forlizzi,et al.  Intelligent assistive technology applications to dementia care: current capabilities, limitations, and future challenges. , 2009, The American journal of geriatric psychiatry : official journal of the American Association for Geriatric Psychiatry.

[62]  J. Broekens,et al.  Assistive social robots in elderly care: a review , 2009 .

[63]  Ehud Sharlin,et al.  Toward Acceptable Domestic Robots: Applying Insights from Social Psychology , 2009, Int. J. Soc. Robotics.

[64]  Dana Kulic,et al.  Measurement Instruments for the Anthropomorphism, Animacy, Likeability, Perceived Intelligence, and Perceived Safety of Robots , 2009, Int. J. Soc. Robotics.

[65]  R. Whelan Effective Analysis of Reaction Time Data , 2008 .

[66]  Tatsuya Nomura,et al.  Prediction of Human Behavior in Human--Robot Interaction Using Psychological Scales for Anxiety and Negative Attitudes Toward Robots , 2008, IEEE Transactions on Robotics.

[67]  Jun Hu,et al.  Exploring the abuse of robots , 2008 .

[68]  Takayuki Kanda,et al.  Is The Uncanny Valley An Uncanny Cliff? , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[69]  S. Tipper,et al.  Gaze cueing of attention: visual attention, social cognition, and individual differences. , 2007, Psychological bulletin.

[70]  Monica Martinussen,et al.  Likert-based vs. semantic differential-based scorings of positive psychological constructs: A psychometric comparison of two versions of a scale measuring resilience. , 2006 .

[71]  L. Hawkley,et al.  Loneliness as a specific risk factor for depressive symptoms: cross-sectional and longitudinal analyses. , 2006, Psychology and aging.

[72]  M. Skubic,et al.  A technology and nursing collaboration to help older adults age in place. , 2005, Nursing outlook.

[73]  C. Bartneck,et al.  Cruelty towards robots , 2005 .

[74]  C. Bartneck,et al.  Robot abuse : a limitation of the media equation , 2005 .

[75]  M. Pinquart,et al.  Risk factors for loneliness in adulthood and old age--a meta-analysis. , 2003 .

[76]  H. Bouma,et al.  GERONTECHNOLOGY: CREATING ENABLING ENVIRONMENTS FOR THE CHALLENGES AND OPPORTUNITIES OF AGING , 2000 .

[77]  V. Bruce,et al.  You must see the point: automatic processing of cues to the direction of social attention. , 2000, Journal of experimental psychology. Human perception and performance.

[78]  J. Hietanen Does your gaze direction and head orientation shift my visual attention? , 1999, Neuroreport.

[79]  V. Bruce,et al.  Reflexive visual orienting in response to the social attention of others , 1999 .

[80]  S. Baron-Cohen,et al.  Gaze Perception Triggers Reflexive Visuospatial Orienting , 1999 .

[81]  A. Kingstone,et al.  The eyes have it! Reflexive orienting is triggered by nonpredictive gaze , 1998 .

[82]  J. Haxby,et al.  Changes in visuospatial attention over the adult lifespan , 1993, Neuropsychologia.

[83]  A. Aron,et al.  Inclusion of Other in the Self Scale and the structure of interpersonal closeness , 1992 .

[84]  Fred D. Davis,et al.  User Acceptance of Computer Technology: A Comparison of Two Theoretical Models , 1989 .

[85]  S Milgram,et al.  Some Conditions of Obedience and Disobedience to Authority , 1965 .