Robot Mirroring: Promoting Empathy with an Artificial Agent by Reflecting the User’s Physiological Affective States

Self-tracking aims to increase awareness, decrease undesired behaviors, and ultimately lead towards a healthier lifestyle. However, inappropriate communication of self- tracking results might cause the opposite effect. Subtle self- tracking feedback is an alternative that can be provided with the aid of an artificial agent representing the self. Hence, we propose a wearable pet that reflects the user’s affective states through visual and haptic feedback. By eliciting empathy and fostering helping behaviors towards it, users would indirectly help themselves. A wearable prototype was built, and three user studies performed to evaluate the appropriateness of the proposed affective representations. Visual representations using facial and body cues were clear for valence and less clear for arousal. Haptic interoceptive patterns emulating heart-rate levels matched the desired feedback urgency levels with a saturation frequency. The integrated visuo-haptic representations matched to participants own affective experience. From the results, we derived three design guidelines for future robot mirroring wearable systems: physical embodiment, interoceptive feedback, and customization.

[1]  Aiko Murata,et al.  Empathizing With a Dissimilar Other , 2012, Personality & social psychology bulletin.

[2]  Peter Robinson,et al.  When my robot smiles at me Enabling human-robot rapport via real-time head gesture mimicry , 2009 .

[3]  Britta Wrede,et al.  Playing a different imitation game: Interaction with an Empathic Android Robot , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[4]  Sylvia D. Kreibig,et al.  Autonomic nervous system activity in emotion: A review , 2010, Biological Psychology.

[5]  Marcel Brass,et al.  Heartfelt imitation: High interoceptive awareness is linked to greater automatic imitation , 2014, Neuropsychologia.

[6]  P. Maurage,et al.  Interoceptive accuracy scores from the heartbeat counting task are problematic: Evidence from simple bivariate correlations , 2018, Biological Psychology.

[7]  D. Ariely,et al.  The 'IKEA Effect': When Labor Leads to Love , 2011 .

[8]  Tan Tian Swee,et al.  Acoustic cardiac signals analysis: a Kalman filter–based approach , 2012, International journal of nanomedicine.

[9]  Karon E. MacLean,et al.  Sketching CuddleBits: Coupled Prototyping of Body and Behaviour for an Affective Robot Pet , 2017, CHI.

[10]  Jessica R. Cauchard,et al.  Breeze: Sharing Biofeedback through Wearable Technologies , 2018, CHI.

[11]  J. Russell.  A circumplex model of affect. , 1980 .

[12]  C. Spielberger,et al.  Manual for the State-Trait Anxiety Inventory , 1970 .

[13]  Fumihide Tanaka,et al.  Socialization between toddlers and robots at an early childhood education center , 2007, Proceedings of the National Academy of Sciences.

[14]  R. Levenson,et al.  Empathy: a physiological substrate. , 1992, Journal of personality and social psychology.

[15]  J. Klayman.  Varieties of Confirmation Bias , 1995 .

[16]  James A. Landay,et al.  ActiVibe: Design and Evaluation of Vibrations for Progress Monitoring , 2016, CHI.

[17]  Julia Fink,et al.  Anthropomorphism and Human Likeness in the Design of Robots and Human-Robot Interaction , 2012, ICSR.

[18]  Benjamin Lok,et al.  Building Virtual Humans with Back Stories: Training Interpersonal Communication Skills in Medical Students , 2014, IVA.

[19]  Tibor Bosse,et al.  Mood Mirroring with an Embodied Virtual Agent: A Pilot Study on the Relationship Between Personalized Visual Feedback and Adherence , 2018, PAAMS.

[20]  M. Cabanac.  What is emotion? , 2002, Behavioural Processes.

[21]  Jérémy Frey.  Heart Rate Monitoring as an Easy Way to Increase Engagement in Human-Agent Interaction , 2015, PhyCS.

[22]  Nicolas Guéguen,et al.  Mimicry and seduction: An evaluation in a courtship context , 2009 .

[23]  J. Bailenson,et al.  Virtual Superheroes: Using Superpowers in Virtual Reality to Encourage Prosocial Behavior , 2013, PloS one.

[24]  K. Neff.  Self-Compassion: An Alternative Conceptualization of a Healthy Attitude Toward Oneself , 2003 .

[25]  J. Cacioppo,et al.  Electromyographic activity over facial muscle regions can differentiate the valence and intensity of affective reactions. , 1986, Journal of personality and social psychology.

[26]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[27]  A. Aron,et al.  Inclusion of Other in the Self Scale and the structure of interpersonal closeness , 1992 .

[28]  G. A. Mendelsohn,et al.  Affect grid : A single-item scale of pleasure and arousal , 1989 .

[29]  R. Baaren,et al.  Mimicry for money: Behavioral consequences of imitation , 2003 .

[30]  A. Schaefer,et al.  Assessing the effectiveness of a large database of emotion-eliciting films: A new tool for emotion researchers , 2010 .

[31]  Ó. Gonçalves,et al.  The Emotional Movie Database (EMDB): A Self-Report and Psychophysiological Study , 2012, Applied psychophysiology and biofeedback.

[32]  Björn Meyer,et al.  What's in a (neutral) face? Personality disorders, attachment styles, and the appraisal of ambiguous social cues. , 2004, Journal of personality disorders.

[33]  Christian Mühl,et al.  Connecting Brains and Bodies: Applying Physiological Computing to Support Social Interaction , 2015, Interact. Comput..

[34]  R. Levenson,et al.  Emotion recognition across cultures: the influence of ethnicity on empathic accuracy and physiological linkage. , 2009, Emotion.