A Virtual Reality Study of Help Recognition and Metacognition with an Affective Agent

Advances in the use of virtual affective agents for therapeutic purposes in mental health opened a research avenue to improve the way patients interpret other's behavior as helpful instead of menacing. Here, the authors propose an original paradigm based on affective computing and virtual reality technologies requiring the assessment of helping intentions as well as self-monitoring metacognition. Sixteen healthy subjects played a 38-turns card games with a virtual affective agent MARC during which they had to guess between two cards the one that would be color-matched with another card. Their guesses could be oriented by the agent's emotional displays. Three subjective ratings on a percentage analog scale were recorded after each trial: helpfulness, self-monitoring, and sympathy. Help recognition and self-monitoring metacognitive ratings raise the question of the importance to enhance both components in therapeutic situations within psychiatric populations. Overall, this study exemplifies the promising use of virtual reality settings for future studies in the medical psychology field.

[1]  Ramón López-Cózar,et al.  A framework for the assessment of synthetic personalities according to user perception , 2014, Int. J. Hum. Comput. Stud..

[2]  Jean-Claude Martin,et al.  Impact of Expressive Wrinkles on Perception of a Virtual Character's Facial Expressions of Emotions , 2009, IVA.

[3]  Kenji Suzuki,et al.  A card-playing humanoid playmate for human behavioral analysis , 2012, Entertain. Comput..

[4]  Peter H. M. P. Roelofsma,et al.  The Effect of Dominance Manipulation on the Perception and Believability of an Emotional Expression , 2014, Emotion Modeling.

[5]  J. Os,et al.  The relationship between neurocognition and social cognition with functional outcomes in schizophrenia: A meta-analysis , 2011, Neuroscience & Biobehavioral Reviews.

[6]  David Heaney,et al.  The consultation and relational empathy (CARE) measure: development and preliminary validation and reliability of an empathy-based consultation process measure. , 2004, Family practice.

[7]  Thomas J Nasca,et al.  Physician empathy: definition, components, measurement, and relationship to gender and specialty. , 2002, The American journal of psychiatry.

[8]  Mary L. Phillips,et al.  Commonalities in social and non-social cognitive impairments in adults with autism spectrum disorder and schizophrenia , 2013, Schizophrenia Research.

[9]  Ana Paiva,et al.  Detecting user engagement with a robot companion using task and social interaction-based features , 2009, ICMI-MLMI '09.

[10]  Kevin N. Ochsner,et al.  The Social-Emotional Processing Stream: Five Core Constructs and Their Translational Potential for Schizophrenia and Beyond , 2008, Biological Psychiatry.

[11]  Brett Browning,et al.  Believable Robot Characters , 2011, AI Mag..

[12]  A. J. Fridlund.  Human Facial Expression: An Evolutionary View , 1994 .

[13]  F. James Rohlf,et al.  Biometry: The Principles and Practice of Statistics in Biological Research , 1969 .

[14]  Xingguo Xiong,et al.  Prototyping of Robotic Systems: Applications of Design and Implementation , 2012 .

[15]  B. Parkinson,et al.  Personality and Social Psychology Review Do Facial Movements Express Emotions or Communicate Motives? Personality and Social Psychology Review Additional Services and Information for Do Facial Movements Express Emotions or Communicate Motives? Emotion Expression vs. Motive Communication Emotion Expr , 2022 .

[16]  G. Horstmann.  What do facial expressions convey: feeling states, behavioral intentions, or action requests? , 2003, Emotion.

[17]  G. Fink,et al.  It's in your eyes--using gaze-contingent stimuli to create truly interactive paradigms for social cognitive and affective neuroscience. , 2010, Social cognitive and affective neuroscience.

[18]  Morris Goldsmith,et al.  Real-world cognitive--and metacognitive--dysfunction in schizophrenia: a new approach for measuring (and remediating) more "right stuff". , 2006, Schizophrenia bulletin.

[19]  Kai Vogeley,et al.  A second-person neuroscience in interaction 1 , 2013, Behavioral and Brain Sciences.

[20]  Jean Decety,et al.  A neurobehavioral evolutionary perspective on the mechanisms underlying empathy , 2012, Progress in Neurobiology.

[21]  J. Bensing,et al.  Analyzing the "nature" and "specific effectiveness" of clinical empathy: a theoretical overview and contribution towards a theory-based research agenda. , 2009, Patient education and counseling.

[22]  Alireza Basohbat Novinzadeh,et al.  Modeling and Designing an Intelligent Controller using Bond Graph for a Satellite Controlled by Magnetic Actuators , 2012, Int. J. Intell. Mechatronics Robotics.

[23]  Koen V. Hindriks,et al.  The icat as a natural interaction partner: playing go fish with a robot , 2011, AAMAS'11.

[24]  Bingbing Liu,et al.  Prototyping of Fully Autonomous Indoor Patrolling Mobile Robots , 2014 .

[25]  Nadine Bazin,et al.  ToMRemed : une technique de remédiation cognitive centrée sur la théorie de l’esprit pour les patients schizophrènes , 2010 .

[26]  Jonathan Gratch,et al.  The effect of expression of anger and happiness in computer agents on negotiations with humans , 2011, AAMAS.