A Distributed Tool to Perform Dynamic Therapies for Social Cognitive Deficit Through Avatars

Patients suffering from Social Cognition Deficits have difficulties when trying to understand its interlocutor emotional status. In order to contribute to the treatment of this deficit, we have developed a distributed application to offer remote therapies and using the concept of avatars. By using this application, therapist embody avatars that convey their emotions, voices and gestures. Therefore, this application enables patient to recognize the avatars emotions which, in turn, are controlled by the therapist. For this aim, a distributed software has been developed along with different devices such as a Kinect v2 for motion tracking and a facial expression analyzer. Unity has been used for the development of this application to make this type of remote therapy possible.

[1]  José Manuel Pastor,et al.  Smart environment architecture for emotion detection and regulation , 2016, J. Biomed. Informatics.

[2]  Ken-ichi Anjyo,et al.  Direct Manipulation Blendshapes , 2010, IEEE Computer Graphics and Applications.

[3]  Russell M. Taylor,et al.  VRPN: a device-independent, network-transparent VR peripheral system , 2001, VRST '01.

[4]  Marília Prada,et al.  The many faces of a face: Comparing stills and videos of facial expressions in eight dimensions (SAVE database) , 2017, Behavior research methods.

[5]  Elena Navarro,et al.  Exploiting Awareness for the Development of Collaborative Rehabilitation Systems , 2017, Mob. Inf. Syst..

[6]  S. Baron-Cohen,et al.  The Autism-Spectrum Quotient (AQ): Evidence from Asperger Syndrome/High-Functioning Autism, Malesand Females, Scientists and Mathematicians , 2001, Journal of autism and developmental disorders.

[7]  H. Macher,et al.  FIRST EXPERIENCES WITH KINECT V2 SENSOR FOR CLOSE RANGE 3D MODELLING , 2015 .

[8]  Elena Navarro,et al.  Towards an Awareness Interpretation for Physical and Cognitive Rehabilitation Systems , 2016, UCAmI.

[9]  Daniel McDuff,et al.  AFFDEX SDK: A Cross-Platform Real-Time Multi-Face Expression Recognition Toolkit , 2016, CHI Extended Abstracts.

[10]  Lauri Nummenmaa,et al.  Perceptual and affective mechanisms in facial expression recognition: An integrative review , 2016, Cognition & emotion.

[11]  Karl F. MacDorman,et al.  The Uncanny Valley [From the Field] , 2012, IEEE Robotics Autom. Mag..

[12]  Elena Navarro,et al.  An Innovative Tool to Create Neurofeedback Games for ADHD Treatment , 2017, IWINAC.

[13]  Skye McDonald,et al.  Facial Emotion Recognition Deficits following Moderate–Severe Traumatic Brain Injury (TBI): Re-examining the Valence Effect and the Role of Emotion Intensity , 2014, Journal of the International Neuropsychological Society.

[14]  Michelle Menard,et al.  Game Development with Unity , 2011 .

[15]  A. Guastella,et al.  Social Cognition Deficits and Psychopathic Traits in Young People Seeking Mental Health Treatment , 2013, PloS one.

[16]  Philip D. Harvey,et al.  Social cognition: the key factor predicting social outcome in people with schizophrenia? , 2010, Psychiatry (Edgmont (Pa. : Township)).