Facial Virtual Tracking: A System to Mirror Emotions

The capacity for social interaction, communication and recognition of emotions is a characteristic that the human being possesses and that allows him/her to be socially included. However, some have difficulties in expressing and interpreting emotional states, which can contribute to their marginalisation in society. A particular case is children with Autism Spectrum Disorder. These children have difficulties in social interaction and manifest repetitive patterns. In this work, a serious game is being developed in which an avatar (ZECA avatar) is able to interact with the child, through challenges and training of certain facial movements that will be validated by the system, facilitating imitation and recognition of emotions (happiness, sadness, anger, surprise and fear). The tests performed in the laboratory environment allowed to conclude the adequacy of the game for promoting emotional states in a friendly way.

[1]  F. Soares,et al.  Using a humanoid robot as the promoter of interaction with children in the context of educational games , 2017 .

[2]  Marek P. Michalowski,et al.  Keepon : A Playful Robot for Research, Therapy, and Entertainment (Original Paper) , 2009 .

[3]  Cristina P. Santos,et al.  A pilot study using imitation and storytelling scenarios as activities for labelling emotions by children with autism using a humanoid robot , 2014, 4th International Conference on Development and Learning and on Epigenetic Robotics.

[4]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[5]  João Sena Esteves,et al.  Mirroring and recognizing emotions through facial expressions for a RoboKind platform , 2017, 2017 IEEE 5th Portuguese Meeting on Bioengineering (ENBENG).

[6]  Filomena O. Soares,et al.  An Application to Promote Emotional Skills in Children with Autism Spectrum Disorders , 2018, JCSG.

[7]  A. Billard,et al.  Chapter 18 Games Children with Autism Can Play With Robota , a Humanoid Robotic Doll , 1995 .

[8]  Filomena O. Soares,et al.  Mirroring emotion system - on-line synthesizing facial expressions on a robot face , 2016, 2016 8th International Congress on Ultra Modern Telecommunications and Control Systems and Workshops (ICUMT).

[9]  C. Darwin The Expression of the Emotions in Man and Animals , .

[10]  Peter Robinson,et al.  Cross-dataset learning and person-specific normalisation for automatic Action Unit detection , 2015, 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[11]  W. Marsden I and J , 2012 .

[12]  Abdul Rahman Omar,et al.  Humanoid robot NAO as a teaching tool of emotion recognition for children with autism using the Android app , 2014, 2014 International Symposium on Micro-NanoMechatronics and Human Science (MHS).

[13]  Marek P. Michalowski,et al.  Keepon , 2009, Int. J. Soc. Robotics.

[14]  Chrystopher L. Nehaniv,et al.  Title of paper : KASPAR – A Minimally Expressive Humanoid Robot for Human-Robot Interaction Research , 2009 .

[15]  P. Ekman,et al.  What the face reveals : basic and applied studies of spontaneous expression using the facial action coding system (FACS) , 2005 .