Generating Facial Emotions for Diagnosis and Training

The ability to process and identify facial emotions is an essential factor for an individuals social interaction. There are certain psychiatric disorders that can limit an individuals ability to recognize emotions in facial expressions. This problem could be confronted by making use of computational techniques in order to develop learning environments for the diagnosis, evaluation and training in identifying facial emotions. This paper presents an approach that uses image processing techniques, formal languages, anthropometry and Facial Action Coding System (FACS) to generate caricatures that represent facial movements related to neutral, satisfaction, sadness, anger, disgust, fear and surprise emotions. The rules that define the emotions were determined using an AND-OR graph to enable generating these images in a flexible manner. An evaluation conducted with healthy volunteers showed that some emotions are more easily recognized, while for other emotions the caricatures need to be further improved. This is a promising approach, since the parameters used provide flexibility to define the emotional intensity that must be represented.

[1]  Bogdan J. Matuszewski,et al.  Facial Expression Biometrics Using Statistical Shape Models , 2009, EURASIP J. Adv. Signal Process..

[2]  Jean-Claude Martin,et al.  Multimedia interfaces for users with high functioning autism: An empirical investigation , 2008, Int. J. Hum. Comput. Stud..

[3]  P. Gosselin,et al.  Le Decodage De Prototypes Emotionnels Faciaux , 1995 .

[4]  Nilanjan Sarkar,et al.  Assessing the Utility of a Virtual Environment for Enhancing Facial Affect Recognition in Adolescents with Autism , 2014, Journal of autism and developmental disorders.

[5]  Shichuan Du,et al.  The resolution of facial expressions of emotion. , 2011, Journal of vision.

[6]  Ming Yang,et al.  Semantics-driven portrait cartoon stylization , 2010, 2010 IEEE International Conference on Image Processing.

[7]  P. Ekman,et al.  Constants across cultures in the face and emotion. , 1971, Journal of personality and social psychology.

[8]  Hong Chen,et al.  A Hierarchical Compositional Model for Face Representation and Sketching , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  V. Leitáo,et al.  Computer Graphics: Principles and Practice , 1995 .

[10]  C. Cacou Anthropometry of the head and face , 1995 .

[11]  Stephan F Taylor,et al.  Brain mapping biomarkers of socio-emotional processing in schizophrenia. , 2012, Schizophrenia bulletin.

[12]  Matthew Stone,et al.  An anthropometric face model using variational techniques , 1998, SIGGRAPH.

[13]  Beny Lafer,et al.  Facial emotion recognition in bipolar disorder: a critical review. , 2009, Revista brasileira de psiquiatria.

[14]  Jake Porway,et al.  A stochastic graph grammar for compositional object representation and recognition , 2009, Pattern Recognit..

[15]  G Kirouac,et al.  [Decoding facial emotional prototypes]. , 1995, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[16]  M. Carter Computer graphics: Principles and practice , 1997 .

[17]  Klaus Mathiak,et al.  Recognition Profile of Emotions in Natural and Virtual Faces , 2008, PloS one.

[18]  Alex Martin,et al.  Facial Emotion Recognition in Autism Spectrum Disorders: A Review of Behavioral and Neuroimaging Studies , 2010, Neuropsychology Review.

[19]  N. Sarkar,et al.  Design of a Virtual Reality Based Adaptive Response Technology for Children With Autism , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[20]  Shiguang Shan,et al.  A Compositional and Dynamic Model for Face Aging , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .