Design and application of facial expression analysis system in empathy ability of children with autism spectrum disorder

Empathy is an important social ability in the early childhood development. One of the significant characteristics of children with autism spectrum disorder (ASD) is their lack of empathy, which makes it difficult for them to feel and understand other people’s emotions and to judge other people’s behavioral intentions, leading to social disorders. This research designs and implements a facial expression analysis system that could obtain and analyze the real-time facial expressions of children when viewing stimulus materials, and then evaluate the differences of empathy ability between ASD children and typical development (TD) children. The results of this research provide new ideas for the evaluation of ASD children, and also help to develop empathy intervention plans for ASD children.

[1]  D. McIntosh,et al.  Rapid facial reactions to emotional facial expressions in typically developing children and children with autism spectrum disorder. , 2008, Journal of experimental child psychology.

[2]  Agata Rozga,et al.  Undifferentiated facial electromyography responses to dynamic, audio-visual emotion displays in individuals with autism spectrum disorders. , 2013, Developmental science.

[3]  Danielle C. Mathersul,et al.  Automatic facial responses to affective stimuli in high-functioning adults with autism spectrum disorder , 2013, Physiology & Behavior.

[4]  Yu Qiao,et al.  Joint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks , 2016, IEEE Signal Processing Letters.

[5]  Agnieszka Landowska,et al.  Applications for investigating therapy progress of autistic children , 2016, 2016 Federated Conference on Computer Science and Information Systems (FedCSIS).

[6]  Pamela Ventola,et al.  A Facial Affect Analysis System for Autism Spectrum Disorder , 2019, 2019 IEEE International Conference on Image Processing (ICIP).

[7]  W. Lawson.  Autism spectrum conditions: the pathophysiological basis for inattention and the new Diagnostic and Statistical Manual of Mental Disorders (DSM-V) , 2013 .

[8]  Pierluigi Carcagnì,et al.  Computational Assessment of Facial Expression Production in ASD Children , 2018, Sensors.

[9]  Pierluigi Carcagnì,et al.  A Computer Vision Based Approach for Understanding Emotional Involvements in Children with Autism Spectrum Disorders , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[10]  D. Warden,et al.  Convergence between physiological, facial and verbal self‐report measures of affective empathy in children , 2007 .

[11]  Krzysztof Pancerz,et al.  Random forest feature selection for data coming from evaluation sheets of subjects with ASDs , 2016, 2016 Federated Conference on Computer Science and Information Systems (FedCSIS).