A Facial Expression Recognition Approach Using DCNN for Autistic Children to Identify Emotions

In this paper, an initial work of a research is discussed which is to teach young autistic children recognizing human facial expression with the help of computer vision and image processing. This paper mostly discusses the initial work of facial expression recognition using a deep convolutional neural network. The Kaggle's FER2013 dataset has been used to train and experiment with a deep convolutional neural network model. Once a satisfactory result is achieved, the dataset is modified with pictures of four different lighting conditions and each of these datasets is again trained with the same model. This is necessary for the end goal of the research which is to recognize facial expression in any possible environment. Finally, the comparison between results with different datasets is discussed and future work of the project is outlined.

[1]  Martin Kampel,et al.  Facial Expression Recognition using Convolutional Neural Networks: State of the Art , 2016, ArXiv.

[2]  P. Ekman,et al.  Constants across cultures in the face and emotion. , 1971, Journal of personality and social psychology.

[3]  Christina Huang,et al.  Combining convolutional neural networks for emotion recognition , 2017, 2017 IEEE MIT Undergraduate Research Technology Conference (URTC).

[4]  R. Hobson.  The autistic child's appraisal of expressions of emotion: a further study. , 1986, Journal of child psychology and psychiatry, and allied disciplines.

[5]  C. Deruelle,et al.  Motion and Emotion: A Novel Approach to the Study of Face Processing by Young Autistic Children , 2001, Journal of autism and developmental disorders.

[6]  R. Hobson,et al.  The salience of facial expression for autistic children. , 1987, Journal of child psychology and psychiatry, and allied disciplines.

[7]  A Duff,et al.  Facial expression recognition as a candidate marker for autism spectrum disorder: how frequent and severe are deficits? , 2018, Molecular Autism.

[8]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[9]  Shanmuganathan Raman,et al.  Facial Expression Recognition Using Visual Saliency and Deep Learning , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[10]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[11]  Richard Hans Robert Hahnloser,et al.  Digital selection and analogue amplification coexist in a cortex-inspired silicon circuit , 2000, Nature.

[12]  Alexandru Savoiu,et al.  Recognizing Facial Expressions Using Deep Learning , 2022 .

[13]  Jyoti Kumari,et al.  Facial Expression Recognition: A Survey , 2015 .

[14]  Hui Wang,et al.  Deep Convolutional Neural Network for Facial Expression Recognition Using Facial Parts , 2017, 2017 IEEE 15th Intl Conf on Dependable, Autonomic and Secure Computing, 15th Intl Conf on Pervasive Intelligence and Computing, 3rd Intl Conf on Big Data Intelligence and Computing and Cyber Science and Technology Congress(DASC/PiCom/DataCom/CyberSciTech).

[15]  Sepp Hochreiter,et al.  Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) , 2015, ICLR.

[16]  J. Boucher,et al.  Unfamiliar face recognition in relatively able autistic children. , 1992, Journal of child psychology and psychiatry, and allied disciplines.

[17]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[18]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[19]  A. Prasad Vinod,et al.  Facial emotion recognition system for autistic children: a feasible study based on FPGA implementation , 2015, Medical & Biological Engineering & Computing.

[20]  Tarik A. Rashid,et al.  Convolutional Neural Networks based Method for Improving Facial Expression Recognition , 2016 .