Facial emotion recognition system for autistic children: a feasible study based on FPGA implementation

Children with autism spectrum disorder have difficulty in understanding the emotional and mental states from the facial expressions of the people they interact. The inability to understand other people’s emotions will hinder their interpersonal communication. Though many facial emotion recognition algorithms have been proposed in the literature, they are mainly intended for processing by a personal computer, which limits their usability in on-the-move applications where portability is desired. The portability of the system will ensure ease of use and real-time emotion recognition and that will aid for immediate feedback while communicating with caretakers. Principal component analysis (PCA) has been identified as the least complex feature extraction algorithm to be implemented in hardware. In this paper, we present a detailed study of the implementation of serial and parallel implementation of PCA in order to identify the most feasible method for realization of a portable emotion detector for autistic children. The proposed emotion recognizer architectures are implemented on Virtex 7 XC7VX330T FFG1761-3 FPGA. We achieved 82.3 % detection accuracy for a word length of 8 bits.

[1]  K. H. Kim,et al.  Emotion recognition system using short-term monitoring of physiological signals , 2004, Medical and Biological Engineering and Computing.

[2]  Michael J. Lyons,et al.  Coding facial expressions with Gabor wavelets , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[3]  U. Frith,et al.  Exploring the cognitive phenotype of autism: weak "central coherence" in parents and siblings of children with autism: I. Experimental tests. , 2001, Journal of child psychology and psychiatry, and allied disciplines.

[4]  Dian Tjondronegoro,et al.  Facial Expression Recognition Using Facial Movement Features , 2011, IEEE Transactions on Affective Computing.

[5]  G. Pfurtscheller,et al.  Feature extraction for on-line EEG classification using principal components and linear discriminants , 2006, Medical and Biological Engineering and Computing.

[6]  Stefan Koelsch,et al.  Med Biol Eng Comput (2010) 48:423–433 DOI 10.1007/s11517-010-0592-3 ORIGINAL ARTICLE , 2022 .

[7]  Fumio Hara,et al.  The recognition of basic facial expressions by neural network , 1991, [Proceedings] 1991 IEEE International Joint Conference on Neural Networks.

[8]  Shaogang Gong,et al.  Facial expression recognition based on Local Binary Patterns: A comprehensive study , 2009, Image Vis. Comput..

[9]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[10]  Ling Guan,et al.  Human emotion recognition using real 3D visual features from Gabor library , 2010, 2010 IEEE International Workshop on Multimedia Signal Processing.

[11]  T. Yamada,et al.  Effects of facial color on virtual facial image synthesis for dynamic facial color and expression under laughing emotion , 2004, RO-MAN 2004. 13th IEEE International Workshop on Robot and Human Interactive Communication (IEEE Catalog No.04TH8759).

[12]  A. Prasad Vinod,et al.  Low Complexity FPGA Implementation of Emotion Detection for Autistic Children , 2013, 2013 7th International Symposium on Medical Information and Communication Technology (ISMICT).

[13]  Tao Wang,et al.  Hardware efficient architectures of improved Jacobi method to solve the eigen problem , 2010, 2010 2nd International Conference on Computer Engineering and Technology.

[14]  Dongbing Gu,et al.  Static face detection and emotion recognition with FPGA support , 2006, ICINCO-RA.

[15]  Abbes Amira,et al.  Improved SVD systolic array and implementation on FPGA , 2003, Proceedings. 2003 IEEE International Conference on Field-Programmable Technology (FPT) (IEEE Cat. No.03EX798).

[16]  Mary Hart,et al.  Autism/excel study , 2005, Assets '05.

[17]  Amit Konar,et al.  Emotion Recognition From Facial Expressions and Its Control Using Fuzzy Logic , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[18]  A. P. Vinod,et al.  Hardware efficient FPGA implementation of emotion recognizer for autistic children , 2013, 2013 IEEE International Conference on Electronics, Computing and Communication Technologies.

[19]  Antonia Hamilton,et al.  Recognition of Emotions in Autism: A Formal Meta-Analysis , 2013, Journal of autism and developmental disorders.

[20]  Steven J. Simske,et al.  Recognition of emotions in interactive voice response systems , 2003, INTERSPEECH.

[21]  E. LoPresti,et al.  Assistive technology for cognition [Understanding the Needs of Persons with Disabilities] , 2008, IEEE Engineering in Medicine and Biology Magazine.

[22]  J. F. Böhme,et al.  Reducing the computations of the singular value decomposition array given by Brent and Luk , 1991 .

[23]  Ching-Chih Tsai,et al.  Interactive emotion recognition using Support Vector Machine for human-robot interaction , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.