Comparative Performance Evaluation of Artificial Neural Network-Based vs. Human Facial Expression Classifiers for Facial Expression Recognition

Towards building new, friendlier human-computer interaction and multimedia interactive services systems, we developed a neural network-based image processing system (called NEU-FACES), which first determines automatically whether or not there are any faces in given images and, if so, returns the location and extent of each face. Next, NEU-FACES uses neural network-based classifiers, which allow the classification of several facial expressions from features that we develop and describe. In the process of building NEU-FACES, we conducted an empirical study in which we specify related design requirements and, study statistically the expression recognition performance of humans. In this paper, we make and evaluation of performance of our NEU-FACES system versus the human’s expression recognition performance.

[1]  Ioanna-Ourania Stathopoulou,et al.  A NEW NEURAL NETWORK-BASED METHOD FOR FACE DETECTION IN IMAGES AND APPLICATIONS IN BIOINFORMATICS , 2004 .

[2]  L. R Gleitman,et al.  Proceedings of the twenty-second annual conference of the cognitive science society , 2000 .

[3]  Garrison W. Cottrell,et al.  A Six-Unit Network is All You Need to Discover Happiness , 2000 .

[4]  Larry S. Davis,et al.  Human expression recognition from motion using a radial basis function network architecture , 1996, IEEE Trans. Neural Networks.

[5]  Ioanna-Ourania Stathopoulou,et al.  Facial Expression Classification: Specifying Requirements for an Automated System , 2006, KES.

[6]  G.A. Tsihrintzis,et al.  Detection and expression classification systems for face images (FADECS) , 2005, IEEE Workshop on Signal Processing Systems Design and Implementation, 2005..

[7]  Ioanna-Ourania Stathopoulou,et al.  Evaluation of the discrimination power of features extracted from 2-D and 3-D facial images for facial expression analysis , 2005, 2005 13th European Signal Processing Conference.

[8]  Demetri Terzopoulos,et al.  Analysis and Synthesis of Facial Image Sequences Using Physical and Anatomical Models , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Alex Pentland,et al.  Coding, Analysis, Interpretation, and Recognition of Facial Expressions , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Maria Virvou,et al.  Mobile educational features in authoring tools for personalised tutoring , 2005, Comput. Educ..

[11]  M. Virvou,et al.  Relating Error Diagnosis and Performance Characteristics for Affect Perception and Empathy in an Educational Software Application , 2003 .

[12]  P. Ekman,et al.  Unmasking the Face: A Guide to Recognizing Emotions From Facial Expressions , 1975 .

[13]  Christine L. Lisetti,et al.  Automatic facial expression interpretation: Where human-computer interaction, artificial intelligence and cognitive science intersect , 2000 .

[14]  Michael J. Black,et al.  Recognizing facial expressions under rigid and non-rigid facial motions , 1995 .

[15]  Ioanna-Ourania Stathopoulou,et al.  An improved neural-network-based face detection and facial expression classification system , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[16]  Maria Virvou,et al.  Affective Student Modeling Based on Microphone and Keyboard User Actions , 2006 .