Automatic detection of non-posed facial action units

Automatic facial expression recognition has received great attention in the past two decades due to many applications, such as developmental psychology and human-computer interface design. In most of the current studies, less attention has been paid to the recognition of non-posed facial expressions or measuring their intensity levels. In this paper, we first introduce a novel spontaneous facial expression database called DISFA, which contains videos of 27 young adults, expressing non-posed facial expressions. In this database, the absence and presence of 12 action units (AUs) as well as their intensity levels (i.e., 0-5 scale) were coded by a facial action coding system (FACS) coder. Then, we present an automatic system which can detect facial AUs described by FACS. We compared different facial representation techniques and classifiers for automatic AU detection. As a result of our experiments, we achieved 97% average detection rate using localized Gabor features with SVM classifiers.

[1]  Vinay Bettadapura,et al.  Face Expression Recognition and Analysis: The State of the Art , 2012, ArXiv.

[2]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[3]  Gwen Littlewort,et al.  Recognizing facial expression: machine learning and application to spontaneous behavior , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[4]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[5]  Daniel S. Messinger,et al.  A framework for automated measurement of the intensity of non-posed Facial Action Units , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[6]  Mohammad H. Mahoor,et al.  A Multimodal Approach for Face Modeling and Recognition , 2008, IEEE Transactions on Information Forensics and Security.

[7]  Shaogang Gong,et al.  Facial expression recognition based on Local Binary Patterns: A comprehensive study , 2009, Image Vis. Comput..

[8]  Robert Pless,et al.  A Survey of Manifold Learning for Images , 2009, IPSJ Trans. Comput. Vis. Appl..

[9]  Simon Lucey,et al.  Investigating Spontaneous Facial Action Recognition through AAM Representations of the Face , 2007 .

[10]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.