Automatic Identification of Anthropological Face Landmarks for Emotion Detection

We propose a facial landmark system constructed on anthropological principles that is intended to substitute the (costly) use of Action Units (AU) in characterizing facial dynamics, for the purpose of automatic emotion detection. We demonstrate the suitability of the method by implementing a lightweight automatic Anthropological Face Landmarks (AFL) identification algorithm and compare the task of emotional valence classification using the proposed system to explicitly using AU labels. Despite the comparison being unfair to our method (AUs are labeled by experts, while the landmarks are detected automatically), we show that even in a Proof-of-Concept setting, our system follows closely the performance of detecting emotions with Action Units.

[1]  Stefanos Zafeiriou,et al.  Incremental Face Alignment in the Wild , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  T. Thompson.  Self-awareness: Behavior analysis and neuroscience , 2008, The Behavior analyst.

[3]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[4]  Deva Ramanan,et al.  Face detection, pose estimation, and landmark localization in the wild , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Qiang Ji,et al.  Facial Landmark Detection: A Literature Survey , 2018, International Journal of Computer Vision.

[6]  Tim M. den Uyl,et al.  Automated facial coding: validation of basic emotions and FACS AUs in FaceReader , 2014 .

[7]  P. Ekman,et al.  Constants across cultures in the face and emotion. , 1971, Journal of personality and social psychology.

[8]  G. R. Leon,et al.  PSYCHOLOGY AND CULTURE DURING LONG DURATION SPACE MISSIONS , 2007 .

[9]  L.A. Wickman,et al.  Human performance considerations for a Mars mission , 2006, 2006 IEEE Aerospace Conference.

[10]  Takeo Kanade,et al.  The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[11]  Z. Obermeyer,et al.  Predicting the Future - Big Data, Machine Learning, and Clinical Medicine. , 2016, The New England journal of medicine.

[12]  J. Cameron,et al.  Adaptive response studies may help choose astronauts for long-term space travel. , 2003, Advances in space research : the official journal of the Committee on Space Research.

[13]  Lawrence A. Palinkas,et al.  Psychology and culture during long-duration space missions ☆ , 2009 .

[14]  Josephine Sullivan,et al.  One millisecond face alignment with an ensemble of regression trees , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Maja Pantic,et al.  Web-based database for facial expression analysis , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[16]  David J. Kriegman,et al.  Localizing parts of faces using a consensus of exemplars , 2011, CVPR.

[17]  Maja Pantic,et al.  Gauss-Newton Deformable Part Models for Face Alignment In-the-Wild , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Pietro Perona,et al.  Robust Face Landmark Estimation under Occlusion , 2013, 2013 IEEE International Conference on Computer Vision.

[19]  Peter Robinson,et al.  OpenFace: An open source facial behavior analysis toolkit , 2016, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV).

[20]  Stefanos Zafeiriou,et al.  Robust Discriminative Response Map Fitting with Constrained Local Models , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Shiguang Shan,et al.  Coarse-to-Fine Auto-Encoder Networks (CFAN) for Real-Time Face Alignment , 2014, ECCV.