Comparison of Angle and Size Features with Deep Learning for Emotion Recognition

The robust recognition of a person’s emotion from images is an important task in human-machine interaction. This task can be considered a classification problem, for which a plethora of methods exists. In this paper, the emotion recognition performance of two fundamentally different approaches is compared: classification based on hand-crafted features against deep learning. This comparison is conducted by means of well-established datasets and highlights the benefits and drawbacks of each approach.

[1]  Takeo Kanade,et al.  The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[2]  Edilson de Aguiar,et al.  Facial expression recognition with Convolutional Neural Networks: Coping with few data and the training sample order , 2017, Pattern Recognit..

[3]  Jean-Philippe Thiran,et al.  Towards robust cascaded regression for face alignment in the wild , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[4]  Jürgen Beyerer,et al.  Reduced Feature Set for Emotion Recognition Based on Angle and Size Information , 2018, IAS.

[5]  Min Peng,et al.  NIRFaceNet: A Convolutional Neural Network for Near-Infrared Face Identification , 2016, Inf..

[6]  Mohammad H. Mahoor,et al.  Going deeper in facial expression recognition using deep neural networks , 2015, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV).

[7]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[8]  Davis E. King,et al.  Dlib-ml: A Machine Learning Toolkit , 2009, J. Mach. Learn. Res..

[9]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[10]  Shiguang Shan,et al.  Learning Expressionlets via Universal Manifold Model for Dynamic Facial Expression Recognition , 2015, IEEE Transactions on Image Processing.

[11]  Shiguang Shan,et al.  Deeply Learning Deformable Facial Action Parts Model for Dynamic Expression Analysis , 2014, ACCV.

[12]  Matti Pietikäinen,et al.  Facial expression recognition from near-infrared videos , 2011, Image Vis. Comput..

[13]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.