Intensity Estimation of the Real-World Facial Expression

Affect computing or Automatic affect sensing has aroused extensive interests of researchers in the area of machine learning and pattern recognition. Most previous research focused on face detection and emotion recognition while our research explores facial intensity estimation, which cares more about the dynamic changes on a face. CK+ database and Real-world Affective Face Database (RAF-DB) are used to test and implement the algorithms in this paper. To settle the problem of intensity estimation, classification and ranking algorithms are used for training and testing intensity levels. Meanwhile, the performance of five different feature representations is evaluated using the accuracy results obtained from classification approach. By using the optimum feature representation as the input to the next designed training model, ranking results can be attained. Techniques of Learning to Rank in the area of information retrieval are utilized to combat the situation of intensity ranking. RankSVM and RankBoost are used as frameworks to estimate the ranking scores based on sequences of images. The experimental results of scoring are evaluated by the indexes used in information retrieval. Algorithms used in the research are well organized and compared to generate an optimal model for the ranking task.

[1]  Yi-Ping Hung,et al.  Intensity Rank Estimation of Facial Expressions Based on a Single Image , 2013, 2013 IEEE International Conference on Systems, Man, and Cybernetics.

[2]  Mohammad H. Mahoor,et al.  DISFA: A Spontaneous Facial Action Intensity Database , 2013, IEEE Transactions on Affective Computing.

[3]  John McDonald,et al.  Automatic estimation of the dynamics of facial expression using a three-level model of intensity , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[4]  Lijun Yin,et al.  FERA 2015 - second Facial Expression Recognition and Analysis challenge , 2015, 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[5]  Daniel S. Messinger,et al.  A framework for automated measurement of the intensity of non-posed Facial Action Units , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[6]  Maja Pantic,et al.  The first facial expression recognition and analysis challenge , 2011, Face and Gesture 2011.

[7]  Qingshan Liu,et al.  RankBoost with l1 regularization for facial expression recognition and intensity estimation , 2009, 2009 IEEE 12th International Conference on Computer Vision.