Facial expression recognition using feature based techniques and model based techniques: A survey

Facial expression is a way of non-verbal communication. A person depicts his/her feelings through facial expressions. In computer systems facial expressions help in verification, identification and authentication. One popular use of facial expression recognition is automatic feedback capture from customers upon reacting to a particular product. Effective recognition technology is in high demand by the common users of today's gadgets and technologies. Facial expression recognition technique is broadly classified into two techniques: Feature based techniques and Model based techniques. The key contribution of this article is that we have analyzed latest state of the art techniques in Feature based techniques and Model based techniques. These techniques are analyzed using various standard public face databases: GEMEP-FERA, BU-3DFE, CK+, Bosphorous, MMI, JAFFE, LFW, FERET, CMU-PIE, Georgia tech, AR, eNTERFACE 05 and FRGC. From our analysis we found that for Feature based Curvelet approach performed on FRGCv2 database gave an excellent 97.83% recognition rate and Model based textured 3D video technique performed on BU-4DFE database gave an excellent 94.34 % recognition rate.

[1]  Wenming Zheng,et al.  Multi-View Facial Expression Recognition Based on Group Sparse Reduced-Rank Regression , 2014, IEEE Transactions on Affective Computing.

[2]  Nicu Sebe,et al.  Special Issue on Multimodal Affective Interaction , 2010, IEEE Trans. Multim..

[3]  Takeo Kanade,et al.  The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[4]  Steven Lawrence Fernandes,et al.  Recognizing facial images using ICA, LPP, MACE Gabor Filters, Score Level Fusion Techniques , 2014, 2014 International Conference on Electronics and Communication Systems (ICECS).

[5]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[6]  John Wright,et al.  RASL: Robust Alignment by Sparse and Low-Rank Decomposition for Linearly Correlated Images , 2012, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Ling Guan,et al.  A Deformable 3-D Facial Expression Model for Dynamic Human Emotional State Recognition , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Mohammed Bennamoun,et al.  An Automatic Framework for Textured 3D Video-Based Facial Expression Recognition , 2014, IEEE Transactions on Affective Computing.

[9]  Hassen Drira,et al.  3D Face Recognition under Expressions, Occlusions, and Pose Variations , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Mohan M. Trivedi,et al.  Head Pose Estimation and Augmented Reality Tracking: An Integrated System and Evaluation for Monitoring Driver Awareness , 2010, IEEE Transactions on Intelligent Transportation Systems.

[11]  Zihan Zhou,et al.  Towards a practical face recognition system: Robust registration and illumination by sparse representation , 2009, CVPR.

[12]  Rafael A. Calvo,et al.  Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications , 2010, IEEE Transactions on Affective Computing.

[13]  V. Vijayakumari,et al.  Face Recognition Techniques: A Survey , 2013, International Journal of Advanced Trends in Computer Science and Engineering.

[14]  Steven Lawrence Fernandes,et al.  Recognizing Faces When Images Are Corrupted by Varying Degree of Noises and Blurring Effects , 2015 .

[15]  Mohan M. Trivedi,et al.  On the Roles of Eye Gaze and Head Dynamics in Predicting Driver's Intent to Change Lanes , 2009, IEEE Transactions on Intelligent Transportation Systems.

[16]  Qingshan Liu,et al.  Exploring facial expressions with compositional features , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  Martin D. Levine,et al.  Fully automated recognition of spontaneous facial expressions in videos using random forest classifiers , 2014, IEEE Transactions on Affective Computing.

[18]  M. Bennamoun,et al.  3-D Face Recognition Using Curvelet Local Features , 2014, IEEE Signal Processing Letters.

[19]  Xuelong Li,et al.  Data Uncertainty in Face Recognition , 2014, IEEE Transactions on Cybernetics.

[20]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Rama Chellappa,et al.  Towards view-invariant expression analysis using analytic shape manifolds , 2011, Face and Gesture 2011.

[22]  P. Nagabhushan,et al.  A Comparative Study on Score Level Fusion Techniques and MACE Gabor Filters for Face Recognition in the Presence of Noises and Blurring Effects , 2013, 2013 International Conference on Cloud & Ubiquitous Computing & Emerging Technologies.

[23]  Zhihong Zeng,et al.  A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions , 2009, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Steven Lawrence Fernandes,et al.  Recognizing facial images using Gabor Wavelets, DCT-Neural Network, Hybrid Spatial Feature Interdependence Matrix , 2014, 2014 2nd International Conference on Devices, Circuits and Systems (ICDCS).

[25]  Mohan M. Trivedi,et al.  Face Expression Recognition by Cross Modal Data Association , 2013, IEEE Transactions on Multimedia.

[26]  P. Nagabhushan,et al.  Robust Face Recognition in the Presence of Noises and Blurring Effects by Fusing Appearance Based Techniques and Sparse Representation , 2013, 2013 2nd International Conference on Advanced Computing, Networking and Security.

[27]  Rama Chellappa,et al.  Component-Based Recognition of Facesand Facial Expressions , 2013, IEEE Transactions on Affective Computing.

[28]  Yong Man Ro,et al.  Intra-Class Variation Reduction Using Training Expression Images for Sparse Representation Based Facial Expression Recognition , 2014, IEEE Transactions on Affective Computing.

[29]  Maja Pantic,et al.  The SEMAINE corpus of emotionally coloured character interactions , 2010, 2010 IEEE International Conference on Multimedia and Expo.