Micro-Expression Recognition Based on the Spatio-Temporal Feature

Micro-expressions are brief and involuntary facial movements which reveal persons’ real emotions. Recognition of microexpression is a great challenge due to its properties of short duration and low intensity. To address this problem, we propose a ROI (Region of Interest)-based spatio-temporal feature named Dense Sampling Optical-flow’s Mean Magnitude and Angle (DS-OMMA) for micro-expression recognition. Namely, partitioning the facial region into some adaptive ROIs discovers the facial spatial structure, and optical flow explores the temporal information by capturing small muscular movements on the face. Moreover, dense sampling reduces the effect of noise caused by head movement or illumination. The proposed approach is evaluated on two spontaneous micro-expression datasets, i.e., CASME2 and CAS(ME)2. The experimental results show that our proposed DS-OMMA feature performs better than the baseline feature LBP-TOP and the state-of-the-art feature MDMO in recognition accuracy.

[1]  Cordelia Schmid,et al.  Dense Trajectories and Motion Boundary Descriptors for Action Recognition , 2013, International Journal of Computer Vision.

[2]  Sujing Wang,et al.  CAS(ME)2: A Database of Spontaneous Macro-expressions and Micro-expressions , 2016, HCI.

[3]  Guoying Zhao,et al.  Micro-expression Recognition Using Dynamic Textures on Tensor Independent Color Space , 2014, 2014 22nd International Conference on Pattern Recognition.

[4]  Mark G. Frank,et al.  Police Lie Detection Accuracy: The Effect of Lie Scenario , 2009, Law and human behavior.

[5]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[6]  John See,et al.  LBP with Six Intersection Points: Reducing Redundant Information in LBP-TOP for Micro-expression Recognition , 2014, ACCV.

[7]  Yuichi Ohta,et al.  Facial micro-expressions recognition using high speed camera and 3D-gradient descriptor , 2009, ICDP.

[8]  Peter Robinson,et al.  OpenFace: An open source facial behavior analysis toolkit , 2016, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV).

[9]  P. Ekman,et al.  Nonverbal leakage and clues to deception. , 1969, Psychiatry.

[10]  Matti Pietikäinen,et al.  A Spontaneous Micro-expression Database: Inducement, collection and baseline , 2013, 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[11]  Xiaolan Fu,et al.  Face Recognition and Micro-expression Recognition Based on Discriminant Tensor Subspace Analysis Plus Extreme Learning Machine , 2014, Neural Processing Letters.

[12]  Guoying Zhao,et al.  Micro-Expression Recognition Using Robust Principal Component Analysis and Local Spatiotemporal Directional Features , 2014, ECCV Workshops.

[13]  Descriptors Higher.  Annual Meeting of the International Communication Association , 1974 .

[14]  Qi Wu,et al.  For micro-expression recognition: Database and suggestions , 2014, Neurocomputing.

[15]  KokSheik Wong,et al.  Subtle Expression Recognition Using Optical Strain Weighted Features , 2014, ACCV Workshops.

[16]  Matti Pietikäinen,et al.  Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Guoying Zhao,et al.  CASME II: An Improved Spontaneous Micro-Expression Database and the Baseline Evaluation , 2014, PloS one.

[18]  Peter Robinson,et al.  Constrained Local Neural Fields for Robust Facial Landmark Detection in the Wild , 2013, 2013 IEEE International Conference on Computer Vision Workshops.

[19]  Venugopal Govindaraju,et al.  Behavior and Security , 2009 .

[20]  Guoying Zhao,et al.  A Main Directional Mean Optical Flow Feature for Spontaneous Micro-Expression Recognition , 2016, IEEE Transactions on Affective Computing.