Micro-Expression Recognition Using Robust Principal Component Analysis and Local Spatiotemporal Directional Features

One of important cues of deception detection is micro-expression. It has three characteristics: short duration, low intensity and usually local movements. These characteristics imply that micro-expression is sparse. In this paper, we use the sparse part of Robust PCA (RPCA) to extract the subtle motion information of micro-expression. The local texture features of the information are extracted by Local Spatiotemporal Directional Features (LSTD). In order to extract more effective local features, 16 Regions of Interest (ROIs) are assigned based on the Facial Action Coding System (FACS). The experimental results on two micro-expression databases show the proposed method gain better performance. Moreover, the proposed method may further be used to extract other subtle motion information (such as lip-reading, the human pulse, and micro-gesture etc.) from video.

[1]  Xiaolan Fu,et al.  Face Recognition and Micro-expression Recognition Based on Discriminant Tensor Subspace Analysis Plus Extreme Learning Machine , 2014, Neural Processing Letters.

[2]  Matti Pietikäinen,et al.  Towards a practical lipreading system , 2011, CVPR 2011.

[3]  Guoying Zhao,et al.  CASME II: An Improved Spontaneous Micro-Expression Database and the Baseline Evaluation , 2014, PloS one.

[4]  Ling Wang,et al.  Robust principal component analysis for sparse face recognition , 2013, 2013 Fourth International Conference on Intelligent Control and Information Processing (ICICIP).

[5]  Trac D. Tran,et al.  Video frame interpolation via weighted robust principal component analysis , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[6]  Zhixun Su,et al.  Linearized Alternating Direction Method with Adaptive Penalty for Low-Rank Representation , 2011, NIPS.

[7]  Matti Pietikäinen,et al.  Recognising spontaneous facial micro-expressions , 2011, 2011 International Conference on Computer Vision.

[8]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[9]  C. Eckart,et al.  The approximation of one matrix by another of lower rank , 1936 .

[10]  Dimitris N. Metaxas,et al.  Motion Profiles for Deception Detection Using Visual Cues , 2010, ECCV.

[11]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[12]  Ville Ojansivu,et al.  Blur Insensitive Texture Classification Using Local Phase Quantization , 2008, ICISP.

[13]  Bao-Liang Lu,et al.  A robust principal component analysis algorithm for EEG-based vigilance estimation , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[14]  Xiaolan Fu,et al.  Face Recognition and Micro-expression based on Discriminant Tensor Subspace Analysis plus Extreme Learning Machine , 2013 .

[15]  P. Ekman,et al.  Nonverbal leakage and clues to deception. , 1969, Psychiatry.

[16]  Matti Pietikäinen,et al.  A Spontaneous Micro-expression Database: Inducement, collection and baseline , 2013, 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[17]  Matti Pietikäinen,et al.  Visual Speaker Identification with Spatiotemporal Directional Features , 2013, ICIAR.

[18]  Fernando De la Torre,et al.  Robust Principal Component Analysis for Brain Imaging , 2013, ICANN.

[19]  John Wright,et al.  Robust Principal Component Analysis: Exact Recovery of Corrupted Low-Rank Matrices via Convex Optimization , 2009, NIPS.

[20]  Yuichi Ohta,et al.  Facial micro-expressions recognition using high speed camera and 3D-gradient descriptor , 2009, ICDP.

[21]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Paul Ekman,et al.  Lie Catching and Microexpressions , 2009 .

[23]  Matti Pietikäinen,et al.  Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  D. Matsumoto,et al.  Evidence for training the ability to read microexpressions of emotion , 2011 .

[25]  Wen-Jing Yan,et al.  How Fast are the Leaked Facial Expressions: The Duration of Micro-Expressions , 2013 .