Micro-expression recognition based on local binary patterns from three orthogonal planes and nearest neighbor method

Micro-expression is a very short and rapid involuntary facial expression, which reveals suppressed affect. Recognizing micro-expression can help to accurately grasp the real feelings of people, a result that can have an important practical impact. But the scholars' studies have demonstrated that real micro-expression is difficult to identify. There are two main restrictive factors, one is the need of a comprehensive and typical database, and the other one is the need of a suitable method. This paper proposes a combination of local binary patterns from three orthogonal planes (LBP-TOP) and the nearest neighbor method, and does experiments on a large database. At last, a reasonable result is obtained.

[1]  Siri Schubert.  A Look Tells All , 2006 .

[2]  B. Stuart,et al.  Nonverbal Behavior and Psychopathology , 2008 .

[3]  L. Fleischer.  Telling Lies Clues To Deceit In The Marketplace Politics And Marriage , 2016 .

[4]  Robin Marantz Henig.  Looking for the lie: scientists are using brain imaging and other tools as new kinds of lie detectors. But trickier even than finding the source of deception might be navigating a world without it. , 2006, The New York times magazine.

[5]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Yuichi Ohta,et al.  Facial micro-expressions recognition using high speed camera and 3D-gradient descriptor , 2009, ICDP.

[7]  Dmitry B. Goldgof,et al.  Towards macro- and micro-expression spotting in video using strain patterns , 2009, 2009 Workshop on Applications of Computer Vision (WACV).

[8]  Yuichi Ohta,et al.  Detection and measurement of facial micro-expression characteristics for psychological analysis (ヒューマン情報処理) , 2010 .

[9]  Matti Pietikäinen,et al.  Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Qi Wu,et al.  The Machine Knows What You Are Hiding: An Automatic Micro-expression Recognition System , 2011, ACII.

[11]  Matti Pietikäinen,et al.  Recognising spontaneous facial micro-expressions , 2011, 2011 International Conference on Computer Vision.

[12]  P. Ekman,et al.  A New Test to Measure Emotion Recognition Ability: Matsumoto and Ekman's Japanese and Caucasian Brief Affect Recognition Test (JACBART) , 2000 .

[13]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[14]  Dmitry B. Goldgof,et al.  Macro- and micro-expression spotting in long videos using spatio-temporal strain , 2011, Face and Gesture 2011.

[15]  P. Ekman,et al.  Nonverbal leakage and clues to deception. , 1969, Psychiatry.

[16]  Matti Pietikäinen,et al.  A Spontaneous Micro-expression Database: Inducement, collection and baseline , 2013, 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[17]  E. A. Haggard,et al.  Micromomentary facial expressions as indicators of ego mechanisms in psychotherapy , 1966 .