Automated recognition of facial expressions authenticity

Recognition of facial expressions authenticity is quite troublesome for humans. Therefore, it is an interesting topic for the computer vision community, as the developed algorithms for facial expressions authenticity estimation may be used as indicators of deception. This paper discusses the state-of-the art methods developed for smile veracity estimation and proposes a plan of development and validation of a novel approach to automated discrimination between genuine and posed facial expressions. The proposed fully automated technique is based on the extension of the high-dimensional Local Binary Patterns (LBP) to the spatio-temporal domain and combines them with the dynamics of facial landmarks movements. The proposed technique will be validated on several existing smile databases and a novel database created with the use of a high speed camera. Finally, the developed framework will be applied for the detection of deception in real life scenarios.

[1]  P. Ekman,et al.  The Duchenne smile: emotional expression and brain physiology. II. , 1990, Journal of personality and social psychology.

[2]  Matti Pietikäinen,et al.  Performance evaluation of texture measures with classification based on Kullback discrimination of distributions , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[3]  P. Ekman,et al.  The ability to detect deceit generalizes across different types of high-stake lies. , 1997, Journal of personality and social psychology.

[4]  Paul Ekman,et al.  A Few Can Catch a Liar , 1999 .

[5]  Susan R. Fussell.  The Verbal Communication of Emotions : Interdisciplinary Perspectives , 2002 .

[6]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Paul Ekman,et al.  The wizards of deception detection. , 2004 .

[8]  Jeffrey F. Cohn,et al.  The Timing of Facial Motion in posed and Spontaneous Smiles , 2003, Int. J. Wavelets Multiresolution Inf. Process..

[9]  A. Young,et al.  Understanding the recognition of facial identity and facial expression , 2005, Nature Reviews Neuroscience.

[10]  Matthew L. Jensen,et al.  Automatic Extraction of Deceptive Behavioral Cues from Video , 2005, ISI.

[11]  B. Depaulo,et al.  Accuracy of Deception Judgments , 2006, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[12]  J. Cohn,et al.  Movement Differences between Deliberate and Spontaneous Facial Expressions: Zygomaticus Major Action in Smiling , 2006, Journal of nonverbal behavior.

[13]  Matti Pietikäinen,et al.  Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  G. D. Bond,et al.  Deception Detection Expertise , 2008, Law and human behavior.

[15]  Gwen Littlewort,et al.  Toward Practical Smile Detection , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  S. Weinberger.  Airport security: Intent to deceive? , 2010, Nature.

[17]  S. Porter,et al.  Pitfalls and Opportunities in Nonverbal and Verbal Lie Detection , 2010, Psychological science in the public interest : a journal of the American Psychological Society.

[18]  Venu Govindaraju,et al.  Lie to Me: Deceit detection via online behavioral learning , 2011, Face and Gesture 2011.

[19]  Stephen Porter,et al.  OF THE HUMAN FACE Secrets of the Human Face : New Insights Into the Face and Covert Emotions , 2011 .

[20]  Matti Pietikäinen,et al.  Differentiating spontaneous from posed facial expressions within a generic facial expression recognition framework , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[21]  Albert Ali Salah,et al.  Are You Really Smiling at Me? Spontaneous versus Posed Enjoyment Smiles , 2012, ECCV.

[22]  Qing-Song Xu,et al.  Random frog: an efficient reversible jump Markov Chain Monte Carlo-like approach for variable selection with applications to gene selection and disease classification. , 2012, Analytica chimica acta.

[23]  Jian Sun,et al.  Blessing of Dimensionality: High-Dimensional Feature and Its Efficient Compression for Face Verification , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Maja Pantic,et al.  The MAHNOB Laughter database , 2013, Image Vis. Comput..

[25]  Hong Liu,et al.  Spontaneous versus posed smile recognition using discriminative local spatial-temporal descriptors , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[26]  Luc Van Gool,et al.  Face Detection without Bells and Whistles , 2014, ECCV.

[27]  Lin Su,et al.  High-Stakes Deception Detection Based on Facial Expressions , 2014, 2014 22nd International Conference on Pattern Recognition.

[28]  Josephine Sullivan,et al.  One millisecond face alignment with an ensemble of regression trees , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Liang Wang,et al.  Facial smile detection based on deep learning features , 2015, 2015 3rd IAPR Asian Conference on Pattern Recognition (ACPR).

[30]  Albert Ali Salah,et al.  Recognition of Genuine Smiles , 2015, IEEE Transactions on Multimedia.

[31]  James Bailey,et al.  Detection of Deception in the Mafia Party Game , 2015, ICMI.

[32]  Bogdan Smolka,et al.  Silesian Deception Database: Presentation and Analysis , 2015, WMDD@ICMI.

[33]  Davis E. King.  Max-Margin Object Detection , 2015, ArXiv.

[34]  Tal Hassner,et al.  Effective face frontalization in unconstrained images , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Cheng Li,et al.  Face alignment by coarse-to-fine shape searching , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Fei Yang,et al.  Is Interactional Dissynchrony a Clue to Deception? Insights From Automated Analysis of Nonverbal Visual Cues , 2015, IEEE Transactions on Cybernetics.

[37]  Michel Valstar,et al.  Advances, Challenges, and Opportunities in Automatic Facial Expression Recognition , 2016 .

[38]  Bogdan Smolka,et al.  High dimensional local binary patterns for facial expression recognition in the wild , 2016, 2016 18th Mediterranean Electrotechnical Conference (MELECON).