Your Eyes Say You’re Lying: An Eye Movement Pattern Analysis for Face Familiarity and Deceptive Cognition

Eye movement patterns reflect human latent internal cognitive activities. We aim to discover eye movement patterns during face recognition under different conditions of information concealment. These conditions include the degrees of face familiarity and deception or not, namely telling the truth when observing familiar and unfamiliar faces, and deceiving in front of familiar and unfamiliar faces. We apply Hidden Markov models with Gaussian emission to generalise regions and trajectories of eye fixation points under the above four conditions. Our results show that both eye movement patterns and eye gaze regions become significantly different during deception compared with truth-telling. We show the feasibility of detecting deception and further cognitive activity classification using eye movement patterns.

[1]  Srinivas S. Kruthiventi,et al.  Saliency Unified: A Deep Architecture for simultaneous Eye Fixation Prediction and Salient Object Segmentation , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Deborah E. Hannula,et al.  The obligatory effects of memory on eye movements , 2007, Memory.

[3]  Keum-Shik Hong,et al.  Single-trial lie detection using a combined fNIRS-polygraph system , 2015, Front. Psychol..

[4]  Dinggang Shen,et al.  Classifying spatial patterns of brain activity with machine learning methods: Application to lie detection , 2005, NeuroImage.

[5]  L. Fleischer.  Telling Lies Clues To Deceit In The Marketplace Politics And Marriage , 2016 .

[6]  B. Depaulo,et al.  Accuracy of Deception Judgments , 2006, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[7]  Michael Kalloniatis,et al.  Light and Dark Adaptation , 2007 .

[8]  Jeffrey J. Walczyk,et al.  Advancing Lie Detection by Inducing Cognitive Load on Liars: A Review of Relevant Theories and Techniques Guided by Lessons from Polygraph-Based Approaches , 2013, Front. Psychology.

[9]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[10]  Larry S. Davis,et al.  Deception Detection in Videos , 2017, AAAI.

[11]  Deborah E. Hannula,et al.  Worth a Glance: Using Eye Movements to Investigate the Cognitive Neuroscience of Memory , 2010, Front. Hum. Neurosci..

[12]  J S Allen,et al.  Effects of VDT resolution on visual fatigue and readability: an eye movement approach. , 1989, Ergonomics.

[13]  W A Rushton,et al.  Light and dark adaptation. , 1972, Investigative ophthalmology.

[14]  Joseph H. Goldberg,et al.  Identifying fixations and saccades in eye-tracking protocols , 2000, ETRA.

[15]  Tim Chuk,et al.  Understanding eye movements in face recognition using hidden Markov models. , 2014, Journal of vision.

[16]  V Bruce,et al.  Familiarisation with Faces Selectively Enhances Sensitivity to Changes Made to the Eyes , 2001, Perception.

[17]  Gershon Ben-Shakhar,et al.  Do You Know Him? Gaze Dynamics Toward Familiar Faces on a Concealed Information Test , 2018, Journal of Applied Research in Memory and Cognition.

[18]  Aldert Vrij,et al.  Tracking the Truth: The Effect of Face Familiarity on Eye Fixations during Deception , 2017, Quarterly journal of experimental psychology.

[19]  M. Farah,et al.  Functional MRI-based lie detection: scientific and societal challenges , 2014, Nature Reviews Neuroscience.

[20]  Paul Ekman,et al.  The wizards of deception detection. , 2004 .

[21]  M. Just,et al.  Eye fixations and cognitive processes , 1976, Cognitive Psychology.