Using Blink Rate to Detect Deception: A Study to Validate an Automatic Blink Detector and a New Dataset of Videos from Liars and Truth-Tellers

Eye-blink is a sensitive index of cognitive load and some studies have reported that it can be a useful cue for detecting deception. However, it is difficult to apply in the real forensic scenario as very complex techniques to record eye blinking are usually needed (e.g., electrooculography, eye tracker technology). In this paper, we propose a new approach to automatically detect eye blinking based on a computer vision algorithm, which does not require any expensive technology to record data. Results demonstrated that the automatic blink detector reached an accuracy similar to the electrooculogram in detecting the blink rate. Moreover, the automatic blink detector was applied to 68 videos of people who were lying or telling the truth about a past holiday, testing the difference between the two groups in terms of blink rate and response timing. Training machine learning classification models on these features, an accuracy up to 70% in identifying liars and truth-tellers was obtained.

[1]  Mauro Conti,et al.  Covert lie detection using keyboard dynamics , 2018, Scientific Reports.

[2]  Aldert Vrij,et al.  A cognitive approach to lie detection: A meta‐analysis , 2017 .

[3]  S. L. Sporer,et al.  Are Computers Effective Lie Detectors? A Meta-Analysis of Linguistic Cues to Deception , 2015, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[4]  Rada Mihalcea,et al.  Towards multimodal deception detection -- step 1: building a collection of deceptive videos , 2012, ICMI '12.

[5]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[6]  Jeffrey J. Walczyk,et al.  Advancing Lie Detection by Inducing Cognitive Load on Liars: A Review of Relevant Theories and Techniques Guided by Lessons from Polygraph-Based Approaches , 2013, Front. Psychology.

[7]  Aldert Vrij,et al.  Sorting the liars from the truth tellers: the benefits of asking unanticipated questions on lie detection , 2013 .

[8]  Aldert Vrij,et al.  A cognitive load approach to lie detection , 2008 .

[9]  Angelo Gemignani,et al.  Machine Learning in Psychometrics and Psychological Research , 2020, Frontiers in Psychology.

[10]  Maria Hartwig,et al.  Guilty and innocent suspects’ strategies during police interrogations , 2007 .

[11]  Dimitris N. Metaxas,et al.  Motion Profiles for Deception Detection Using Visual Cues , 2010, ECCV.

[12]  S. Cessie,et al.  Ridge Estimators in Logistic Regression , 1992 .

[13]  G. Ben-Shakhar,et al.  Lying Takes Time: A Meta-Analysis on Reaction Time Measures of Deception , 2017, Psychological bulletin.

[14]  Verónica Pérez-Rosas,et al.  A Multimodal Dataset for Deception Detection , 2014, LREC.

[15]  Fei Yang,et al.  Is Interactional Dissynchrony a Clue to Deception? Insights From Automated Analysis of Nonverbal Visual Cues , 2015, IEEE Transactions on Cybernetics.

[16]  Janet C Rucker,et al.  Normal and abnormal lid function. , 2011, Handbook of clinical neurology.

[17]  F. Paas,et al.  Cognitive Load Theory and Instructional Design: Recent Developments , 2003 .

[18]  N. Mackworth The Breakdown of Vigilance during Prolonged Visual Search 1 , 1948 .

[19]  A. Vrij,et al.  Outsmarting the Liars: The Benefit of Asking Unanticipated Questions , 2009, Law and human behavior.

[20]  A. Vrij,et al.  Blinking During and After Lying , 2008 .

[21]  T. Yarkoni,et al.  Choosing Prediction Over Explanation in Psychology: Lessons From Machine Learning , 2017, Perspectives on psychological science : a journal of the Association for Psychological Science.

[22]  Luciano Gamberini,et al.  The detection of faked identity using unexpected questions and mouse dynamics , 2017, PloS one.

[23]  Yang Wang,et al.  GSR and Blink Features for Cognitive Load Classification , 2013, INTERACT.

[24]  D Denney,et al.  The eye blink electro-oculogram. , 1984, The British journal of ophthalmology.

[25]  Luciano Gamberini,et al.  Identity Verification Using a Kinematic Memory Detection Technique , 2017 .

[26]  Terry K Koo,et al.  A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. , 2016, Journal Chiropractic Medicine.

[27]  Hassan Ugail,et al.  A database for facial behavioural analysis , 2013, 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[28]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[29]  Mauro Conti,et al.  Type Me the Truth!: Detecting Deceitful Users via Keystroke Dynamics , 2017, ARES.

[30]  Fenna H. Poletiek,et al.  The Effects of Unexpected Questions on Detecting Familiar and Unfamiliar Lies , 2013 .

[31]  Mohamed Abouelenien,et al.  Deception Detection using Real-life Trial Data , 2015, ICMI.

[32]  Aldert Vrij,et al.  The occurrence of eye blinks during a guilty knowledge test , 2010 .

[33]  Lin Su,et al.  Does "lie to me" lie to you? An evaluation of facial clues to high-stakes deception , 2016, Comput. Vis. Image Underst..

[34]  D. Broomhead,et al.  Radial Basis Functions, Multi-Variable Functional Interpolation and Adaptive Networks , 1988 .

[35]  Davis E. King,et al.  Dlib-ml: A Machine Learning Toolkit , 2009, J. Mach. Learn. Res..

[36]  Alessandro Angrilli,et al.  Spontaneous eye blink rate: An index of dopaminergic component of sustained attention and fatigue. , 2018, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[37]  F. Marchak Detecting false intent using eye blink measures , 2013, Front. Psychol..

[38]  Aldert Vrij,et al.  Deception and truth detection when analyzing nonverbal and verbal cues , 2018, Applied Cognitive Psychology.

[39]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[40]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[41]  K. Fukuda,et al.  Eye blinks: new indices for the detection of deception. , 2001, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[42]  Mohamed Abouelenien,et al.  Verbal and Nonverbal Clues for Real-life Deception Detection , 2015, EMNLP.

[43]  S. Sathiya Keerthi,et al.  Improvements to Platt's SMO Algorithm for SVM Classifier Design , 2001, Neural Computation.