Intelligent Deception Detection through Machine Based Interviewing

In this paper an automatic deception detection system, which analyses participant deception risk scores from non-verbal behaviour captured during an interview conducted by an Avatar, is demonstrated. The system is built on a configuration of artificial neural networks, which are used to detect facial objects and extract non-verbal behaviour in the form of micro gestures over short periods of time. A set of empirical experiments was conducted based a typical airport security scenario of packing a suitcase. Data was collected through 30 participants participating in either a truthful or deceptive scenarios being interviewed by a machine based border guard Avatar. Promising results were achieved using raw unprocessed data on un-optimized classifier neural networks. These indicate that a machine based interviewing technique can elicit non-verbal interviewee behavior, which allows an automatic system to detect deception.

[1]  Hichang Cho,et al.  Deception in avatar-mediated virtual environment , 2013, Comput. Hum. Behav..

[2]  James O'Shea,et al.  Do Europe's borders need multi-faceted biometric protection , 2017 .

[3]  Justine Cassell,et al.  Embodied Conversational Agents: Representation and Intelligence in User Interfaces , 2001, AI Mag..

[4]  Nonverbal Cues and Communication , 2012 .

[5]  M. Noordzij,et al.  Interviewing Suspects with Avatars: Avatars Are More Effective When Perceived as Human , 2016, Front. Psychol..

[6]  Keeley A. Crockett,et al.  Near Real-Time Comprehension Classification with Artificial Neural Networks: Decoding e-Learner Non-Verbal Behavior , 2018, IEEE Transactions on Learning Technologies.

[7]  Ewout H. Meijer,et al.  Deception detection with behavioral, autonomic, and neural measures: Conceptual and methodological considerations that warrant modesty. , 2016, Psychophysiology.

[8]  D. Dougherty,et al.  The validity of polygraph testing: Scientific analysis and public controversy. , 1985 .

[9]  David McLean,et al.  Silent talker: a new computer-based system for the analysis of facial cues to deception , 2006 .

[10]  Jay F. Nunamaker,et al.  Embodied Conversational Agent-Based Kiosk for Automated Interviewing , 2011, J. Manag. Inf. Syst..

[11]  Dean A. Pollina,et al.  Development of technologies and test formats for credibility assessment / Dean A. Pollina, Frank Horvath, John W. Denver, Andrew B. Dollins, Troy E. Brown. , 2009 .

[12]  Francisco Lacerda,et al.  Charlatanry in forensic speech science: A problem to be taken seriously , 2007 .

[13]  Robert Herms,et al.  Prediction of Deception and Sincerity from Speech Using Automatic Phone Recognition-Based Features , 2016, INTERSPEECH.

[14]  C. Honts,et al.  The comparison question polygraph test: A contrast of methods and scoring , 2015, Physiology & Behavior.

[15]  Jeffrey J. Walczyk,et al.  Advancing Lie Detection by Inducing Cognitive Load on Liars: A Review of Relevant Theories and Techniques Guided by Lessons from Polygraph-Based Approaches , 2013, Front. Psychology.

[16]  Gert-Jan de Vreede,et al.  Automated Group Facilitation for Gathering Wide Audience End-User Requirements , 2013, 2013 46th Hawaii International Conference on System Sciences.