Decision support for determining veracity via linguistic-based cues

Deception detection is an essential skill in careers such as law enforcement and must be accomplished accurately. However, humans are not very competent at determining veracity without aid. This study examined automated text-based deception detection which attempts to overcome the shortcomings of previous credibility assessment methods. A real-world, high-stakes sample of statements was collected and analyzed. Several different sets of linguistic-based cues were used as inputs for classification models. Overall accuracy rates of up to 74% were achieved, suggesting that automated deception detection systems can be an invaluable tool for those who must assess the credibility of text.

[1]  B. Depaulo,et al.  Accuracy of Deception Judgments , 2006, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[2]  David C. Raskin,et al.  Methodological issues in estimating polygraph accuracy in field applications , 1987 .

[3]  J.F. Nunamaker,et al.  Detecting deception in secondary screening interviews using linguistic analysis , 2004, Proceedings. The 7th International IEEE Conference on Intelligent Transportation Systems (IEEE Cat. No.04TH8749).

[4]  Casimir A. Kulikowski,et al.  Computer Systems That Learn: Classification and Prediction Methods from Statistics, Neural Nets, Machine Learning and Expert Systems , 1990 .

[5]  Jeffrey T. Hancock,et al.  Automated Linguistic Analysis of Deceptive and Truthful Synchronous Computer-Mediated Communication , 2005, Proceedings of the 38th Annual Hawaii International Conference on System Sciences.

[6]  James F. Roiger,et al.  Testing Interpersonal Deception Theory: The Language of Interpersonal Deception , 1996 .

[7]  A. Vrij.  Detecting Lies and Deceit: The Psychology of Lying and the Implications for Professional Practice , 2000 .

[8]  Stephen Porter,et al.  The language of deceit: An investigation of the verbal clues to deception in the interrogation context , 1996 .

[9]  Hamish Cunningham,et al.  GATE-a General Architecture for Text Engineering , 1996, COLING.

[10]  Dongsong Zhang,et al.  Typing or messaging? Modality effect on deception detection in computer-mediated communication , 2007, Decis. Support Syst..

[11]  Andries Petrus Engelbrecht,et al.  Determining the Significance of Input Parameters using Sensitivity Analysis , 1995, IWANN.

[12]  Steven A. Mccornack.  Information manipulation theory , 1992 .

[13]  Donald E. Brown,et al.  Data association methods with applications to law enforcement , 2003, Decis. Support Syst..

[14]  Jeffrey T. Hancock,et al.  Deception and design: the impact of communication technology on lying behavior , 2004, CHI.

[15]  Thomas Hugh Feeley,et al.  Humans as lie detectors: Some more second thoughts , 1998 .

[16]  A. Vrij,et al.  Telling and detecting lies in a high-stake situation: the case of a convicted murderer , 2001 .

[17]  Melody Y. Kiang,et al.  A comparative assessment of classification methods , 2003, Decis. Support Syst..

[18]  J. Burgoon,et al.  Interpersonal Deception Theory , 1996 .

[19]  M. Zuckerman.  Verbal and nonverbal communication of deception , 1981 .

[20]  J. Nunamaker,et al.  Automating Linguistics-Based Cues for Detecting Deception in Text-Based Asynchronous Computer-Mediated Communications , 2004 .

[21]  U. Undeutsch.  The Development of Statement Reality Analysis , 1989 .

[22]  Jeffrey T. Hancock,et al.  Lies in Conversation: An Examination of Deception Using Automated Linguistic Analysis , 2004 .

[23]  Jay F. Nunamaker,et al.  Automated Determination of the Veracity of Interview Statements from People of Interest to an Operational Security Force , 2006, Proceedings of the 39th Annual Hawaii International Conference on System Sciences (HICSS'06).

[24]  E. Ford,et al.  Lie detection: historical, neuropsychiatric and legal dimensions. , 2006, International journal of law and psychiatry.

[25]  Harry Hollien,et al.  FINAL REPORT CIFA CONTRACT - FA 4814-04-0011 Voice Stress Analyzer Instrumentation Evaluation , 2006 .

[26]  P. Ekman,et al.  Who can catch a liar? , 1991, The American psychologist.

[27]  Jay F. Nunamaker,et al.  An exploratory study into deception detection in text-based computer-mediated communication , 2003, 36th Annual Hawaii International Conference on System Sciences, 2003. Proceedings of the.

[28]  Kenneth E. Kendall,et al.  Decentralizing decision support systems a field experiment with drug and criminal investigators , 1993, Decis. Support Syst..

[29]  B. Depaulo,et al.  Accuracy of Deception Judgments: Appendix A , 2006 .

[30]  Thomas Hugh Feeley,et al.  To Catch a Liar: Challenges for Research in Lie Detection Training , 2003 .

[31]  J. Burgoon,et al.  The Dynamic Nature of Deceptive Verbal Communication , 2006 .

[32]  A. Vrij.  Criteria-Based Content Analysis: A Qualitative Review of the First 37 Studies. , 2005 .

[33]  James J. Lindsay,et al.  Cues to deception. , 2003, Psychological bulletin.

[34]  Jay F. Nunamaker,et al.  Designing Agent99 Trainer: A Learner-Centered, Web-Based Training System for Deception Detection , 2003, ISI.

[35]  Jay F. Nunamaker,et al.  A Comparison of Classification Methods for Predicting Deception in Computer-Mediated Communication , 2004, J. Manag. Inf. Syst..

[36]  Jay F. Nunamaker,et al.  Advances in automated deception detection in text-based computer-mediated communication , 2004, SPIE Defense + Commercial Sensing.

[37]  Francisco Sandoval,et al.  From Natural to Artificial Neural Computation , 1995 .

[38]  F. Horvath,et al.  Differentiation of truthful and deceptive criminal suspects in Behavior Analysis Interviews. , 1994, Journal of forensic sciences.

[39]  Mark Adkins,et al.  An Analysis of Text-Based Deception Detection Tools , 2006, AMCIS.

[40]  Adrienne Y. Lee,et al.  Language of lies in prison: linguistic classification of prisoners' truthful and deceptive natural language , 2005 .

[41]  Hsinchun Chen,et al.  Enhancing border security: Mutual information analysis to identify suspect vehicles , 2007, Decis. Support Syst..

[42]  J. Pennebaker,et al.  Lying Words: Predicting Deception from Linguistic Styles , 2003, Personality & social psychology bulletin.

[43]  Matthias Gamer,et al.  Psychophysiological and vocal measures in the detection of guilty knowledge. , 2006, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[44]  A. K. Pujari,et al.  Data Mining Techniques , 2006 .

[45]  Aldert Vrij,et al.  An Empirical Test of the Behaviour Analysis Interview , 2006, Law and human behavior.

[46]  J. Hair.  Multivariate data analysis , 1972 .