Towards multimodal deception detection -- step 1: building a collection of deceptive videos

In this paper, we introduce a novel crowdsourced dataset of deceptive videos. We describe the collection process and the characteristics of the dataset, and we validate it through initial experiments in the recognition of deceptive language. The collection, consisting of 140 truthful and deceptive videos, will enable future experiments in multimodal deceptive detection.

[1]  James J. Lindsay,et al.  Cues to deception. , 2003, Psychological bulletin.

[2]  Rada Mihalcea,et al.  Text Mining for Automatic Image Tagging , 2010, COLING.

[3]  Rada Mihalcea,et al.  Towards multimodal sentiment analysis: harvesting opinions from the web , 2011, ICMI '11.

[4]  Andrew Ortony,et al.  The Referential Structure of the Affective Lexicon , 1987, Cogn. Sci..

[5]  A. Mohammadian,et al.  Multimodal Detection of Deception using Fusion of Reaction Time and P300 Component , 2008, 2008 Cairo International Biomedical Engineering Conference.

[6]  Hatice Gunes,et al.  How to distinguish posed from spontaneous smiles using geometric features , 2007, ICMI '07.

[7]  Andreas Stolcke,et al.  Distinguishing deceptive from non-deceptive speech , 2005, INTERSPEECH.

[8]  Dvijesh Shastri,et al.  Imaging Facial Physiology for the Detection of Deceit , 2006, International Journal of Computer Vision.

[9]  Oliver Brdiczka,et al.  Detecting Human Behavior Models From Multimodal Observation in a Smart Home , 2009, IEEE Transactions on Automation Science and Engineering.

[10]  I. Pavlidis,et al.  Forehead Thermal Signature Extraction in Lie Detection , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[11]  Maja Pantic,et al.  Spontaneous vs. posed facial behavior: automatic analysis of brow actions , 2006, ICMI '06.

[12]  Chris Callison-Burch,et al.  Using Mechanical Turk to Build Machine Translation Evaluation Sets , 2010, Mturk@HLT-NAACL.

[13]  Gwen Littlewort,et al.  Faces of pain: automated measurement of spontaneousallfacial expressions of genuine and posed pain , 2007, ICMI '07.

[14]  J. Nunamaker,et al.  Automating Linguistics-Based Cues for Detecting Deception in Text-Based Asynchronous Computer-Mediated Communications , 2004 .

[15]  J. Pennebaker,et al.  Lying Words: Predicting Deception from Linguistic Styles , 2003, Personality & social psychology bulletin.

[16]  Jay F. Nunamaker,et al.  Modality Effects in Deception Detection and Applications in Automatic-Deception-Detection , 2005, Proceedings of the 38th Annual Hawaii International Conference on System Sciences.

[17]  Elliot Moore,et al.  A study of Glottal waveform features for deceptive speech classification , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[18]  P. Ekman,et al.  Detecting deception from the body or face. , 1974 .

[19]  Claire Cardie,et al.  Finding Deceptive Opinion Spam by Any Stretch of the Imagination , 2011, ACL.

[20]  James W. Pennebaker,et al.  Linguistic Inquiry and Word Count (LIWC2007) , 2007 .

[21]  Carlo Strapparava,et al.  WordNet Affect: an Affective Extension of WordNet , 2004, LREC.

[22]  Venu Govindaraju,et al.  Real-time Automatic Deceit Detection from Involuntary Facial Expressions , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Carlo Strapparava,et al.  The Lie Detector: Explorations in the Automatic Recognition of Deceptive Language , 2009, ACL.

[24]  J. Pennebaker,et al.  Linguistic styles: language use as an individual difference. , 1999, Journal of personality and social psychology.

[25]  Brendan T. O'Connor,et al.  Cheap and Fast – But is it Good? Evaluating Non-Expert Annotations for Natural Language Tasks , 2008, EMNLP.

[26]  Jeffrey F. Cohn,et al.  The Timing of Facial Motion in posed and Spontaneous Smiles , 2003, Int. J. Wavelets Multiresolution Inf. Process..