The Detection of Malingering: A New Tool to Identify Made-Up Depression

Major depression is a high-prevalence mental disease with major socio-economic impact, for both the direct and the indirect costs. Major depression symptoms can be faked or exaggerated in order to obtain economic compensation from insurance companies. Critically, depression is potentially easily malingered, as the symptoms that characterize this psychiatric disorder are not difficult to emulate. Although some tools to assess malingering of psychiatric conditions are already available, they are principally based on self-reporting and are thus easily faked. In this paper, we propose a new method to automatically detect the simulation of depression, which is based on the analysis of mouse movements while the patient is engaged in a double-choice computerized task, responding to simple and complex questions about depressive symptoms. This tool clearly has a key advantage over the other tools: the kinematic movement is not consciously controllable by the subjects, and thus it is almost impossible to deceive. Two groups of subjects were recruited for the study. The first one, which was used to train different machine-learning algorithms, comprises 60 subjects (20 depressed patients and 40 healthy volunteers); the second one, which was used to test the machine-learning models, comprises 27 subjects (9 depressed patients and 18 healthy volunteers). In both groups, the healthy volunteers were randomly assigned to the liars and truth-tellers group. Machine-learning models were trained on mouse dynamics features, which were collected during the subject response, and on the number of symptoms reported by participants. Statistical results demonstrated that individuals that malingered depression reported a higher number of depressive and non-depressive symptoms than depressed participants, whereas individuals suffering from depression took more time to perform the mouse-based tasks compared to both truth-tellers and liars. Machine-learning models reached a classification accuracy up to 96% in distinguishing liars from depressed patients and truth-tellers. Despite this, the data are not conclusive, as the accuracy of the algorithm has not been compared with the accuracy of the clinicians; this study presents a possible useful method that is worth further investigation.

[1]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[2]  P. Cuijpers,et al.  [Subclinical depression: a clinically relevant condition?]. , 2008, Tijdschrift voor psychiatrie.

[3]  Li Su,et al.  Countering Countermeasures: Detecting Identity Lies by Detecting Conscious Breakthrough , 2014, PloS one.

[4]  D. Rosenhan On Being Sane in Insane Places , 1973, Science.

[5]  Matthias Gamer,et al.  Influence of countermeasures on the validity of the Concealed Information Test. , 2016, Psychophysiology.

[6]  Giuseppe Sartori,et al.  The autobiographical IAT: a review , 2013, Front. Psychol..

[7]  Nicholas D. Duran,et al.  The action dynamics of overcoming the truth , 2010, Psychonomic bulletin & review.

[8]  Luciano Gamberini,et al.  False Identity Detection Using Complex Sentences , 2018, Front. Psychol..

[9]  Umberto Castiello,et al.  Detecting fakers of the autobiographical IAT , 2011 .

[10]  Wiley Mittenberg,et al.  Base Rates of Malingering and Symptom Exeggeration , 2002, Journal of clinical and experimental neuropsychology.

[11]  G. Young Malingering in Forensic Disability-Related Assessments: Prevalence 15 ± 15 % , 2015 .

[12]  Michael B. Lewis,et al.  Telling Lies: The Irrepressible Truth? , 2013, PloS one.

[13]  J. Graham,et al.  Detection of coached general malingering on the MMPI-2. , 2000, Psychological assessment.

[14]  Faked depression: comparing malingering via the internet, pen-and-paper, and telephone administration modes. , 2013, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[15]  B. Mulsant,et al.  Actors' portrayals of depression to test interrater reliability in clinical trials. , 2004, The American journal of psychiatry.

[16]  K. Greve,et al.  Prevalence of malingering in patients with chronic pain referred for psychologic evaluation in a medico-legal context. , 2009, Archives of physical medicine and rehabilitation.

[17]  W. Curran Malingering , 1888, The Hospital.

[18]  W. Coster Clinical Assessment of Malingering and Deception , 1990 .

[19]  Paulo Pereira,et al.  Corrigendum: Gap junctional protein Cx43 is involved in the communication between extracellular vesicles and mammalian cells , 2015, Scientific Reports.

[20]  T. Penzel,et al.  Diagnostic and Statistical Manual of Mental Disorders , 2020, Springer Reference Medizin.

[21]  G. Orrú,et al.  Indicators to distinguish symptom accentuators from symptom producers in individuals with a diagnosed adjustment disorder: A pilot study on inconsistency subtypes using SIMS and MMPI-2-RF , 2019, PloS one.

[22]  Thomas A. Farmer,et al.  Hand in Motion Reveals Mind in Motion , 2011, Front. Psychology.

[23]  K. Sullivan,et al.  Detecting faked psychopathology: A comparison of two tests to detect malingered psychopathology using a simulation design , 2010, Psychiatry Research.

[24]  M. Mathews,et al.  Detection and management of malingering in a clinical setting , 2006 .

[25]  F. Agakov,et al.  Application of high-dimensional feature selection: evaluation for genomic prediction in man , 2015, Scientific Reports.

[26]  Eibe Frank,et al.  Logistic Model Trees , 2003, Machine Learning.

[27]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[28]  K. Shadan,et al.  Available online: , 2012 .

[29]  G. Ben-Shakhar,et al.  Lying Takes Time: A Meta-Analysis on Reaction Time Measures of Deception , 2017, Psychological bulletin.

[30]  Luciano Gamberini,et al.  The detection of faked identity using unexpected questions and mouse dynamics , 2017, PloS one.

[31]  E. Frank,et al.  Validity and reliability of a new instrument for assessing mood symptomatology: the Structured Clinical Interview for Mood Spectrum (SCI‐MOODS) , 1999 .

[32]  R. J. Beaber,et al.  A brief test for measuring malingering in schizophrenic individuals. , 1985, The American journal of psychiatry.

[33]  Mauro Conti,et al.  Covert lie detection using keyboard dynamics , 2018, Scientific Reports.

[34]  Pat Langley,et al.  Estimating Continuous Distributions in Bayesian Classifiers , 1995, UAI.

[35]  Shan Suthaharan,et al.  Decision Tree Learning , 2016 .

[36]  Toniann Pitassi,et al.  The reusable holdout: Preserving validity in adaptive data analysis , 2015, Science.

[37]  K. Boone,et al.  Malingering Detection of Cognitive Impairment With the b Test Is Boosted Using Machine Learning , 2019, Front. Psychol..

[38]  A. Vrij,et al.  Outsmarting the Liars: The Benefit of Asking Unanticipated Questions , 2009, Law and human behavior.

[39]  G. Sartori,et al.  Detection of Malingering in Personal Injury and Damage Ascertainment , 2016 .

[40]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[41]  Jonathan B Freeman,et al.  MouseTracker: Software for studying real-time mental processing using a computer mouse-tracking method , 2010, Behavior research methods.

[42]  Luciano Gamberini,et al.  Identity Verification Using a Kinematic Memory Detection Technique , 2017 .

[43]  B. Druss,et al.  Health and disability costs of depressive illness in a major U.S. corporation. , 2000, The American journal of psychiatry.

[44]  G. P. Smith,et al.  Detection of malingering: validation of the Structured Inventory of Malingered Symptomatology (SIMS). , 1997, The journal of the American Academy of Psychiatry and the Law.

[45]  G. Orrú,et al.  Introducing Machine Learning to Detect Personality Faking-Good in a Male Sample: A New Model Based on Minnesota Multiphasic Personality Inventory-2 Restructured Form Scales and Reaction Times , 2019, Front. Psychiatry.

[46]  S. Sathiya Keerthi,et al.  Improvements to Platt's SMO Algorithm for SVM Classifier Design , 2001, Neural Computation.

[47]  Luciano Gamberini,et al.  How Human-Mouse Interaction can Accurately Detect Faked Responses About Identity , 2016, Symbiotic.

[48]  Mark A. Hall,et al.  Correlation-based Feature Selection for Machine Learning , 2003 .

[49]  G. Sartori,et al.  A novel methodology for the objective ascertainment of psychic and existential damage , 2016, International Journal of Legal Medicine.

[50]  A. Beck,et al.  An inventory for measuring depression. , 1961, Archives of general psychiatry.

[51]  E. Meadows,et al.  Practitioner’s Guide to Empirically Based Measures of Depression , 2001, Journal of Cognitive Psychotherapy.