Unconscious lie detection as an example of a widespread fallacy in the Neurosciences

Neuroscientists frequently use a certain statistical reasoning to establish the existence of distinct neuronal processes in the brain. We show that this reasoning is flawed and that the large corresponding literature needs reconsideration. We illustrate the fallacy with a recent study that received an enormous press coverage because it concluded that humans detect deceit better if they use unconscious processes instead of conscious deliberations. The study was published under a new open-data policy that enabled us to reanalyze the data with more appropriate methods. We found that unconscious performance was close to chance - just as the conscious performance. This illustrates the flaws of this widely used statistical reasoning, the benefits of open-data practices, and the need for careful reconsideration of studies using the same rationale.

[1]  Karl R Gegenfurtner,et al.  A comparison of localization judgments and pointing precision. , 2007, Journal of vision.

[2]  E. Wagenmakers,et al.  Erroneous analyses of interactions in neuroscience: a problem of significance , 2011, Nature Neuroscience.

[3]  B. Depaulo,et al.  Accuracy of Deception Judgments , 2006, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[4]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[5]  S. Dehaene,et al.  Imaging unconscious semantic priming , 1998, Nature.

[6]  J A SWETS,et al.  Is there a sensory threshold? , 1961, Science.

[7]  Geoffrey R. Loftus,et al.  Standard errors and confidence intervals in within-subjects designs: Generalizing Loftus and Masson (1994) and avoiding the biases of alternative accounts , 2012, Psychonomic Bulletin & Review.

[8]  P. Lachenbruch Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[9]  E. Eich Business Not as Usual , 2014, Psychological science.

[10]  R. Dolan,et al.  Conscious and unconscious emotional learning in the human amygdala , 1998, Nature.

[11]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[12]  Thomas Schmidt,et al.  Criteria for unconscious cognition: Three types of dissociation , 2006, Perception & psychophysics.

[13]  S. Dehaene,et al.  Levels of processing during non-conscious perception: a critical review of visual masking , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[14]  Deborah E. Hannula,et al.  Imaging implicit perception: promise and pitfalls , 2005, Nature Reviews Neuroscience.

[15]  C. Eriksen,et al.  Discrimination and learning without awareness: a methodological survey and evaluation. , 1960, Psychological review.

[16]  J. R. Doyle Semantic activation without conscious identification in dichotic listening , parafoveal vision , and visual masking : A survey and appraisal , 2008 .

[17]  R. Dolan,et al.  How the Brain Translates Money into Force: A Neuroimaging Study of Subliminal Motivation , 2007, Science.

[18]  Jeff Miller,et al.  Information processing models generating lognormally distributed reaction times , 1993 .

[19]  T. Levine,et al.  Direct and Indirect Measures of Lie Detection Tell the Same Story , 2014, Psychological science.

[20]  Karl R Gegenfurtner,et al.  Grasping visual illusions: Consistent data and no dissociation , 2008, Cognitive neuropsychology.

[21]  D. Carney,et al.  Some Evidence for Unconscious Lie Detection , 2014, Psychological science.

[22]  Richard L. Abrams,et al.  Three Cognitive Markers of Unconscious Semantic Activation , 1996, Science.

[23]  E. Reingold,et al.  Using direct and indirect measures to study perception without awareness , 1988, Perception & psychophysics.

[24]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.