Neuroimaging: Decoding mental states from brain activity in humans

Recent advances in human neuroimaging have shown that it is possible to accurately decode a person's conscious experience based only on non-invasive measurements of their brain activity. Such 'brain reading' has mostly been studied in the domain of visual perception, where it helps reveal the way in which individual experiences are encoded in the human brain. The same approach can also be extended to other types of mental state, such as covert attitudes and lie detection. Such applications raise important ethical issues concerning the privacy of personal thought.

[1]  D. Spalding.  The Principles of Psychology , 1873, Nature.

[2]  W. Marston,et al.  Systolic blood pressure symptoms of deception. , 1917 .

[3]  H. E. Burtt.  The Inspiration-Expiration Ratio During Truth and Falsehood. , 1921 .

[4]  G. E. Smith.  The Human Brain , 1924, Nature.

[5]  E. Dewan.  Occipital Alpha Rhythm Eye Position and Lens Accommodation , 1967, Nature.

[6]  A. L. I︠A︡rbus.  Eye Movements and Vision , 1967 .

[7]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[8]  R I Thackray,et al.  A comparison of physiological indices in detection of deception. , 1968, Psychophysiology.

[9]  L A Geddes,et al.  History of the polygraphy, an instrument for the detection of deception. , 1973, Biomedical engineering.

[10]  Geddes La,et al.  History of the polygraphy, an instrument for the detection of deception. , 1973 .

[11]  David T. Lykken,et al.  A Tremor in the Blood: Uses and Abuses of the Lie Detector , 1980 .

[12]  F Horvath,et al.  Detecting deception: the promise and the reality of voice stress analysis. , 1982, Journal of forensic sciences.

[13]  A. Marcel.  Conscious and unconscious perception: Experiments on visual masking and word recognition , 1983, Cognitive Psychology.

[14]  B. Libet,et al.  Time of conscious intention to act in relation to onset of cerebral activity (readiness-potential). The unconscious initiation of a freely voluntary act. , 1983, Brain : a journal of neurology.

[15]  Alan C. Evans,et al.  Differences in cerebral blood flow and glucose utilization in vegetative versus locked‐in patients , 1987, Annals of neurology.

[16]  E. Reingold,et al.  Using direct and indirect measures to study perception without awareness , 1988, Perception & psychophysics.

[17]  P. Ekman,et al.  Who can catch a liar? , 1991, The American psychologist.

[18]  J R Duhamel,et al.  The updating of the representation of visual space in parietal cortex by intended eye movements. , 1992, Science.

[19]  K. Obermayer,et al.  Geometry of orientation and ocular dominance columns in monkey striate cortex , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[20]  C. Honts,et al.  Mental and physical countermeasures reduce the accuracy of polygraph tests. , 1994, The Journal of applied psychology.

[21]  Adrian T. Lee,et al.  fMRI of human visual cortex , 1994, Nature.

[22]  T. Allison,et al.  Face recognition in human extrastriate cortex. , 1994, Journal of neurophysiology.

[23]  J W Belliveau,et al.  Borders of multiple visual areas in humans revealed by functional magnetic resonance imaging. , 1995, Science.

[24]  C. Koch,et al.  Are we aware of neural activity in primary visual cortex? , 1995, Nature.

[25]  Karl J. Friston,et al.  Spatial registration and normalization of images , 1995 .

[26]  Keiji Tanaka,et al.  Optical Imaging of Functional Organization in the Monkey Inferotemporal Cortex , 1996, Science.

[27]  V. Mountcastle.  The columnar organization of the neocortex. , 1997, Brain : a journal of neurology.

[28]  A. Norcia,et al.  A method for investigating binocular rivalry in real-time with the steady-state VEP , 1997, Vision Research.

[29]  Keiji Tanaka.  Mechanisms of visual object recognition: monkey and human studies , 1997, Current Opinion in Neurobiology.

[30]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[31]  Jean-Baptiste Poline,et al.  Inferring behavior from functional brain images , 1998, Nature Neuroscience.

[32]  P. Kennedy,et al.  Restoration of neural output from a paralyzed patient by a direct brain connection , 1998, Neuroreport.

[33]  Nancy Kanwisher,et al.  A cortical representation of the local visual environment , 1998, Nature.

[34]  S. Dehaene,et al.  Imaging unconscious semantic priming , 1998, Nature.

[35]  M S Buchsbaum,et al.  Reduced prefrontal and increased subcortical brain functioning assessed using positron emission tomography in predatory and affective murderers. , 1998, Behavioral sciences & the law.

[36]  S. Edelman,et al.  Toward direct visualization of the internal shape representation space by fMRI , 1998, Psychobiology.

[37]  A. Dale,et al.  High‐resolution intersubject averaging and a coordinate system for the cortical surface , 1999, Human brain mapping.

[38]  G B Stanley,et al.  Reconstruction of Natural Scenes from Ensemble Responses in the Lateral Geniculate Nucleus , 1999, The Journal of Neuroscience.

[39]  M. Reivich,et al.  Limbic activation during cue-induced cocaine craving. , 1999, The American journal of psychiatry.

[40]  P. Haggard,et al.  On the relation between brain potentials and the awareness of voluntary movements , 1999, Experimental Brain Research.

[41]  H. Flor,et al.  A spelling device for the paralysed , 1999, Nature.

[42]  P Suppes,et al.  Invariance between subjects of brain wave representations of language. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[43]  N. Kanwisher,et al.  Mental Imagery of Faces and Places Activates Corresponding Stimulus-Specific Brain Regions , 2000, Journal of Cognitive Neuroscience.

[44]  C. Koch,et al.  Category-specific visual responses of single neurons in the human medial temporal lobe , 2000, Nature Neuroscience.

[45]  William A. Cunningham,et al.  Performance on Indirect Measures of Race Evaluation Predicts Amygdala Activation , 2000, Journal of Cognitive Neuroscience.

[46]  S Lehéricy,et al.  The visual word form area: spatial and temporal characterization of an initial stage of reading in normal subjects and posterior split-brain patients. , 2000, Brain : a journal of neurology.

[47]  Miguel A. L. Nicolelis,et al.  Actions from thoughts , 2001, Nature.

[48]  N. Kanwisher,et al.  The Human Body , 2001 .

[49]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[50]  M. Beauregard,et al.  Neural Correlates of Conscious Self-Regulation of Emotion , 2001, The Journal of Neuroscience.

[51]  I. Wilkinson,et al.  Behavioural and functional anatomical correlates of deception in humans , 2001, Neuroreport.

[52]  L. Farwell,et al.  Using brain MERMER testing to detect knowledge despite efforts to conceal. , 2001, Journal of forensic sciences.

[53]  Robert Turner,et al.  How Much Cortex Can a Vein Drain? Downstream Dilution of Activation-Related Cerebral Blood Oxygenation Changes , 2002, NeuroImage.

[54]  N. Kanwisher,et al.  How Distributed Is Visual Category Information in Human Occipito-Temporal Cortex? An fMRI Study , 2002, Neuron.

[55]  Martha J. Farah,et al.  Emerging ethical issues in neuroscience , 2002, Nature Neuroscience.

[56]  K. Luan Phan,et al.  Functional Neuroanatomy of Emotion: A Meta-Analysis of Emotion Activation Studies in PET and fMRI , 2002, NeuroImage.

[57]  Ioannis Pavlidis,et al.  Seeing through the face of deception , 2002, Nature.

[58]  N. Logothetis,et al.  Visual competition , 2002, Nature Reviews Neuroscience.

[59]  Chetwyn C. H. Chan,et al.  Lie detection by functional magnetic resonance imaging , 2002, Human brain mapping.

[60]  T. Canli,et al.  Neuroimaging of emotion and personality: Scientific evidence and ethical considerations , 2002, Brain and Cognition.

[61]  C. L. Wyland,et al.  An fMRI investigation of the impact of interracial contact on executive function , 2003, Nature Neuroscience.

[62]  K.-R. Muller,et al.  Boosting bit rates and error detection for the classification of fast-paced motor commands based on single-trial EEG analysis , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[63]  A. Villringer,et al.  Beyond the Visible—Imaging the Human Brain with Light , 2003, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[64]  Tom M. Mitchell,et al.  Classifying Instantaneous Cognitive States from fMRI Data , 2003, AMIA.

[65]  David D. Cox,et al.  Functional magnetic resonance imaging (fMRI) “brain reading”: detecting and classifying distributed patterns of fMRI activity in human visual cortex , 2003, NeuroImage.

[66]  T. Carlson,et al.  Patterns of Activity in the Categorical Representations of Objects , 2003, Journal of Cognitive Neuroscience.

[67]  Stephen C Strother,et al.  Predicting performance from functional imaging data: methods matter , 2003, NeuroImage.

[68]  T. Carlson,et al.  Patterns of Activity in the Categorical Representations of Objects , 2003 .

[69]  S. Kosslyn,et al.  Neural correlates of different types of deception: an fMRI investigation. , 2003, Cerebral cortex.

[70]  Leslie G. Ungerleider,et al.  A general mechanism for perceptual decision-making in the human brain , 2004, Nature.

[71]  Michael Brammer,et al.  Brain scam? , 2004, Nature Neuroscience.

[72]  Samuel M. McClure,et al.  Neural Correlates of Behavioral Preference for Culturally Familiar Drinks , 2004, Neuron.

[73]  William A. Cunningham,et al.  PSYCHOLOGICAL SCIENCE Research Article Separable Neural Components in the Processing of Black and White , 2022 .

[74]  Andrew H. Ryan,et al.  Comparison of polygraph data obtained from individuals involved in mock crimes and actual criminal investigations. , 2004, The Journal of applied psychology.

[75]  R. Malach,et al.  Intersubject Synchronization of Cortical Activity During Natural Vision , 2004, Science.

[76]  Jonathan R Wolpaw,et al.  Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[77]  Stefano Panzeri,et al.  Functional imaging and neural information coding , 2004, NeuroImage.

[78]  Tom M. Mitchell,et al.  Learning to Decode Cognitive States from Brain Images , 2004, Machine Learning.

[79]  R. Veit,et al.  Self-regulation of local brain activity using real-time functional magnetic resonance imaging (fMRI) , 2004, Journal of Physiology-Paris.

[80]  Nikos K Logothetis,et al.  On the nature of the BOLD fMRI contrast mechanism. , 2004, Magnetic resonance imaging.

[81]  S. Zeki,et al.  Functional brain mapping during free viewing of natural scenes , 2004, Human brain mapping.

[82]  Stephen C. Strother,et al.  Support vector machines for temporal classification of block design fMRI data , 2005, NeuroImage.

[83]  Geoffrey M Boynton,et al.  Imaging orientation selectivity: decoding conscious perception in V1 , 2005, Nature Neuroscience.

[84]  Conny F. Schmidt,et al.  Face perception is mediated by a distributed cortical network , 2005, Brain Research Bulletin.

[85]  F. Tong,et al.  Decoding the visual and subjective contents of the human brain , 2005, Nature Neuroscience.

[86]  M. Farah,et al.  Neuroethics: the practical and the philosophical , 2005, Trends in Cognitive Sciences.

[87]  R. Deichmann,et al.  Eye-specific effects of binocular rivalry in the human lateral geniculate nucleus , 2005, Nature.

[88]  Alice J. O'Toole,et al.  Partially Distributed Representations of Objects and Faces in Ventral Temporal Cortex , 2005, Journal of Cognitive Neuroscience.

[89]  C. Koch,et al.  Invariant visual representation by single neurons in the human brain , 2005, Nature.

[90]  R. Gur,et al.  Telling truth from lie in individual subjects with fast event‐related fMRI , 2005, Human brain mapping.

[91]  G. Rees,et al.  Predicting the Stream of Consciousness from Activity in Human Visual Cortex , 2005, Current Biology.

[92]  Dinggang Shen,et al.  Classifying spatial patterns of brain activity with machine learning methods: Application to lie detection , 2005, NeuroImage.

[93]  M. Boly,et al.  Residual cognitive function in comatose, vegetative and minimally conscious states , 2005, Current opinion in neurology.

[94]  G. Rees,et al.  Predicting the orientation of invisible stimuli from activity in human primary visual cortex , 2005, Nature Neuroscience.

[95]  S. Pridmore,et al.  Neuroimaging in Psychopathy , 2005, The Australian and New Zealand journal of psychiatry.

[96]  K. Phan,et al.  Neuroimaging and personality disorders , 2005, Current psychiatry reports.

[97]  Daniel L Adams,et al.  The cortical column: a structure without a function , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[98]  Tomaso Poggio,et al.  Fast Readout of Object Identity from Macaque Inferior Temporal Cortex , 2005, Science.

[99]  Vaidehi S. Natu,et al.  Category-Specific Cortical Activity Precedes Retrieval During Memory Search , 2005, Science.

[100]  Kevin A. Johnson,et al.  Detecting Deception Using Functional Magnetic Resonance Imaging , 2005, Biological Psychiatry.

[101]  Janaina Mourão Miranda,et al.  Classifying brain states and determining the discriminating activation patterns: Support Vector Machine on functional MRI data , 2005, NeuroImage.

[102]  K. Dickson,et al.  Will the law come running? The potential role of "brain fingerprinting" in crime investigation and adjudication in Australia. , 2005, Journal of law and medicine.

[103]  Timothy J Ziemlewicz,et al.  Neural correlates of telling lies: a functional magnetic resonance imaging study at 4 Tesla. , 2005, Academic radiology.

[104]  Doris Y. Tsao,et al.  A Cortical Region Consisting Entirely of Face-Selective Cells , 2006, Science.

[105]  R. Andersen,et al.  Cognitive neural prosthetics. , 2010, Annual review of psychology.

[106]  K. Grill-Spector,et al.  Repetition and the brain: neural models of stimulus-specific effects , 2006, Trends in Cognitive Sciences.

[107]  N. Kanwisher,et al.  Domain specificity in visual cortex. , 2006, Cerebral cortex.

[108]  Rainer Goebel,et al.  Information-based functional brain mapping. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[109]  R. Poldrack.  Can cognitive processes be inferred from neuroimaging data? , 2006, Trends in Cognitive Sciences.