Mapping of the brain activation associated with deception using fused EEG and fNIRS

In this study, concurrent electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) recordings were performed based on a modified concealed information test (CIT) task to examine the relationship between the hemodynamic signal of the frontal cortex and event-related potential (ERP) component of P300 for high-sensitivity deception detection. In particular, both the fNIRS data and ERP component of P300 were carefully inspected for participants from both the guilty group and innocent groups. During the performance of CIT task, a series of names were presented, which served as the target, irrelevant, or the probe stimuli for the two groups. The guilty participant who assumed himself (herself) as a spy was instructed to deny the recognition of probe (his (her) own name).Interestingly, we discovered that for the guilty group, the probe stimuli elicited significantly larger P300 at parietal site and also evoked significantly higher HbO concentration changes in bilateral superior frontal gyrus and bilateral middle frontal gyrus than the irrelevants stimuli. However, this is not the case for the innocent group, in which participants didn’t exhibit significant difference in both ERP and fNIRS recordings between the probe and irrelevants stimuli cases. More importantly, our findings also indicated that the combined ERP and fNIRS signals can distinguish well between the guilty and innocent groups, in which AUC (the area under Receiver Operating Characteristic curve) is 0.91 for deception detection based on the combined indicator, much higher than that based on ERP components P300 (0.85) or fNIRS signals (0.84).

[1]  J. Polich.  Updating P 300 : An Integrative Theory of P 3 a and P 3 b , 2009 .

[2]  Xiaohong Lin,et al.  Novel, ERP-based, concealed information detection: Combining recognition-based and feedback-evoked ERPs , 2016, Biological Psychology.

[3]  Arthur W Toga,et al.  Localisation of increased prefrontal white matter in pathological liars , 2007, British Journal of Psychiatry.

[4]  Andrew D. Engell,et al.  The Neural Bases of Cognitive Conflict and Control in Moral Judgment , 2004, Neuron.

[5]  J. Polich.  Updating P300: An integrative theory of P3a and P3b , 2007, Clinical Neurophysiology.

[6]  Joseph M. Paxton,et al.  Patterns of neural activity associated with honest and dishonest moral decisions , 2009, Proceedings of the National Academy of Sciences.

[7]  R. C. Gur,et al.  Brain Activity during Simulated Deception: An Event-Related Functional Magnetic Resonance Study , 2002, NeuroImage.

[8]  D. Delpy,et al.  System for long-term measurement of cerebral blood and tissue oxygenation on newborn infants by near infra-red transillumination , 1988, Medical and Biological Engineering and Computing.

[9]  Xiao Pan Ding,et al.  Detecting Concealed Information Using Functional Near-Infrared Spectroscopy , 2014, Brain Topography.

[10]  Jiangang Liu,et al.  Neural correlates of second-order verbal deception: A functional near-infrared spectroscopy (fNIRS) study , 2014, NeuroImage.

[11]  P. Goldman-Rakic,et al.  Infrequent events transiently activate human prefrontal and parietal cortex as measured by functional MRI. , 1997, Journal of neurophysiology.

[12]  Tobias Egner,et al.  Intentional false responding shares neural substrates with response conflict and cognitive control , 2005, NeuroImage.

[13]  Kevin A. Johnson,et al.  Detecting Deception Using Functional Magnetic Resonance Imaging , 2005, Biological Psychiatry.

[14]  Sungho Tak,et al.  Quantification of CMRO2 without hypercapnia using simultaneous near-infrared spectroscopy and fMRI measurements , 2010, Physics in medicine and biology.

[15]  J. Ford,et al.  Combined event‐related fMRI and EEG evidence for temporal—parietal cortex activation during target detection , 1997, Neuroreport.

[16]  E Donchin,et al.  The truth will out: interrogative polygraphy ("lie detection") with event-related brain potentials. , 1991, Psychophysiology.

[17]  M. Gamer,et al.  Task relevance and recognition of concealed information have different influences on electrodermal activity and event-related brain potentials. , 2010, Psychophysiology.

[18]  J P Rosenfeld,et al.  Late vertex positivity in event-related potentials as a guilty knowledge indicator: a new method of life detection. , 1987, The International journal of neuroscience.

[19]  Bruno Verschuere,et al.  Combining physiological measures in the detection of concealed information , 2008, Physiology & Behavior.

[20]  Atsushi Maki,et al.  Simultaneous Recording of Event-Related Auditory Oddball Response Using Transcranial Near Infrared Optical Topography and Surface EEG , 2002, NeuroImage.

[21]  D. Linden.  The P300: Where in the Brain Is It Produced and What Does It Tell Us? , 2005, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[22]  A. Owen,et al.  Anterior prefrontal cortex: insights into function from anatomy and neuroimaging , 2004, Nature Reviews Neuroscience.

[23]  S. Kosslyn,et al.  Neural correlates of different types of deception: an fMRI investigation. , 2003, Cerebral cortex.

[24]  R. Goebel,et al.  The functional neuroanatomy of target detection: an fMRI study of visual and auditory oddball tasks. , 1999, Cerebral cortex.

[25]  N. Abe.  The neurobiology of deception: evidence from neuroimaging and loss-of-function studies , 2009, Current opinion in neurology.

[26]  Archana K. Singh,et al.  Spatial registration of multichannel multi-subject fNIRS data to MNI space without MRI , 2005, NeuroImage.

[27]  Michael R. Winograd,et al.  Review of recent studies and issues regarding the P300-based complex trial protocol for detection of concealed information. , 2013, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[28]  Keum-Shik Hong,et al.  Single-trial lie detection using a combined fNIRS-polygraph system , 2015, Front. Psychol..

[29]  I. Wilkinson,et al.  Behavioural and functional anatomical correlates of deception in humans , 2001, Neuroreport.

[30]  S. Ge,et al.  fNIRS-based online deception decoding , 2012, Journal of neural engineering.

[31]  Kang Lee,et al.  Neural correlates of spontaneous deception: A functional near-infrared spectroscopy (fNIRS)study , 2013, Neuropsychologia.

[32]  J. Rosenfeld,et al.  Simple, effective countermeasures to P300-based tests of detection of concealed information. , 2004, Psychophysiology.

[33]  G. Sartori,et al.  Lie-specific involvement of dorsolateral prefrontal cortex in deception. , 2008, Cerebral cortex.

[34]  Masatoshi Itoh,et al.  Deceiving Others: Distinct Neural Responses of the Prefrontal Cortex and Amygdala in Simple Fabrication and Deception with Social Interactions , 2007, Journal of Cognitive Neuroscience.

[35]  Wolfgang Ambach,et al.  A Concealed Information Test with multimodal measurement. , 2010, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[36]  R. Gur,et al.  Telling truth from lie in individual subjects with fast event‐related fMRI , 2005, Human brain mapping.

[37]  R. Veit,et al.  The truth about lying: inhibition of the anterior prefrontal cortex improves deceptive behavior. , 2010, Cerebral cortex.

[38]  Huafu Chen,et al.  Mapping the small-world properties of brain networks in deception with functional near-infrared spectroscopy , 2016, Scientific Reports.

[39]  Yufeng Ke,et al.  Enhancing performance of P300-Speller under mental workload by incorporating dual-task data during classifier training , 2017, Comput. Methods Programs Biomed..

[40]  H. Nittono,et al.  Event-related potentials increase the discrimination performance of the autonomic-based concealed information test. , 2011, Psychophysiology.

[41]  Archana K. Singh,et al.  Exploring the false discovery rate in multichannel NIRS , 2006, NeuroImage.

[42]  Yong He,et al.  BrainNet Viewer: A Network Visualization Tool for Human Brain Connectomics , 2013, PloS one.

[43]  J. Cohen,et al.  Dissociating the role of the dorsolateral prefrontal and anterior cingulate cortex in cognitive control. , 2000, Science.

[44]  Gershon Ben-Shakhar,et al.  Effects of questions' repetition and variation on the efficiency of the guilty knowledge test: a reexamination. , 2002, The Journal of applied psychology.

[45]  J Peter Rosenfeld,et al.  Detecting Knowledge of Incidentally Acquired, Real-World Memories Using a P300-Based Concealed-Information Test , 2014, Psychological science.

[46]  D. Boas,et al.  HomER: a review of time-series analysis methods for near-infrared spectroscopy of the brain. , 2009, Applied optics.

[47]  Adrianna C. Jenkins,et al.  Damage To Dorsolateral Prefrontal Cortex Affects Tradeoffs Between Honesty And Self-Interest , 2014, Nature Neuroscience.

[48]  O. Bock,et al.  Age-related changes in prefrontal activity during walking in dual-task situations: a fNIRS study. , 2014, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[49]  S. Debener,et al.  How about taking a low-cost, small, and wireless EEG for a walk? , 2012, Psychophysiology.