Single-trial lie detection using a combined fNIRS-polygraph system

Deception is a human behavior that many people experience in daily life. It involves complex neuronal activities in addition to several physiological changes in the body. A polygraph, which can measure some of the physiological responses from the body, has been widely employed in lie-detection. Many researchers, however, believe that lie detection can become more precise if the neuronal changes that occur in the process of deception can be isolated and measured. In this study, we combine both measures (i.e., physiological and neuronal changes) for enhanced lie-detection. Specifically, to investigate the deception-related hemodynamic response, functional near-infrared spectroscopy (fNIRS) is applied at the prefrontal cortex besides a commercially available polygraph system. A mock crime scenario with a single-trial stimulus is set up as a deception protocol. The acquired data are classified into “true” and “lie” classes based on the fNIRS-based hemoglobin-concentration changes and polygraph-based physiological signal changes. Linear discriminant analysis is utilized as a classifier. The results indicate that the combined fNIRS-polygraph system delivers much higher classification accuracy than that of a singular system. This study demonstrates a plausible solution toward single-trial lie-detection by combining fNIRS and the polygraph.

[1]  Min Zhao,et al.  A New Approach for Concealed Information Identification Based on ERP Assessment , 2011, Journal of Medical Systems.

[2]  Hanli Liu,et al.  Functional near-infrared spectroscopy to investigate hemodynamic responses to deception in the prefrontal cortex , 2009, Brain Research.

[3]  Keum-Shik Hong,et al.  Real-time feature extraction of P300 component using adaptive nonlinear principal component analysis , 2011, Biomedical engineering online.

[4]  M. Herrmann,et al.  Medial prefrontal cortex stimulation modulates the processing of conditioned fear , 2014, Front. Behav. Neurosci..

[5]  Jeffrey J. Walczyk,et al.  Advancing Lie Detection by Inducing Cognitive Load on Liars: A Review of Relevant Theories and Techniques Guided by Lessons from Polygraph-Based Approaches , 2013, Front. Psychology.

[6]  R. Pozos,et al.  Near-Infrared Spectroscopy (NIRS) , 2011 .

[7]  C. C. Duncan,et al.  Safety of Atomoxetine in Combination With Intravenous Cocaine in Cocaine-Experienced Participants , 2012, Journal of addiction medicine.

[8]  M. Ferrari,et al.  The use of near infrared spectroscopy in sports medicine. , 2003, The Journal of sports medicine and physical fitness.

[9]  Ewout H. Meijer,et al.  Memory detection with the Concealed Information Test: a meta analysis of skin conductance, respiration, heart rate, and P300 data. , 2014, Psychophysiology.

[10]  Keum-Shik Hong,et al.  Decoding Answers to Four-Choice Questions Using Functional near Infrared Spectroscopy , 2015 .

[11]  Keum-Shik Hong,et al.  Decoding of four movement directions using hybrid NIRS-EEG brain-computer interface , 2014, Front. Hum. Neurosci..

[12]  Martin Wolf,et al.  General equation for the differential pathlength factor of the frontal human head depending on wavelength and age , 2013, Journal of biomedical optics.

[13]  Keum-Shik Hong,et al.  Noise reduction in functional near-infrared spectroscopy signals by independent component analysis. , 2013, The Review of scientific instruments.

[14]  Hellmuth Obrig,et al.  A wearable multi-channel fNIRS system for brain imaging in freely moving subjects , 2014, NeuroImage.

[15]  H. Nittono,et al.  Event-related potentials increase the discrimination performance of the autonomic-based concealed information test. , 2011, Psychophysiology.

[16]  J Peter Rosenfeld,et al.  Deception awareness improves P300-based deception detection in concealed information tests. , 2012, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[17]  Niels Birbaumer,et al.  Learned EEG-based brain self-regulation of motor-related oscillations during application of transcranial electric brain stimulation: feasibility and limitations , 2014, Front. Behav. Neurosci..

[18]  E Donchin,et al.  The truth will out: interrogative polygraphy ("lie detection") with event-related brain potentials. , 1991, Psychophysiology.

[19]  A non-standard method for estimating accuracy of lie detection techniques demonstrated on a self-validating set of field polygraph examinations , 2013 .

[20]  Dan J Stein,et al.  Altered prefrontal cortical function during processing of fear-relevant stimuli in pregnancy , 2011, Behavioural Brain Research.

[21]  J. A. Pruszynski,et al.  Neural correlates , 2023 .

[22]  Ning Zhong,et al.  Different Strategies in Solving Series Completion Inductive Reasoning Problems: An fMRI and Computational Study , 2014, CogSci.

[23]  Martin P. Paulus,et al.  The effect of age on neural processing of pleasant soft touch stimuli , 2014, Front. Behav. Neurosci..

[24]  G. Miserocchi,et al.  Near Infrared Spectroscopy (NIRS) as a New Non-Invasive Tool to Detect Oxidative Skeletal Muscle Impairment in Children Survived to Acute Lymphoblastic Leukaemia , 2014, PloS one.

[25]  T. Falk,et al.  Taking NIRS-BCIs Outside the Lab: Towards Achieving Robustness Against Environment Noise , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[26]  Martin Wolf,et al.  Progress of near-infrared spectroscopy and topography for brain and muscle clinical applications. , 2007, Journal of biomedical optics.

[27]  Farrokh Janabi-Sharifi Real-Time Feature Extraction , 2002 .

[28]  伸二 平,et al.  脳機能研究によるconcealed information testの動向 , 2009 .

[29]  Robert Riener,et al.  Detection of motor execution using a hybrid fNIRS-biosignal BCI: a feasibility study , 2013, Journal of NeuroEngineering and Rehabilitation.

[30]  Y. Kim,et al.  Classification of prefrontal and motor cortex signals for three-class fNIRS–BCI , 2015, Neuroscience Letters.

[31]  Klaus-Robert Müller,et al.  Enhanced Performance by a Hybrid Nirs–eeg Brain Computer Interface , 2022 .

[32]  Zhen Yuan,et al.  Fusion of fNIRS and fMRI data: identifying when and where hemodynamic signals are changing in human brains , 2013, Front. Hum. Neurosci..

[33]  N. Birbaumer,et al.  Age increases brain complexity. , 1996, Electroencephalography and clinical neurophysiology.

[34]  C. C. Duncan,et al.  Event-related potentials in clinical research: Guidelines for eliciting, recording, and quantifying mismatch negativity, P300, and N400 , 2009, Clinical Neurophysiology.

[35]  A. Eke,et al.  The modified Beer–Lambert law revisited , 2006, Physics in medicine and biology.

[36]  Keum-Shik Hong,et al.  Online binary decision decoding using functional near-infrared spectroscopy for the development of brain–computer interface , 2014, Experimental Brain Research.

[37]  S. Ge,et al.  Recognition of stimulus-evoked neuronal optical response by identifying chaos levels of near-infrared spectroscopy time series , 2011, Neuroscience Letters.

[38]  E. D. Farahani,et al.  A Concealed Information Test with Combination of ERP Recording and Autonomic Measurements , 2013, Neurophysiology.

[39]  Keum-Shik Hong,et al.  State-space models of impulse hemodynamic responses over motor, somatosensory, and visual cortices. , 2014, Biomedical optics express.

[40]  T. Farrow,et al.  A cognitive neurobiological account of deception: evidence from functional neuroimaging. , 2004, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[41]  S. Ge,et al.  fNIRS-based online deception decoding , 2012, Journal of neural engineering.

[42]  Tianzi Jiang,et al.  The neural correlates of risk propensity in males and females using resting-state fMRI , 2014, Front. Behav. Neurosci..

[43]  H. Nittono,et al.  Identifying concealment-related responses in the concealed information test. , 2013, Psychophysiology.

[44]  Keum-Shik Hong,et al.  fNIRS-based brain-computer interfaces: a review , 2015, Front. Hum. Neurosci..

[45]  M. Farah,et al.  Functional MRI-based lie detection: scientific and societal challenges , 2014, Nature Reviews Neuroscience.

[46]  Keum-Shik Hong,et al.  Classification of functional near-infrared spectroscopy signals corresponding to the right- and left-wrist motor imagery for development of a brain–computer interface , 2013, Neuroscience Letters.

[47]  S. Platek,et al.  Brain mapping of deception and truth telling about an ecologically valid situation: functional MR imaging and polygraph investigation--initial experience. , 2006, Radiology.

[48]  K. Hong,et al.  Lateralization of music processing with noises in the auditory cortex: an fNIRS study , 2014, Front. Behav. Neurosci..

[49]  Michael R. Winograd,et al.  Review of recent studies and issues regarding the P300-based complex trial protocol for detection of concealed information. , 2013, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[50]  A. Denault,et al.  Cerebral near-infrared spectroscopy in adult heart surgery: systematic review of its clinical efficacy , 2005, Canadian journal of anaesthesia = Journal canadien d'anesthesie.

[51]  C H Schmitz,et al.  Optical tomographic imaging of dynamic features of dense-scattering media. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[52]  Keum-Shik Hong,et al.  Linear parameter-varying model and adaptive filtering technique for detecting neuronal activities: an fNIRS study , 2013, Journal of neural engineering.

[53]  M. R. Bhutta,et al.  Note: three wavelengths near-infrared spectroscopy system for compensating the light absorbance by water. , 2014, The Review of scientific instruments.

[54]  Jiangang Liu,et al.  Neural correlates of second-order verbal deception: A functional near-infrared spectroscopy (fNIRS) study , 2014, NeuroImage.

[55]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces , 2007, Journal of neural engineering.

[56]  C. C. Duncan,et al.  Event-related potentials in clinical research : Guidelines for eliciting , recording , and quantifying mismatch negativity , P 300 , and N 400 , 2017 .

[57]  M. Wolf,et al.  Wireless miniaturized in-vivo near infrared imaging. , 2008, Optics express.

[58]  Xiao Pan Ding,et al.  Detecting Concealed Information Using Functional Near-Infrared Spectroscopy , 2014, Brain Topography.

[59]  Andreas J Fallgatter,et al.  Affective perception and imagery: A NIRS study. , 2011, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[60]  R. Eston,et al.  Prefrontal Cortex Haemodynamics and Affective Responses during Exercise: A Multi-Channel Near Infrared Spectroscopy Study , 2014, PloS one.

[61]  D. V. van Essen,et al.  The contributions of prefrontal cortex and executive control to deception: evidence from activation likelihood estimate meta-analyses. , 2009, Cerebral cortex.

[62]  F. Irani,et al.  Functional Near Infrared Spectroscopy (fNIRS): An Emerging Neuroimaging Technology with Important Applications for the Study of Brain Disorders , 2007, The Clinical neuropsychologist.

[63]  Anthony D. Wagner,et al.  Functional MRI-based lie detection: scientific and societal challenges , 2014, Nature Reviews Neuroscience.

[64]  Beop-Min Kim,et al.  Development of wireless NIRS system with dynamic removal of motion artifacts , 2011 .

[65]  Kang Lee,et al.  Neural correlates of spontaneous deception: A functional near-infrared spectroscopy (fNIRS)study , 2013, Neuropsychologia.