Neuronal Activation Detection Using Vector Phase Analysis with Dual Threshold Circles: A Functional Near-Infrared Spectroscopy Study

In this paper, a new vector phase diagram differentiating the initial decreasing phase (i.e. initial dip) and the delayed hemodynamic response (HR) phase of oxy-hemoglobin changes ( Δ HbO) of functional near-infrared spectroscopy (fNIRS) is developed. The vector phase diagram displays the trajectories of Δ HbO and deoxy-hemoglobin changes ( Δ HbR), as orthogonal components, in the Δ HbO- Δ HbR polar coordinates. To determine the occurrence of an initial dip, dual threshold circles (an inner circle from the resting state, an outer circle from the peak values of the initial dip and the main HR) are incorporated into the phase diagram for making decisions. The proposed scheme is then applied to a brain-computer interface scheme, and its performance is evaluated in classifying two finger tapping tasks (right-hand thumb and little finger) from the left motor cortex. Three gamma functions are used to model the initial dip, the main HR, and the undershoot in generating the designed HR function. In classifying two tapping tasks, the signal mean and signal minimum values during 0-2.5 s, as features of initial dip, are used. The linear discriminant analysis was utilized as a classifier. The experimental results show that the active brain locations of the two tasks were quite distinctive ( p < 0.05 ), and moreover, spatially specific if using the initial dip map at 4 s in comparison to the map of HRs at 14 s. Also, the average classification accuracy was improved from 59% to 74.9% when using the phase diagram of dual threshold circles.

[1]  Yoshihiro Suda,et al.  Greater Activity in the Frontal Cortex on Left Curves: A Vector-Based fNIRS Study of Left and Right Curve Driving , 2015, PloS one.

[2]  S. Takashima,et al.  Human Visual Cortical Function during Photic Stimulation Monitoring by Means of near-Infrared Spectroscopy , 1993, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[3]  Qi Wu,et al.  Using Fractal and Local Binary Pattern Features for Classification of ECOG Motor Imagery Tasks Obtained from the Right Brain Hemisphere , 2016, Int. J. Neural Syst..

[4]  E Yacoub,et al.  Detection of the early decrease in fMRI signal in the motor area , 2001, Magnetic resonance in medicine.

[5]  Luciano Fadiga,et al.  Superlinear Summation of Information in Premotor Neuron Pairs , 2017, Int. J. Neural Syst..

[6]  Karl J. Friston,et al.  CHAPTER 2 – Statistical parametric mapping , 2007 .

[7]  Rami Saab,et al.  An Auditory-Tactile Visual Saccade-Independent P300 Brain-Computer Interface , 2016, Int. J. Neural Syst..

[8]  Klaus-Robert Müller,et al.  Enhanced Performance by a Hybrid Nirs–eeg Brain Computer Interface , 2022 .

[9]  Heidrun Wabnitz,et al.  Special Section Guest Editorial:Clinical near-infrared spectroscopy and imaging of the brain , 2016, Neurophotonics.

[10]  Xingyu Wang,et al.  Sparse Bayesian Learning for Obtaining Sparsity of EEG Frequency Bands Based Feature Vectors in Motor Imagery Classification , 2017, Int. J. Neural Syst..

[11]  E Yacoub,et al.  Detection of the early negative response in fMRI at 1.5 Tesla , 1999, Magnetic resonance in medicine.

[12]  Martin A. Lindquist,et al.  Modeling the hemodynamic response function in fMRI: Efficiency, bias and mis-modeling , 2009, NeuroImage.

[13]  Noriyuki Oka,et al.  Increased oxygen load in the prefrontal cortex from mouth breathing: a vector-based near-infrared spectroscopy study , 2013, Neuroreport.

[14]  Guillaume Flandin,et al.  Functional optical signal analysis: a software tool for near-infrared spectroscopy data processing incorporating statistical parametric mapping. , 2007, Journal of biomedical optics.

[15]  K. Hong,et al.  Bundled-Optode Method in Functional Near-Infrared Spectroscopy , 2016, PloS one.

[16]  Keum-Shik Hong,et al.  Passive BCI based on drowsiness detection: an fNIRS study. , 2015, Biomedical optics express.

[17]  Marcel van Gerven,et al.  Spreading Codes Enables the Blind Estimation of the Hemodynamic Response with Short-Events Sequences , 2015, Int. J. Neural Syst..

[18]  T. Braver,et al.  Cognitive Neuroscience Approaches to Individual Differences in Working Memory and Executive Control: Conceptual and Methodological Issues , 2010 .

[19]  Michael-Paul Schallmo,et al.  Selective BOLD responses to individual finger movement measured with fMRI at 3T , 2012, Human brain mapping.

[20]  Jörn Diedrichsen,et al.  Two Distinct Ipsilateral Cortical Representations for Individuated Finger Movements , 2012, Cerebral cortex.

[21]  J. Buford,et al.  Wavelet methodology to improve single unit isolation in primary motor cortex cells , 2015, Journal of Neuroscience Methods.

[22]  Hideki Takahashi,et al.  Correlation of prefrontal cortical activation with changing vehicle speeds in actual driving: a vector-based functional near-infrared spectroscopy study , 2013, Front. Hum. Neurosci..

[23]  Yong Xu,et al.  Using co-variations in the Hb signal to detect visual activation: A near infrared spectroscopic imaging study , 2009, NeuroImage.

[24]  Long Chen,et al.  Incorporation of Inter-Subject Information to Improve the Accuracy of Subject-Specific P300 Classifiers , 2016, Int. J. Neural Syst..

[25]  David A. Boas,et al.  Differences in the hemodynamic response to event-related motor and visual paradigms as measured by near-infrared spectroscopy , 2003, NeuroImage.

[26]  Tomer Fekete,et al.  The NIRS Analysis Package: Noise Reduction and Statistical Inference , 2011, PloS one.

[27]  B Christie,et al.  Doctors revise Declaration of Helsinki , 2000, BMJ : British Medical Journal.

[28]  J. Buford,et al.  Combined corticospinal and reticulospinal effects on upper limb muscles , 2014, Neuroscience Letters.

[29]  Adelina Pellicer,et al.  Near-infrared spectroscopy: a methodology-focused review. , 2011, Seminars in fetal & neonatal medicine.

[30]  Marco Antonio Luersen,et al.  Globalized Nelder-Mead method for engineering optimization , 2002 .

[31]  S. Kastner,et al.  Complex organization of human primary motor cortex: a high-resolution fMRI study. , 2008, Journal of neurophysiology.

[32]  Judit Gervain,et al.  Near-infrared spectroscopy: recent advances in infant speech perception and language acquisition research , 2014, Front. Psychol..

[33]  Keum-Shik Hong,et al.  Detection and classification of three-class initial dips from prefrontal cortex. , 2017, Biomedical optics express.

[34]  R. M. Siegel,et al.  High-resolution optical imaging of functional brain architecture in the awake monkey. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[35]  Wei Li,et al.  Increasing N200 Potentials Via Visual Stimulus Depicting Humanoid Robot Behavior , 2016, Int. J. Neural Syst..

[36]  Dae-Shik Kim,et al.  High-resolution mapping of iso-orientation columns by fMRI , 2000, Nature Neuroscience.

[37]  Keum-Shik Hong,et al.  Reduction of trial-to-trial variability in functional near-infrared spectroscopy signals by accounting for resting-state functional connectivity , 2013, Journal of biomedical optics.

[38]  Toshinori Kato,et al.  Vector-based phase classification of initial dips during word listening using near-infrared spectroscopy , 2012, Neuroreport.

[39]  Keum-Shik Hong,et al.  fNIRS-based brain-computer interfaces: a review , 2015, Front. Hum. Neurosci..

[40]  Nick F. Ramsey,et al.  BOLD matches neuronal activity at the mm scale: A combined 7T fMRI and ECoG study in human sensorimotor cortex , 2014, NeuroImage.

[41]  K. Hong,et al.  Detection of primary RGB colors projected on a screen using fNIRS , 2017 .

[42]  K. Hong,et al.  Decoding four different sound-categories in the auditory cortex using functional near-infrared spectroscopy , 2016, Hearing Research.

[43]  R. Turner,et al.  Event-Related fMRI: Characterizing Differential Responses , 1998, NeuroImage.

[44]  David A Boas,et al.  Increased Cerebral Blood Volume and Oxygen Consumption in Neonatal Brain Injury , 2009, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[45]  Andreas Bartels,et al.  Temporal Jitter of the BOLD Signal Reveals a Reliable Initial Dip and Improved Spatial Resolution , 2013, Current Biology.

[46]  Thibault Gateau,et al.  Real-Time State Estimation in a Flight Simulator Using fNIRS , 2015, PloS one.

[47]  Bin Xia,et al.  Brain–Computer Interface–Based Communication in the Completely Locked-In State , 2017, GBCIC.

[48]  A. Grinvald,et al.  Interactions Between Electrical Activity and Cortical Microcirculation Revealed by Imaging Spectroscopy: Implications for Functional Brain Mapping , 1996, Science.

[49]  R. Buxton,et al.  Dynamics of blood flow and oxygenation changes during brain activation: The balloon model , 1998, Magnetic resonance in medicine.

[50]  Essa Yacoub,et al.  The story of the initial dip in fMRI , 2012, NeuroImage.

[51]  Keum-Shik Hong,et al.  State-space models of impulse hemodynamic responses over motor, somatosensory, and visual cortices. , 2014, Biomedical optics express.

[52]  Takeshi Kawase,et al.  TMS Orientation for NIRS-Functional Motor Mapping , 2006, Brain Topography.

[53]  Toshinori Kato,et al.  Principle and technique of NIRS-Imaging for human brain FORCE: fast-oxygen response in capillary event , 2004 .

[54]  Bülent Sankur,et al.  Constraining the general linear model for sensible hemodynamic response function waveforms , 2008, Medical & Biological Engineering & Computing.

[55]  Yoko Hoshi,et al.  Functional near-infrared spectroscopy: current status and future prospects. , 2007, Journal of biomedical optics.

[56]  G. Taga,et al.  Hemoglobin phase of oxygenation and deoxygenation in early brain development measured using fNIRS , 2017, Proceedings of the National Academy of Sciences.

[57]  K. Hong,et al.  Lateralization of music processing with noises in the auditory cortex: an fNIRS study , 2014, Front. Behav. Neurosci..

[58]  Han-Jeong Hwang,et al.  Near-infrared spectroscopy (NIRS)-based eyes-closed brain-computer interface (BCI) using prefrontal cortex activation due to mental arithmetic , 2016, Scientific Reports.

[59]  Keum-Shik Hong,et al.  Kalman estimator- and general linear model-based on-line brain activation mapping by near-infrared spectroscopy , 2010, Biomedical engineering online.

[60]  K. Hong,et al.  Bundled-optode implementation for 3D imaging in functional near-infrared spectroscopy. , 2016, Biomedical optics express.

[61]  A. Shmuel,et al.  Investigation of the initial dip in fMRI at 7 Tesla , 2001, NMR in biomedicine.

[62]  Theodore J. Huppert,et al.  Real-time imaging of human brain function by near-infrared spectroscopy using an adaptive general linear model , 2009, NeuroImage.

[63]  D. Boas,et al.  HomER: a review of time-series analysis methods for near-infrared spectroscopy of the brain. , 2009, Applied optics.

[64]  Simone Cutini,et al.  Functional near Infrared Optical Imaging in Cognitive Neuroscience: An Introductory Review , 2012 .

[65]  Y. Hoshi Functional near-infrared optical imaging: utility and limitations in human brain mapping. , 2003, Psychophysiology.

[66]  J. Hennig,et al.  Observation of a fast response in functional MR , 1994, Magnetic resonance in medicine.

[67]  J. Buford,et al.  Brain–Computer Interface after Nervous System Injury , 2014, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[68]  Jeffrey C. Lagarias,et al.  Convergence Properties of the Nelder-Mead Simplex Method in Low Dimensions , 1998, SIAM J. Optim..

[69]  Takashi Uehara,et al.  Impact of Familial Loading on Prefrontal Activation in Major Psychiatric Disorders: A Near-Infrared Spectroscopy (NIRS) Study , 2017, Scientific Reports.

[70]  Keum-Shik Hong,et al.  Decoding of four movement directions using hybrid NIRS-EEG brain-computer interface , 2014, Front. Hum. Neurosci..

[71]  Atsushi Maki,et al.  Temporal behavior of human functional near-infraredgraphy (fNIR) using single-word speaking trial , 1999 .

[72]  Tom Chau,et al.  Online EEG Classification of Covert Speech for Brain-Computer Interfacing , 2017, Int. J. Neural Syst..

[73]  K. Hong,et al.  Determining Optimal Feature-Combination for LDA Classification of Functional Near-Infrared Spectroscopy Signals in Brain-Computer Interface Application , 2016, Front. Hum. Neurosci..

[74]  D. Ts'o,et al.  Cortical functional architecture and local coupling between neuronal activity and the microcirculation revealed by in vivo high-resolution optical imaging of intrinsic signals. , 1990, Proceedings of the National Academy of Sciences of the United States of America.

[75]  Society of magnetic resonance in medicine , 1990 .

[76]  A. Maki,et al.  Intersubject variability of near-infrared spectroscopy signals during sensorimotor cortex activation. , 2005, Journal of biomedical optics.

[77]  Keum Shik Hong,et al.  Hybrid Brain–Computer Interface Techniques for Improved Classification Accuracy and Increased Number of Commands: A Review , 2017, Front. Neurorobot..

[78]  D. Delpy,et al.  System for long-term measurement of cerebral blood and tissue oxygenation on newborn infants by near infra-red transillumination , 1988, Medical and Biological Engineering and Computing.

[79]  A. Villringer,et al.  Near infrared spectroscopy (NIRS): A new tool to study hemodynamic changes during activation of brain function in human adults , 1993, Neuroscience Letters.

[80]  S. Arridge,et al.  Estimation of optical pathlength through tissue from direct time of flight measurement , 1988 .

[81]  Keum Shik Hong,et al.  Hybrid EEG–fNIRS-Based Eight-Command Decoding for BCI: Application to Quadcopter Control , 2017, Front. Neurorobot..

[82]  M. R. Bhutta,et al.  Classification of somatosensory cortex activities using fNIRS , 2017, Behavioural Brain Research.

[83]  Keum Shik Hong,et al.  Reduction of Delay in Detecting Initial Dips from Functional Near-Infrared Spectroscopy Signals Using Vector-Based Phase Analysis , 2016, Int. J. Neural Syst..

[84]  H. Adeli,et al.  Brain-computer interface technologies: from signal to action , 2013, Reviews in the neurosciences.

[85]  Nicholas G Martin,et al.  Modeling of the Hemodynamic Responses in Block Design fMRI Studies , 2014, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[86]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[87]  Sungho Tak,et al.  NIRS-SPM: Statistical parametric mapping for near-infrared spectroscopy , 2009, NeuroImage.

[88]  Hasan Ayaz,et al.  Multisubject “Learning” for Mental Workload Classification Using Concurrent EEG, fNIRS, and Physiological Measures , 2017, Front. Hum. Neurosci..

[89]  Sergio Fantini,et al.  Cerebral Autoregulation in the Microvasculature Measured with Near-Infrared Spectroscopy , 2015, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[90]  Keum-Shik Hong,et al.  Noise reduction in functional near-infrared spectroscopy signals by independent component analysis. , 2013, The Review of scientific instruments.

[91]  Yingchun Zhang,et al.  Enhancing Performance of a Hybrid EEG-fNIRS System Using Channel Selection and Early Temporal Features , 2017, Front. Hum. Neurosci..