Dynamic time warping-based averaging framework for functional near-infrared spectroscopy brain imaging studies

Abstract. We investigate the problem related to the averaging procedure in functional near-infrared spectroscopy (fNIRS) brain imaging studies. Typically, to reduce noise and to empower the signal strength associated with task-induced activities, recorded signals (e.g., in response to repeated stimuli or from a group of individuals) are averaged through a point-by-point conventional averaging technique. However, due to the existence of variable latencies in recorded activities, the use of the conventional averaging technique can lead to inaccuracies and loss of information in the averaged signal, which may result in inaccurate conclusions about the functionality of the brain. To improve the averaging accuracy in the presence of variable latencies, we present an averaging framework that employs dynamic time warping (DTW) to account for the temporal variation in the alignment of fNIRS signals to be averaged. As a proof of concept, we focus on the problem of localizing task-induced active brain regions. The framework is extensively tested on experimental data (obtained from both block design and event-related design experiments) as well as on simulated data. In all cases, it is shown that the DTW-based averaging technique outperforms the conventional-based averaging technique in estimating the location of task-induced active regions in the brain, suggesting that such advanced averaging methods should be employed in fNIRS brain imaging studies.

[1]  M. D’Esposito,et al.  The variability of human BOLD hemodynamic responses , 1998, NeuroImage.

[2]  Gary H. Glover,et al.  A quantitative comparison of NIRS and fMRI across multiple cognitive tasks , 2011, NeuroImage.

[3]  Laleh Najafizadeh,et al.  Capturing dynamic patterns of task-based functional connectivity with EEG , 2013, NeuroImage.

[4]  Toni Giorgino,et al.  Computing and Visualizing Dynamic Time Warping Alignments in R: The dtw Package , 2009 .

[5]  M. Beauchamp,et al.  Auditory cortex activation to natural speech and simulated cochlear implant speech measured with functional near-infrared spectroscopy , 2014, Hearing Research.

[6]  David A Boas,et al.  Eigenvector-based spatial filtering for reduction of physiological interference in diffuse optical imaging. , 2005, Journal of biomedical optics.

[7]  T. Ono,et al.  Selective Medial Prefrontal Cortex Responses During Live Mutual Gaze Interactions in Human Infants: An fNIRS Study , 2015, Brain Topography.

[8]  Shohei Tanaka,et al.  Reduced Prefrontal Cortex Hemodynamic Response in Adults with Methamphetamine Induced Psychosis: Relevance for Impulsivity , 2016, PloS one.

[9]  R. Grebe,et al.  Coupled oxygenation oscillation measured by NIRS and intermittent cerebral activation on EEG in premature infants , 2007, NeuroImage.

[10]  R. Turner,et al.  Detecting Latency Differences in Event-Related BOLD Responses: Application to Words versus Nonwords and Initial versus Repeated Face Presentations , 2002, NeuroImage.

[11]  Laleh Najafizadeh,et al.  On the Relationship Between Trial-to-Trial Response Time Variability and fNIRS-Based Functional Connectivity , 2016 .

[12]  Jichai Jeong,et al.  Multiclass classification of hemodynamic responses for performance improvement of functional near-infrared spectroscopy-based brain–computer interface , 2014, Journal of biomedical optics.

[13]  Linda G. Shapiro,et al.  Detection of neural activity in event-related fMRI using wavelets and dynamic time warping , 2003, SPIE Optics + Photonics.

[14]  Pierre Gançarski,et al.  A global averaging method for dynamic time warping, with applications to clustering , 2011, Pattern Recognit..

[15]  Yong He,et al.  BrainNet Viewer: A Network Visualization Tool for Human Brain Connectomics , 2013, PloS one.

[16]  Kynan Eng,et al.  Trial-to-trial variability differentiates motor imagery during observation between low versus high responders: A functional near-infrared spectroscopy study , 2012, Behavioural Brain Research.

[17]  Bharat B. Biswal,et al.  Detecting resting-state functional connectivity in the language system using functional near-infrared spectroscopy. , 2010, Journal of biomedical optics.

[18]  A. Rosen,et al.  A portable near infrared spectroscopy system for bedside monitoring of newborn brain , 2005, Biomedical engineering online.

[19]  Marc M. van Wanrooij,et al.  Temporal Cortex Activation to Audiovisual Speech in Normal-Hearing and Cochlear Implant Users Measured with Functional Near-Infrared Spectroscopy , 2016, Front. Hum. Neurosci..

[20]  D. Boas,et al.  Resting state functional connectivity of the whole head with near-infrared spectroscopy , 2010, Biomedical optics express.

[21]  M. Ferrari,et al.  Principles, techniques, and limitations of near infrared spectroscopy. , 2004, Canadian journal of applied physiology = Revue canadienne de physiologie appliquee.

[22]  Gordon Morison,et al.  Using Functional Near Infrared Spectroscopy (fNIRS) to Study Dynamic Stereoscopic Depth Perception , 2016, Brain Topography.

[23]  Zsolt Miklós Kovács-Vajna,et al.  A Fingerprint Verification System Based on Triangular Matching and Dynamic Time Warping , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  George M. Church,et al.  Aligning gene expression time series with time warping algorithms , 2001, Bioinform..

[25]  Eamonn J. Keogh,et al.  Scaling up dynamic time warping for datamining applications , 2000, KDD '00.

[26]  Chang-Hwan Im,et al.  Toward more intuitive brain–computer interfacing: classification of binary covert intentions using functional near-infrared spectroscopy , 2016, Journal of biomedical optics.

[27]  R. Coppola,et al.  Physiological characteristics of capacity constraints in working memory as revealed by functional MRI. , 1999, Cerebral cortex.

[28]  Fumitaka Homae,et al.  General to specific development of functional activation in the cerebral cortexes of 2- to 3-month-old infants , 2010, NeuroImage.

[29]  S. Bunce,et al.  Functional near-infrared neuroimaging , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[30]  J. VanMeter,et al.  Event-related fast optical signal in a rapid object recognition task: Improving detection by the independent component analysis , 2008, Brain Research.

[31]  V. Ramachandran,et al.  Paper Slow Echo: Facial Emg Evidence for the Delay of Spontaneous, but Not Voluntary, Emotional Mimicry in Children with Autism Spectrum Disorders , 2022 .

[32]  Marco Ferrari,et al.  Prefrontal Cortex Activation Upon a Demanding Virtual Hand-Controlled Task: A New Frontier for Neuroergonomics , 2016, Front. Hum. Neurosci..

[33]  L. Gupta,et al.  Nonlinear alignment and averaging for estimating the evoked potential , 1996, IEEE Transactions on Biomedical Engineering.

[34]  Chang-Hwan Im,et al.  Evaluation of various mental task combinations for near-infrared spectroscopy-based brain-computer interfaces , 2014, Journal of biomedical optics.

[35]  Victor Chernomordik,et al.  Prefrontal cortex hemodynamics and age: a pilot study using functional near infrared spectroscopy in children , 2014, Front. Neurosci..

[36]  Laleh Najafizadeh,et al.  Normative database of judgment of complexity task with functional near infrared spectroscopy—Application for TBI , 2012, NeuroImage.

[37]  Ulf Ahlstrom,et al.  Cognitive Workload and Learning Assessment During the Implementation of a Next-Generation Air Traffic Control Technology Using Functional Near-Infrared Spectroscopy , 2014, IEEE Transactions on Human-Machine Systems.

[38]  Ata Akin,et al.  Similarity analysis of functional connectivity with functional near-infrared spectroscopy , 2015, Journal of biomedical optics.

[39]  Laleh Najafizadeh,et al.  Towards Improving the``Detection" Power of Brain Imaging Experiments Using fNIRS , 2014 .

[40]  Marco Ferrari,et al.  A brief review on the history of human functional near-infrared spectroscopy (fNIRS) development and fields of application , 2012, NeuroImage.

[41]  G. Taga,et al.  Spatiotemporal properties of cortical haemodynamic response to auditory stimuli in sleeping infants revealed by multi-channel near-infrared spectroscopy , 2011, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[42]  J. Detre,et al.  Noninvasive Measurement of Cerebral Blood Flow and Blood Oxygenation Using Near-Infrared and Diffuse Correlation Spectroscopies in Critically Brain-Injured Adults , 2010, Neurocritical care.

[43]  Martin Wolf,et al.  Progress of near-infrared spectroscopy and topography for brain and muscle clinical applications. , 2007, Journal of biomedical optics.

[44]  Huafu Chen,et al.  Mapping the small-world properties of brain networks in deception with functional near-infrared spectroscopy , 2016, Scientific Reports.

[45]  David A. Boas,et al.  Probing the early development of visual working memory capacity with functional near-infrared spectroscopy , 2014, NeuroImage.

[46]  M. D’Esposito,et al.  The Variability of Human, BOLD Hemodynamic Responses , 1998, NeuroImage.

[47]  Kathryn M. McMillan,et al.  N‐back working memory paradigm: A meta‐analysis of normative functional neuroimaging studies , 2005, Human brain mapping.

[48]  Marco Ferrari,et al.  Detecting Mental Calculation Related Frontal Cortex Oxygenation Changes for Brain Computer Interface Using Multi-Channel Functional Near Infrared Topography , 2009 .

[49]  Yun Wei,et al.  Use of functional near-infrared spectroscopy to evaluate the effects of anodal transcranial direct current stimulation on brain connectivity in motor-related cortex , 2015, Journal of biomedical optics.

[50]  Raja Parasuraman,et al.  Enhancing dual-task performance with verbal and spatial working memory training: Continuous monitoring of cerebral hemodynamics with NIRS , 2014, NeuroImage.

[51]  Chang-Hwan Im,et al.  Hemodynamic responses in rat brain during transcranial direct current stimulation: a functional near-infrared spectroscopy study. , 2014, Biomedical optics express.

[52]  Tanja Schultz,et al.  Mental workload during n-back task—quantified in the prefrontal cortex using fNIRS , 2014, Front. Hum. Neurosci..

[53]  Hasan Ayaz,et al.  Cognitive Workload Assessment of Air Traffic Controllers Using Optical Brain Imaging Sensors , 2010 .

[54]  P. Goldman-Rakic,et al.  Prefrontal Activation Evoked by Infrequent Target and Novel Stimuli in a Visual Target Detection Task: An Event-Related Functional Magnetic Resonance Imaging Study , 2000, The Journal of Neuroscience.

[55]  Ali N. Akansu,et al.  Neural correlates of affective context in facial expression analysis: A simultaneous EEG-fNIRS study , 2015, 2015 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[56]  F. Jöbsis Noninvasive, infrared monitoring of cerebral and myocardial oxygen sufficiency and circulatory parameters. , 1977, Science.

[57]  Lalit R. Bahl,et al.  A Maximum Likelihood Approach to Continuous Speech Recognition , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[58]  Rieko Osu,et al.  Detecting event-related motor activity using functional near-infrared spectroscopy , 2013, 2013 6th International IEEE/EMBS Conference on Neural Engineering (NER).

[59]  Y. Kuroiwa,et al.  Effect of interstimulus interval on visual P300 in Parkinson’s disease , 1999, Journal of neurology, neurosurgery, and psychiatry.

[60]  Sungho Tak,et al.  Statistical analysis of fNIRS data: A comprehensive review , 2014, NeuroImage.

[61]  Geraldine Dawson,et al.  Event-related brain potentials reveal anomalies in temporal processing of faces in autism spectrum disorder. , 2004, Journal of child psychology and psychiatry, and allied disciplines.

[62]  Federico E. Turkheimer,et al.  Executive Functions and Prefrontal Cortex: A Matter of Persistence? , 2011, Front. Syst. Neurosci..

[63]  Tanja Schultz,et al.  Classification of mental tasks in the prefrontal cortex using fNIRS , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[64]  Phetsamone Vannasing,et al.  Language mapping in children using resting-state functional connectivity: comparison with a task-based approach , 2016, Journal of biomedical optics.

[65]  H. Tsunashima,et al.  Development of NIRS-BCI system using perceptron , 2012, 2012 12th International Conference on Control, Automation and Systems.

[66]  A. Corradini,et al.  Dynamic time warping for off-line recognition of a small gesture vocabulary , 2001, Proceedings IEEE ICCV Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems.

[67]  Teresa Wilcox,et al.  Hemodynamic changes in the infant cortex during the processing of featural and spatiotemporal information , 2009, Neuropsychologia.