Using the General Linear Model to Improve Performance in fNIRS Single Trial Analysis and Classification: A Perspective

Within a decade, single trial analysis of functional Near Infrared Spectroscopy (fNIRS) signals has gained significant momentum, and fNIRS joined the set of modalities frequently used for active and passive Brain Computer Interfaces (BCI). A great variety of methods for feature extraction and classification have been explored using state-of-the-art Machine Learning methods. In contrast, signal preprocessing and cleaning pipelines for fNIRS often follow simple recipes and so far rarely incorporate the available state-of-the-art in adjacent fields. In neuroscience, where fMRI and fNIRS are established neuroimaging tools, evoked hemodynamic brain activity is typically estimated across multiple trials using a General Linear Model (GLM). With the help of the GLM, subject, channel, and task specific evoked hemodynamic responses are estimated, and the evoked brain activity is more robustly separated from systemic physiological interference using independent measures of nuisance regressors, such as short-separation fNIRS measurements. When correctly applied in single trial analysis, e.g., in BCI, this approach can significantly enhance contrast to noise ratio of the brain signal, improve feature separability and ultimately lead to better classification accuracy. In this manuscript, we provide a brief introduction into the GLM and show how to incorporate it into a typical BCI preprocessing pipeline and cross-validation. Using a resting state fNIRS data set augmented with synthetic hemodynamic responses that provide ground truth brain activity, we compare the quality of commonly used fNIRS features for BCI that are extracted from (1) conventionally preprocessed signals, and (2) signals preprocessed with the GLM and physiological nuisance regressors. We show that the GLM-based approach can provide better single trial estimates of brain activity as well as a new feature type, i.e., the weight of the individual and channel-specific hemodynamic response function (HRF) regressor. The improved estimates yield features with higher separability, that significantly enhance accuracy in a binary classification task when compared to conventional preprocessing—on average +7.4% across subjects and feature types. We propose to adapt this well-established approach from neuroscience to the domain of single-trial analysis and preprocessing wherever the classification of evoked brain activity is of concern, for instance in BCI.

[1]  Keum-Shik Hong,et al.  fNIRS-based brain-computer interfaces: a review , 2015, Front. Hum. Neurosci..

[2]  David A. Boas,et al.  Twenty years of functional near-infrared spectroscopy: introduction for the special issue , 2014, NeuroImage.

[3]  José del R. Millán,et al.  Brain-Computer Interfaces , 2020, Handbook of Clinical Neurology.

[4]  Fabien Lotte,et al.  Brain-Computer Interfaces: Beyond Medical Applications , 2012, Computer.

[5]  R. Saager,et al.  Measurement of layer-like hemodynamic trends in scalp and cortex: implications for physiological baseline suppression in functional near-infrared spectroscopy. , 2008, Journal of biomedical optics.

[6]  David A. Boas,et al.  Improved physiological noise regression in fNIRS: A multimodal extension of the General Linear Model using temporally embedded Canonical Correlation Analysis , 2019, NeuroImage.

[7]  G Pfurtscheller,et al.  EEG-based communication: improved accuracy by response verification. , 1998, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[8]  G. Dumont,et al.  Wavelet based motion artifact removal for Functional Near Infrared Spectroscopy , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[9]  Noman Naseer,et al.  Enhancing Classification Performance of Functional Near-Infrared Spectroscopy- Brain–Computer Interface Using Adaptive Estimation of General Linear Model Coefficients , 2017, Front. Neurorobot..

[10]  Christa Neuper,et al.  Focal frontal (de)oxyhemoglobin responses during simple arithmetic. , 2010, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[11]  Olivier Ledoit,et al.  A well-conditioned estimator for large-dimensional covariance matrices , 2004 .

[12]  S. Arridge,et al.  Estimation of optical pathlength through tissue from direct time of flight measurement , 1988 .

[13]  H. Flor,et al.  A spelling device for the paralysed , 1999, Nature.

[14]  Raja Parasuraman,et al.  Neuroergonomics: Research and practice , 2003 .

[15]  Martin Wolf,et al.  A review on continuous wave functional near-infrared spectroscopy and imaging instrumentation and methodology , 2014, NeuroImage.

[16]  S. Mallat A wavelet tour of signal processing , 1998 .

[17]  Stefan Haufe,et al.  Electrophysiology-based detection of emergency braking intention in real-world driving , 2014, Journal of neural engineering.

[18]  R Grebe,et al.  Toward a fully integrated wireless wearable EEG-NIRS bimodal acquisition system , 2013, Journal of neural engineering.

[19]  Klaus-Robert Müller,et al.  A regularized discriminative framework for EEG analysis with application to brain–computer interface , 2010, NeuroImage.

[20]  Julien Cohen-Adad,et al.  Activation detection in diffuse optical imaging by means of the general linear model , 2007, Medical Image Anal..

[21]  G. Pfurtscheller,et al.  Elimination von Atmungseffekten auf bewegungsinduzierte Änderungen der Herzrate - Elimination of Respiratory Effects on Movement-induced Cardiac Response , 1997 .

[22]  Mohamad Sawan,et al.  Multichannel wearable fNIRS‐EEG system for long‐term clinical monitoring , 2018, Human brain mapping.

[23]  Stefan Haufe,et al.  The Berlin Brain–Computer Interface: Non-Medical Uses of BCI Technology , 2010, Front. Neurosci..

[24]  Karl J. Friston,et al.  Statistical parametric maps in functional imaging: A general linear approach , 1994 .

[25]  P. H. Koh,et al.  Functional optical topography analysis using Statistical Parametric Mapping (SPM) methodology with and without physiological confounds , 2010, Advances in experimental medicine and biology.

[26]  David A. Boas,et al.  A temporal comparison of BOLD, ASL, and NIRS hemodynamic responses to motor stimuli in adult humans , 2006, NeuroImage.

[27]  Meryem A Yücel,et al.  Short separation regression improves statistical significance and better localizes the hemodynamic response obtained by near-infrared spectroscopy for tasks with differing autonomic responses , 2015, Neurophotonics.

[28]  Anders M. Dale,et al.  Diffuse optical imaging of brain activation: approaches to optimizing image sensitivity, resolution, and accuracy , 2004, NeuroImage.

[29]  Felix Scholkmann,et al.  Signal Processing in Functional Near-Infrared Spectroscopy (fNIRS): Methodological Differences Lead to Different Statistical Results , 2018, Front. Hum. Neurosci..

[30]  W. Heisenberg,et al.  Psoriasis - a review of recent progress, characteristics, diagnostic management , 2022, Journal of Education, Health and Sport.

[31]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[32]  MERYEM A. YÜCEL,et al.  TARGETED PRINCIPLE COMPONENT ANALYSIS: A NEW MOTION ARTIFACT CORRECTION APPROACH FOR NEAR-INFRARED SPECTROSCOPY , 2013, Journal of innovative optical health sciences.

[33]  K.-R. Muller,et al.  Optimizing Spatial filters for Robust EEG Single-Trial Analysis , 2008, IEEE Signal Processing Magazine.

[34]  Keum-Shik Hong,et al.  Feature Extraction and Classification Methods for Hybrid fNIRS-EEG Brain-Computer Interfaces , 2018, Front. Hum. Neurosci..

[35]  Klaus-Robert Müller,et al.  Machine learning for real-time single-trial EEG-analysis: From brain–computer interfacing to mental state monitoring , 2008, Journal of Neuroscience Methods.

[36]  Emery N Brown,et al.  Adaptive filtering for global interference cancellation and real-time recovery of evoked brain activity: a Monte Carlo simulation study. , 2007, Journal of biomedical optics.

[37]  D. Delpy,et al.  Oscillations in cerebral haemodynamics. Implications for functional activation studies. , 1999, Advances in experimental medicine and biology.

[38]  A. Villringer,et al.  Non-invasive optical spectroscopy and imaging of human brain function , 1997, Trends in Neurosciences.

[39]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[40]  D. Boas,et al.  HomER: a review of time-series analysis methods for near-infrared spectroscopy of the brain. , 2009, Applied optics.

[41]  David A. Boas,et al.  A Systematic Comparison of Motion Artifact Correction Techniques for Functional Near-Infrared Spectroscopy , 2012, Front. Neurosci..

[42]  Glenn F. Wilson,et al.  Putting the Brain to Work: Neuroergonomics Past, Present, and Future , 2008, Hum. Factors.

[43]  Robert J Cooper,et al.  Review of recent progress toward a fiberless, whole-scalp diffuse optical tomography system , 2017, Neurophotonics.

[44]  Christian Kothe,et al.  Towards passive brain–computer interfaces: applying brain–computer interface technology to human–machine systems in general , 2011, Journal of neural engineering.

[45]  C. Markham,et al.  Hemodynamics for Brain-Computer Interfaces , 2008, IEEE Signal Processing Magazine.

[46]  Lucas C. Parra,et al.  Recipes for the linear analysis of EEG , 2005, NeuroImage.

[47]  Hasan Ayaz,et al.  Optical brain monitoring for operator training and mental workload assessment , 2012, NeuroImage.

[48]  Marco Ferrari,et al.  A brief review on the history of human functional near-infrared spectroscopy (fNIRS) development and fields of application , 2012, NeuroImage.

[49]  David A. Boas,et al.  Improved recovery of the hemodynamic response in diffuse optical imaging using short optode separations and state-space modeling , 2011, NeuroImage.

[50]  K. Jellinger Toward Brain-Computer Interfacing , 2009 .

[51]  Theodore J. Huppert,et al.  Real-time imaging of human brain function by near-infrared spectroscopy using an adaptive general linear model , 2009, NeuroImage.

[52]  Stefan Haufe,et al.  Single-trial analysis and classification of ERP components — A tutorial , 2011, NeuroImage.

[53]  Meryem A Yücel,et al.  Functional Near Infrared Spectroscopy: Enabling Routine Functional Brain Imaging. , 2017, Current opinion in biomedical engineering.

[54]  David A. Boas,et al.  Motion artifacts in functional near-infrared spectroscopy: A comparison of motion correction techniques applied to real cognitive data , 2014, NeuroImage.

[55]  Keum Shik Hong,et al.  Hybrid Brain–Computer Interface Techniques for Improved Classification Accuracy and Increased Number of Commands: A Review , 2017, Front. Neurorobot..

[56]  M Wolf,et al.  How to detect and reduce movement artifacts in near-infrared imaging using moving standard deviation and spline interpolation , 2010, Physiological measurement.

[57]  Klaus-Robert Müller,et al.  Classifying Single Trial EEG: Towards Brain Computer Interfacing , 2001, NIPS.

[58]  J. Culver,et al.  Brain Specificity of Diffuse Optical Imaging: Improvements from Superficial Signal Regression and Tomography , 2010, Front. Neuroenerg..

[59]  Dominic Heger,et al.  Toward a Wireless Open Source Instrument: Functional Near-infrared Spectroscopy in Mobile Neuroergonomics and BCI Applications , 2015, Front. Hum. Neurosci..

[60]  Jinung An,et al.  Classification of frontal cortex haemodynamic responses during cognitive tasks using wavelet transforms and machine learning algorithms. , 2012, Medical engineering & physics.

[61]  Klaus-Robert Müller,et al.  A new blind source separation framework for signal analysis and artifact rejection in functional Near-Infrared Spectroscopy , 2019, NeuroImage.

[62]  Xu Cui,et al.  Functional near infrared spectroscopy (NIRS) signal improvement based on negative correlation between oxygenated and deoxygenated hemoglobin dynamics , 2010, NeuroImage.

[63]  Gerald Appel,et al.  Technical Analysis: Power Tools for Active Investors , 2005 .

[64]  Heidrun Wabnitz,et al.  M3BA: A Mobile, Modular, Multimodal Biosignal Acquisition Architecture for Miniaturized EEG-NIRS-Based Hybrid BCI and Monitoring , 2017, IEEE Transactions on Biomedical Engineering.

[65]  Keum-Shik Hong,et al.  Kalman estimator- and general linear model-based on-line brain activation mapping by near-infrared spectroscopy , 2010, Biomedical engineering online.

[66]  A. Kleinschmidt,et al.  Simultaneous Recording of Cerebral Blood Oxygenation Changes during Human Brain Activation by Magnetic Resonance Imaging and Near-Infrared Spectroscopy , 1996, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[67]  David A. Boas,et al.  A spatial-temporal comparison of fMRI and NIRS hemodynamic responses to motor stimuli in adult humans , 2005, SPIE BiOS.

[68]  Meryem A Yücel,et al.  Mayer waves reduce the accuracy of estimated hemodynamic response functions in functional near-infrared spectroscopy. , 2016, Biomedical optics express.

[69]  D. Delpy,et al.  Oscillations in Cerebral Haemodynamics , 1999 .

[70]  Klaus-Robert Müller,et al.  Introduction to machine learning for brain imaging , 2011, NeuroImage.

[71]  Stefan Haufe,et al.  The Berlin Brain-Computer Interface: Progress Beyond Communication and Control , 2016, Front. Neurosci..

[72]  David A. Boas,et al.  Dynamic physiological modeling for functional diffuse optical tomography , 2006, NeuroImage.

[73]  R W Cox,et al.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. , 1996, Computers and biomedical research, an international journal.

[74]  N. Huang,et al.  The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[75]  Hongyi Li,et al.  NIRS-based classification of clench force and speed motor imagery with the use of empirical mode decomposition for BCI. , 2015, Medical engineering & physics.