fNIRS-QC: Crowd-Sourced Creation of a Dataset and Machine Learning Model for fNIRS Quality Control

Despite technological advancements in functional Near Infra-Red Spectroscopy (fNIRS) and a rise in the application of the fNIRS in neuroscience experimental designs, the processing of fNIRS data remains characterized by a high number of heterogeneous approaches, implicating the scientific reproducibility and interpretability of the results. For example, a manual inspection is still necessary to assess the quality and subsequent retention of collected fNIRS signals for analysis. Machine Learning (ML) approaches are well-positioned to provide a unique contribution to fNIRS data processing by automating and standardizing methodological approaches for quality control, where ML models can produce objective and reproducible results. However, any successful ML application is grounded in a high-quality dataset of labeled training data, and unfortunately, no such dataset is currently available for fNIRS signals. In this work, we introduce fNIRS-QC, a platform designed for the crowd-sourced creation of a quality control fNIRS dataset. In particular, we (a) composed a dataset of 4385 fNIRS signals; (b) created a web interface to allow multiple users to manually label the signal quality of 510 10 s fNIRS segments. Finally, (c) a subset of the labeled dataset is used to develop a proof-of-concept ML model to automatically assess the quality of fNIRS signals. The developed ML models can serve as a more objective and efficient quality control check that minimizes error from manual inspection and the need for expertise with signal quality control.

[1]  M. Beauchamp,et al.  Auditory cortex activation to natural speech and simulated cochlear implant speech measured with functional near-infrared spectroscopy , 2014, Hearing Research.

[2]  D. Chicco,et al.  The advantages of the Matthews correlation coefficient (MCC) over F1 score and accuracy in binary classification evaluation , 2020, BMC Genomics.

[3]  Lia Maria Hocke,et al.  Automated Processing of fNIRS Data—A Visual Guide to the Pitfalls and Consequences , 2018, Algorithms.

[4]  Bryan Reimer,et al.  Unsupervised fNIRS feature extraction with CAE and ESN autoencoder for driver cognitive load classification , 2020, Journal of neural engineering.

[5]  Naser Hakimi,et al.  fNIRS signal quality estimation by means of a machine learning algorithm trained on morphological and temporal features , 2021, BiOS.

[6]  M. Bornstein,et al.  Parenting Stress Undermines Mother-Child Brain-to-Brain Synchrony: A Hyperscanning Study , 2019, Scientific Reports.

[7]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[8]  Gaël Varoquaux,et al.  The NumPy Array: A Structure for Efficient Numerical Computation , 2011, Computing in Science & Engineering.

[9]  Sailing He,et al.  fNIRS Signal Classification Based on Deep Learning in Rock-Paper-Scissors Imagery Task , 2021 .

[10]  Giulio Gabrieli,et al.  A Machine Learning Approach for the Automatic Estimation of Fixation-Time Data Signals’ Quality , 2020, Sensors.

[11]  M. Bornstein,et al.  Physical presence of spouse enhances brain-to-brain synchrony in co-parenting couples , 2020, Scientific Reports.

[12]  J. Hirsch,et al.  The present and future use of functional near‐infrared spectroscopy (fNIRS) for cognitive neuroscience , 2018, Annals of the New York Academy of Sciences.

[13]  M. Bornstein,et al.  A decade of infant neuroimaging research: What have we learned and where are we going? , 2019, Infant behavior & development.

[14]  G. Esposito,et al.  Deep Neural Networks and Transfer Learning on a Multivariate Physiological Signal Dataset , 2021, Bioengineering.

[15]  Pierre Baldi,et al.  Assessing the accuracy of prediction algorithms for classification: an overview , 2000, Bioinform..

[16]  Stan Szpakowicz,et al.  Beyond Accuracy, F-Score and ROC: A Family of Discriminant Measures for Performance Evaluation , 2006, Australian Conference on Artificial Intelligence.

[17]  Jan Gorodkin,et al.  Comparing two K-category assignments by a K-category correlation coefficient , 2004, Comput. Biol. Chem..

[18]  S.C. Strother,et al.  Evaluating fMRI preprocessing pipelines , 2006, IEEE Engineering in Medicine and Biology Magazine.

[19]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[20]  Luca Pollonini,et al.  PHOEBE: a method for real time mapping of optodes-scalp coupling in functional near-infrared spectroscopy. , 2016, Biomedical optics express.

[21]  Q Li,et al.  Dynamic time warping and machine learning for signal quality assessment of pulsatile signals , 2012, Physiological measurement.

[22]  M. Bornstein,et al.  Are Cry Studies Replicable? An Analysis of Participants, Procedures, and Methods Adopted and Reported in Studies of Infant Cries , 2019 .

[23]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[24]  Russell A. Poldrack,et al.  Guidelines for reporting an fMRI study , 2008, NeuroImage.

[25]  A. Faisal,et al.  Deep learning multimodal fNIRS and EEG signals for bimanual grip force decoding , 2021, Journal of neural engineering.

[26]  G. Esposito,et al.  Father-child dyads exhibit unique inter-subject synchronization during co-viewing of animation video stimuli , 2021, Social neuroscience.

[27]  G. Esposito,et al.  Viewing Romantic and Friendship Interactions Activate Prefrontal Regions in Persons With High Openness Personality Trait , 2020, Frontiers in Psychology.

[28]  Alessandro Torricelli,et al.  Best practices for fNIRS publications , 2021, Neurophotonics.

[29]  Mohamed Bekkar,et al.  Evaluation Measures for Models Assessment over Imbalanced Data Sets , 2013 .

[30]  Gari D. Clifford,et al.  A machine learning approach to multi-level ECG signal quality classification , 2014, Comput. Methods Programs Biomed..

[31]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[32]  Naser Hakimi,et al.  Signal quality index: an algorithm for quantitative assessment of functional near infrared spectroscopy signal quality. , 2020, Biomedical optics express.

[33]  Cesare Furlanello,et al.  Comparison of Wearable and Clinical Devices for Acquisition of Peripheral Nervous System Signals , 2020, Sensors.