A Motion Artifact Correction Procedure for fNIRS Signals Based on Wavelet Transform and Infrared Thermography Video Tracking

Functional near infrared spectroscopy (fNIRS) is a neuroimaging technique that allows to monitor the functional hemoglobin oscillations related to cortical activity. One of the main issues related to fNIRS applications is the motion artefact removal, since a corrupted physiological signal is not correctly indicative of the underlying biological process. A novel procedure for motion artifact correction for fNIRS signals based on wavelet transform and video tracking developed for infrared thermography (IRT) is presented. In detail, fNIRS and IRT were concurrently recorded and the optodes’ movement was estimated employing a video tracking procedure developed for IRT recordings. The wavelet transform of the fNIRS signal and of the optodes’ movement, together with their wavelet coherence, were computed. Then, the inverse wavelet transform was evaluated for the fNIRS signal excluding the frequency content corresponding to the optdes’ movement and to the coherence in the epochs where they were higher with respect to an established threshold. The method was tested using simulated functional hemodynamic responses added to real resting-state fNIRS recordings corrupted by movement artifacts. The results demonstrated the effectiveness of the procedure in eliminating noise, producing results with higher signal to noise ratio with respect to another validated method.

[1]  Arcangelo Merla,et al.  Can Functional Infrared Thermal Imaging Estimate Mental Workload in Drivers as Evaluated by Sample Entropy of the fNIRS Signal? , 2020 .

[2]  Tania S. Douglas,et al.  Motion Artifact Removal for Functional Near Infrared Spectroscopy: A Comparison of Methods , 2010, IEEE Transactions on Biomedical Engineering.

[3]  Arcangelo Merla,et al.  Driver Stress State Evaluation by Means of Thermal Imaging: A Supervised Machine Learning Approach Based on ECG Signal , 2020, Applied Sciences.

[4]  Theerawit Wilaiprasitporn,et al.  Consumer Grade EEG Measuring Sensors as Research Tools: A Review , 2020, IEEE Sensors Journal.

[5]  Dean C. Hay,et al.  Quantitative feature analysis of continuous analytic wavelet transforms of electrocardiography and electromyography , 2018, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[6]  Lawrence B. Wolff,et al.  Tracking human faces in infrared video , 2003, Image Vis. Comput..

[7]  S. Brigadoi,et al.  Accurate hemodynamic response estimation by removal of stimulus-evoked superficial response in fNIRS signals , 2021, Journal of neural engineering.

[8]  Karl J. Friston,et al.  Statistical parametric maps in functional imaging: A general linear approach , 1994 .

[9]  Filippo Zappasodi,et al.  Fiberless, Multi-Channel fNIRS-EEG System Based on Silicon Photomultipliers: Towards Sensitive and Ecological Mapping of Brain Activity and Neurovascular Coupling † , 2020, Sensors.

[10]  Riad I. Hammoud,et al.  Thermal-Visible Video Fusion for Moving Target Tracking and Pedestrian Classification , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  F. Scholkmann,et al.  Individual Differences in Hemodynamic Responses Measured on the Head Due to a Long-Term Stimulation Involving Colored Light Exposure and a Cognitive Task: A SPA-fNIRS Study , 2021, Brain sciences.

[12]  Lalat Indu Giri,et al.  Human respiration monitoring using infrared thermography and artificial intelligence , 2020, Biomedical physics & engineering express.

[13]  Can Zhang,et al.  Automatic visible and infrared face registration based on silhouette matching and robust transformation estimation , 2015 .

[14]  Martin M. Monti,et al.  Human Neuroscience , 2022 .

[15]  P. Burt Fast filter transform for image processing , 1981 .

[16]  Liya Thomas,et al.  Functional Near-Infrared Spectroscopy (fNIRS) in Neuroergonomics , 2020, Neuroergonomics.

[17]  Jiang-tao Wang,et al.  On pedestrian detection and tracking in infrared videos , 2012, Pattern Recognit. Lett..

[18]  Filippo Zappasodi,et al.  Working Memory Decline in Alzheimer’s Disease Is Detected by Complexity Analysis of Multimodal EEG-fNIRS , 2020, Entropy.

[19]  Arun Ross,et al.  Matching thermal to visible face images using hidden factor analysis in a cascaded subspace learning framework , 2016, Pattern Recognit. Lett..

[20]  Lionel Tarassenko,et al.  Non-Contact Assessment of Peripheral Artery Haemodynamics Using Infrared Video Thermography , 2020, IEEE Transactions on Biomedical Engineering.

[21]  David A. Boas,et al.  Motion artifacts in functional near-infrared spectroscopy: A comparison of motion correction techniques applied to real cognitive data , 2014, NeuroImage.

[22]  Ji Zhao,et al.  Non-rigid visible and infrared face registration via regularized Gaussian fields criterion , 2015, Pattern Recognit..

[23]  Abd-Krim Seghouane,et al.  Motion Artefact Removal in Functional Near-infrared Spectroscopy Signals Based on Robust Estimation , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[24]  M Wolf,et al.  How to detect and reduce movement artifacts in near-infrared imaging using moving standard deviation and spline interpolation , 2010, Physiological measurement.

[25]  J. Hirsch,et al.  The present and future use of functional near‐infrared spectroscopy (fNIRS) for cognitive neuroscience , 2018, Annals of the New York Academy of Sciences.

[26]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[27]  Ilias Tachtsidis,et al.  False positives and false negatives in functional near-infrared spectroscopy: issues, challenges, and the way forward , 2016, Neurophotonics.

[28]  Juha Virtanen,et al.  Accelerometer-based method for correcting signal baseline changes caused by motion artifacts in medical near-infrared spectroscopy. , 2011, Journal of biomedical optics.

[29]  David A. Boas,et al.  Improved physiological noise regression in fNIRS: A multimodal extension of the General Linear Model using temporally embedded Canonical Correlation Analysis , 2019, NeuroImage.

[30]  Ioannis T. Pavlidis,et al.  Coalitional tracking , 2007, Comput. Vis. Image Underst..

[31]  David A. Boas,et al.  Further improvement in reducing superficial contamination in NIRS using double short separation measurements , 2014, NeuroImage.

[32]  Peter Robinson,et al.  OpenFace: An open source facial behavior analysis toolkit , 2016, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV).

[33]  Xu Cui,et al.  Sensitivity of fNIRS measurement to head motion: An applied use of smartphones in the lab , 2015, Journal of Neuroscience Methods.

[34]  Yan Zhou,et al.  Spatiotemporal Smoothing as a Basis for Facial Tissue Tracking in Thermal Imaging , 2013, IEEE Transactions on Biomedical Engineering.

[35]  David A Boas,et al.  Eigenvector-based spatial filtering for reduction of physiological interference in diffuse optical imaging. , 2005, Journal of biomedical optics.

[36]  M. Ferrari,et al.  A Mini-Review on Functional Near-Infrared Spectroscopy (fNIRS): Where Do We Stand, and Where Should We Go? , 2019, Photonics.

[37]  Sungho Tak,et al.  NIRS-SPM: Statistical parametric mapping for near-infrared spectroscopy , 2009, NeuroImage.

[38]  Roozbeh Atri,et al.  Movement artefact removal from NIRS signal using multi-channel IMU data , 2018, Biomedical engineering online.

[39]  Martin Wolf,et al.  A New Approach for Automatic Removal of Movement Artifacts in Near-Infrared Spectroscopy Time Series by Means of Acceleration Data , 2015, Algorithms.

[40]  Arcangelo Merla,et al.  Automated warping procedure for facial thermal imaging based on features identification in the visible domain , 2020 .

[41]  Julian F. Thayer,et al.  Central and autonomic nervous system integration in emotion , 2003, Brain and Cognition.

[42]  Roozbeh Atri,et al.  Sensor Fusion in Human Cyber Sensor System for Motion Artifact Removal from NIRS Signal , 2019, 2019 12th International Conference on Human System Interaction (HSI).

[43]  Guangtao Zhai,et al.  Detection of Respiratory Infections Using RGB-Infrared Sensors on Portable Device , 2020, IEEE Sensors Journal.

[44]  Arcangelo Merla,et al.  Assessment of the Autonomic Response in Alzheimer's Patients During the Execution of Memory Tasks: A Functional Thermal Imaging Study. , 2018, Current Alzheimer research.

[45]  Ilias Tachtsidis,et al.  A Review on the Use of Wearable Functional Near-Infrared Spectroscopy in Naturalistic Environments. , 2018, The Japanese psychological research.

[46]  Ricardo Vardasca,et al.  Biomedical Applications of Infrared Thermal Imaging: Current State of Machine Learning Classification , 2019, Proceedings.

[47]  G. Dumont,et al.  Wavelet based motion artifact removal for Functional Near Infrared Spectroscopy , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[48]  MERYEM A. YÜCEL,et al.  TARGETED PRINCIPLE COMPONENT ANALYSIS: A NEW MOTION ARTIFACT CORRECTION APPROACH FOR NEAR-INFRARED SPECTROSCOPY , 2013, Journal of innovative optical health sciences.

[49]  Lalat Indu Giri,et al.  Non-contact monitoring of human respiration using infrared thermography and machine learning , 2020 .

[50]  M. Eysenck,et al.  Anxiety and cognitive performance: attentional control theory. , 2007, Emotion.

[51]  Kantilal P Rane,et al.  Design and Development of Low Cost Humanoid Robot with Thermal Temperature Scanner for COVID-19 Virus Preliminary Identification , 2020, International Journal of Advanced Trends in Computer Science and Engineering.

[52]  T. Chau,et al.  Infrared thermography as an access pathway for individuals with severe motor impairments , 2009, Journal of NeuroEngineering and Rehabilitation.

[53]  Douglas Lyon,et al.  The Discrete Fourier Transform, Part 6: Cross-Correlation , 2010, J. Object Technol..

[54]  Arcangelo Merla,et al.  Simultaneous fNIRS and thermal infrared imaging during cognitive task reveal autonomic correlates of prefrontal cortex activity , 2015, Scientific Reports.

[55]  Kang Ryoung Park,et al.  Robust Pedestrian Detection by Combining Visible and Thermal Infrared Cameras , 2015, Sensors.

[56]  Clare E Elwell,et al.  Automatic detection of motion artifacts in infant functional optical topography studies. , 2010, Advances in experimental medicine and biology.

[57]  Meltem Izzetoglu,et al.  Motion artifact cancellation in NIR spectroscopy using discrete Kalman filtering , 2010, Biomedical engineering online.

[58]  Kristof Van Laerhoven,et al.  Wearables and the Brain , 2019, IEEE Pervasive Computing.

[59]  Guangtao Zhai,et al.  Portable Health Screening Device of Respiratory Infections , 2020, 2020 IEEE International Conference on Multimedia & Expo Workshops (ICMEW).

[60]  Marco Ferrari,et al.  A brief review on the history of human functional near-infrared spectroscopy (fNIRS) development and fields of application , 2012, NeuroImage.

[61]  S. Yusuf,et al.  Evaluation risk of diabetic foot ulcers (DFUs) using infrared thermography based on mobile phone as advanced risk assessment tool in the community setting: A multisite cross-sectional study. , 2020, Enfermeria clinica.

[62]  F. Scholkmann,et al.  Color-dependent changes in humans during a verbal fluency task under colored light exposure assessed by SPA-fNIRS , 2021, Scientific Reports.

[63]  Xu Cui,et al.  Functional near infrared spectroscopy (NIRS) signal improvement based on negative correlation between oxygenated and deoxygenated hemoglobin dynamics , 2010, NeuroImage.

[64]  David A. Boas,et al.  A Systematic Comparison of Motion Artifact Correction Techniques for Functional Near-Infrared Spectroscopy , 2012, Front. Neurosci..

[65]  Jiayi Ma,et al.  Infrared and visible image fusion methods and applications: A survey , 2018, Inf. Fusion.