Improving the Test-Retest Reliability of Resting State fMRI by Removing the Impact of Sleep

Resting state functional magnetic resonance imaging (rs-fMRI) provides a powerful tool to examine large-scale neural networks in the human brain and their disturbances in neuropsychiatric disorders. Thanks to its low demand and high tolerance, resting state paradigms can be easily acquired from clinical population. However, due to the unconstrained nature, resting state paradigm is associated with excessive head movement and proneness to sleep. Consequently, the test-retest reliability of rs-fMRI measures is moderate at best, falling short of widespread use in the clinic. Here, we characterized the effect of sleep on the test-retest reliability of rs-fMRI. Using measures of heart rate variability (HRV) derived from simultaneous electrocardiogram (ECG) recording, we identified portions of fMRI data when subjects were more alert or sleepy, and examined their effects on the test-retest reliability of functional connectivity measures. When volumes of sleep were excluded, the reliability of rs-fMRI is significantly improved, and the improvement appears to be general across brain networks. The amount of improvement is robust with the removal of as much as 60% volumes of sleepiness. Therefore, test-retest reliability of rs-fMRI is affected by sleep and could be improved by excluding volumes of sleepiness as indexed by HRV. Our results suggest a novel and practical method to improve test-retest reliability of rs-fMRI measures.

[1]  Garry Egger,et al.  Castaways , 2009 .

[2]  Marisa O. Hollinshead,et al.  The organization of the human cerebral cortex estimated by intrinsic functional connectivity. , 2011, Journal of neurophysiology.

[3]  M. Toichi,et al.  A new method of assessing cardiac autonomic function and its comparison with spectral analysis and coefficient of variation of R-R interval. , 1997, Journal of the autonomic nervous system.

[4]  A. Craig,et al.  A critical review of the psychophysiology of driver fatigue , 2001, Biological Psychology.

[5]  G. Borghini,et al.  Neuroscience and Biobehavioral Reviews , 2022 .

[6]  U. Rajendra Acharya,et al.  Heart rate variability: a review , 2006, Medical and Biological Engineering and Computing.

[7]  R. Cameron Craddock,et al.  A comprehensive assessment of regional variation in the impact of head micromovements on functional connectomics , 2013, NeuroImage.

[8]  Waleed Al-Nuaimy,et al.  Prediction of driver fatigue: Approaches and open challenges , 2014, 2014 14th UK Workshop on Computational Intelligence (UKCI).

[9]  O. Sporns,et al.  Complex brain networks: graph theoretical analysis of structural and functional systems , 2009, Nature Reviews Neuroscience.

[10]  Fenna M. Krienen,et al.  Opportunities and limitations of intrinsic functional connectivity MRI , 2013, Nature Neuroscience.

[11]  Satoru Miyauchi,et al.  Connectivity pattern changes in default-mode network with deep non-REM and REM sleep , 2011, Neuroscience Research.

[12]  Antonio Napolitano,et al.  Test-retest reliability of graph metrics of resting state MRI functional brain networks: A review , 2015, Journal of Neuroscience Methods.

[13]  A. Rechtschaffen,et al.  A manual of standardized terminology, technique and scoring system for sleep stages of human subjects , 1968 .

[14]  Andreas Heinz,et al.  Test–retest reliability of resting-state connectivity network characteristics using fMRI and graph theoretical measures , 2012, NeuroImage.

[15]  Tamara Vanderwal,et al.  Inscapes: A movie paradigm to improve compliance in functional magnetic resonance imaging , 2015, NeuroImage.

[16]  Yufeng Zang,et al.  DPABI: Data Processing & Analysis for (Resting-State) Brain Imaging , 2016, Neuroinformatics.

[17]  H. Laufs,et al.  Decoding Wakefulness Levels from Typical fMRI Resting-State Data Reveals Reliable Drifts between Wakefulness and Sleep , 2014, Neuron.

[18]  Karl J. Friston.  Functional and Effective Connectivity: A Review , 2011, Brain Connect..

[19]  Mary E. Meyerand,et al.  The effect of scan length on the reliability of resting-state fMRI connectivity estimates , 2013, NeuroImage.

[20]  Yu Wang,et al.  Test–Retest Reliability of Graph Metrics in High‐resolution Functional Connectomics: A Resting‐State Functional MRI Study , 2015, CNS neuroscience & therapeutics.

[21]  M. Raichle,et al.  Cortical network functional connectivity in the descent to sleep , 2009, Proceedings of the National Academy of Sciences.

[22]  Fabrice Bartolomei,et al.  Graph theoretical analysis of structural and functional connectivity MRI in normal and pathological brain networks , 2010, Magnetic Resonance Materials in Physics, Biology and Medicine.

[23]  U. Nussinovitch,et al.  Reliability of Ultra‐Short ECG Indices for Heart Rate Variability , 2011, Annals of noninvasive electrocardiology : the official journal of the International Society for Holter and Noninvasive Electrocardiology, Inc.

[24]  O. Sporns,et al.  Network centrality in the human functional connectome. , 2012, Cerebral cortex.

[25]  O. Sporns,et al.  Brain connectivity toolbox: a collection of complex network measurements and brain connectivity datasets. , 2009, NeuroImage.

[26]  M. Greicius.  Resting-state functional connectivity in neuropsychiatric disorders , 2008, Current opinion in neurology.

[27]  Maurizio Corbetta,et al.  The human brain is intrinsically organized into dynamic, anticorrelated functional networks. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[28]  Cornelis J. Stam,et al.  Small-world and scale-free organization of voxel-based resting-state functional connectivity in the human brain , 2008, NeuroImage.

[29]  John Trinder,et al.  Sleep and circadian influences on cardiac autonomic nervous system activity. , 1997, American journal of physiology. Heart and circulatory physiology.

[30]  Oliver Grimm,et al.  Test–retest reliability of fMRI-based graph theoretical properties during working memory, emotion processing, and resting state , 2014, NeuroImage.

[31]  S. Powers,et al.  Accuracy of pulse oximeters in estimating heart rate at rest and during exercise. , 1991, British journal of sports medicine.

[32]  L. Stegagno,et al.  Sleep onset and cardiovascular activity in primary insomnia , 2011, Journal of sleep research.

[33]  B. Biswal,et al.  The resting brain: unconstrained yet reliable. , 2009, Cerebral cortex.

[34]  G. Tononi,et al.  Breakdown of Cortical Effective Connectivity During Sleep , 2005, Science.

[35]  Manuel S. Schröter,et al.  Development of a Large-Scale Functional Brain Network during Human Non-Rapid Eye Movement Sleep , 2010, The Journal of Neuroscience.

[36]  Xintao Hu,et al.  Test-retest reliability of functional connectivity networks during naturalistic fMRI paradigms , 2016, bioRxiv.

[37]  Karl J. Friston,et al.  Movement‐Related effects in fMRI time‐series , 1996, Magnetic resonance in medicine.

[38]  Luca Citi,et al.  Revealing Real-Time Emotional Responses: a Personalized Assessment based on Heartbeat Dynamics , 2014, Scientific Reports.

[39]  M. Desseilles,et al.  Heart rate variability: a tool to explore the sleeping brain? , 2014, Front. Neurosci..

[40]  Robert W McCarley,et al.  Neurobiology of REM and NREM sleep. , 2007, Sleep medicine.

[41]  Vince D. Calhoun,et al.  A method for functional network connectivity among spatially independent resting-state components in schizophrenia , 2008, NeuroImage.

[42]  Danny J. J. Wang,et al.  Reliability comparison of spontaneous brain activities between BOLD and CBF contrasts in eyes-open and eyes-closed resting states , 2015, NeuroImage.

[43]  Abraham Z. Snyder,et al.  Spurious but systematic correlations in functional connectivity MRI networks arise from subject motion , 2012, NeuroImage.

[44]  John Pluta,et al.  Test–retest stability analysis of resting brain activity revealed by blood oxygen level‐dependent functional MRI , 2012, Journal of magnetic resonance imaging : JMRI.

[45]  E. Wolpert.  A Manual of Standardized Terminology, Techniques and Scoring System for Sleep Stages of Human Subjects. , 1969 .

[46]  Yong He,et al.  Graph Theoretical Analysis of Functional Brain Networks: Test-Retest Evaluation on Short- and Long-Term Resting-State Functional MRI Data , 2011, PloS one.

[47]  R Cameron Craddock,et al.  A whole brain fMRI atlas generated via spatially constrained spectral clustering , 2012, Human brain mapping.

[48]  M. D. Ernst.  Permutation Methods: A Basis for Exact Inference , 2004 .

[49]  Leandro Pecchia,et al.  Heart Rate Variability (HRV) Analysis: A Methodology for Organizational Neuroscience , 2019 .

[50]  R. Barbieri,et al.  Changes in cardiovascular function during the sleep onset period in young adults. , 2005, Journal of applied physiology.

[51]  Paul J. Laurienti,et al.  Neuroinformatics Original Research Article Materials and Methods Study Participants , 2022 .

[52]  Yufeng Zang,et al.  Toward reliable characterization of functional homogeneity in the human brain: Preprocessing, scan duration, imaging resolution and computational space , 2013, NeuroImage.

[53]  Jue Zhang,et al.  Graph Theoretical Analysis of BOLD Functional Connectivity during Human Sleep without EEG Monitoring , 2015, PloS one.

[54]  G. Breithardt,et al.  Heart rate variability: standards of measurement, physiological interpretation and clinical use. Task Force of the European Society of Cardiology and the North American Society of Pacing and Electrophysiology. , 1996 .

[55]  Vinod Menon,et al.  Functional connectivity in the resting brain: A network analysis of the default mode hypothesis , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[56]  J. Allan Hobson,et al.  A manual of standardized terminology, techniques and scoring system for sleep stages of human subjects: A. Rechtschaffen and A. Kales (Editors). (Public Health Service, U.S. Government Printing Office, Washington, D.C., 1968, 58 p., $4.00) , 1969 .

[57]  Robert C. Wolpert,et al.  A Review of the , 1985 .

[58]  Hans-Jochen Heinze,et al.  Association between heart rate variability and fluctuations in resting-state functional connectivity , 2013, NeuroImage.

[59]  A. Chesson,et al.  The AASM Manual for the Scoring of Sleep and Associated Events: Rules, Terminology, and Techinical Specifications , 2007 .

[60]  L. Stegagno,et al.  Nocturnal cardiac autonomic profile in young primary insomniacs and good sleepers. , 2014, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[61]  Kenneth Sundaraj,et al.  Detecting Driver Drowsiness Based on Sensors: A Review , 2012, Sensors.

[62]  Myeong Gi Jeong,et al.  Ultra Short Term Analysis of Heart Rate Variability for Monitoring Mental Stress in Mobile Settings , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[63]  Steven C. R. Williams,et al.  Measuring fMRI reliability with the intra-class correlation coefficient , 2009, NeuroImage.

[64]  Danielle S Bassett,et al.  Brain graphs: graphical models of the human brain connectome. , 2011, Annual review of clinical psychology.

[65]  Mert R. Sabuncu,et al.  The influence of head motion on intrinsic functional connectivity MRI , 2012, NeuroImage.

[66]  Guy A Dumont,et al.  Circadian variation of heart rate variability across sleep stages. , 2013, Sleep.

[67]  Enzo Tagliazucchi,et al.  Automatic sleep staging using fMRI functional connectivity data , 2012, NeuroImage.

[68]  S. Bouallègue,et al.  A New Method , 2021, Black Power and the American Myth.

[69]  J. Trinder,et al.  Autonomic activity during human sleep as a function of time and sleep stage , 2001, Journal of sleep research.

[70]  Simon B. Eickhoff,et al.  One-year test–retest reliability of intrinsic connectivity network fMRI in older adults , 2012, NeuroImage.

[71]  J. Volaufova,et al.  Prediction Intervals Via Consonance Intervals , 1999 .

[72]  Lino Nobili,et al.  Heart rate variability in normal and pathological sleep , 2013, Front. Physiol..

[73]  A. Braun,et al.  Decoupling of the brain's default mode network during deep sleep , 2009, Proceedings of the National Academy of Sciences.

[74]  Paul J. Laurienti,et al.  Comparison of characteristics between region-and voxel-based network analyses in resting-state fMRI data , 2010, NeuroImage.

[75]  Yufeng Zang,et al.  Functional brain hubs and their test–retest reliability: A multiband resting-state functional MRI study , 2013, NeuroImage.

[76]  M. V. D. Heuvel,et al.  Exploring the brain network: A review on resting-state fMRI functional connectivity , 2010, European Neuropsychopharmacology.

[77]  David N. Towers,et al.  The many metrics of cardiac chronotropy: A pragmatic primer and a brief comparison of metrics , 2007, Biological Psychology.

[78]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[79]  Elizabeth A. McDevitt,et al.  Heart rate variability during daytime naps in healthy adults: Autonomic profile and short-term reliability. , 2016, Psychophysiology.

[80]  Juan Zhou,et al.  Dominant hemisphere lateralization of cortical parasympathetic control as revealed by frontotemporal dementia , 2016, Proceedings of the National Academy of Sciences.

[81]  Yong He,et al.  Graph theoretical modeling of brain connectivity. , 2010, Current opinion in neurology.

[82]  J. Mcnames,et al.  Accuracy of ultra-short heart rate variability measures , 2003, Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No.03CH37439).

[83]  G. Zaccara,et al.  Human heart rate variability and sleep stages , 1996, The Italian Journal of Neurological Sciences.

[84]  Theodoros N. Arvanitis,et al.  Altered thalamocortical and intra-thalamic functional connectivity during light sleep compared with wake , 2016, NeuroImage.

[85]  R. H. Kent,et al.  The Mean Square Successive Difference , 1941 .

[86]  Kenneth Sundaraj,et al.  Drowsiness detection during different times of day using multiple features , 2013, Australasian Physical & Engineering Sciences in Medicine.

[87]  Vivek Prabhakaran,et al.  The effect of resting condition on resting-state fMRI reliability and consistency: A comparison between resting with eyes open, closed, and fixated , 2013, NeuroImage.

[88]  Xintao Hu,et al.  Distinct Cerebellar Contributions to Cognitive‐Perceptual Dynamics During Natural Viewing , 2017, Cerebral cortex.

[89]  Mark E. Bastin,et al.  Single subject fMRI test–retest reliability metrics and confounding factors , 2013, NeuroImage.

[90]  Anna M. Bianchi,et al.  Modulation of the Sympatho-Vagal Balance during Sleep: Frequency Domain Study of Heart Rate Variability and Respiration , 2012, Front. Physio..

[91]  Masaki Fukunaga,et al.  Decreased connectivity between the thalamus and the neocortex during human nonrapid eye movement sleep. , 2014, Sleep.

[92]  S. Nevsimalova,et al.  Spectral analysis of heart rate variability in sleep. , 2005, Physiological Research.

[93]  B. Biswal,et al.  Functional connectivity in the motor cortex of resting human brain using echo‐planar mri , 1995, Magnetic resonance in medicine.

[94]  K. McGraw,et al.  Forming inferences about some intraclass correlation coefficients. , 1996 .

[95]  R. Lane,et al.  A model of neurovisceral integration in emotion regulation and dysregulation. , 2000, Journal of affective disorders.

[96]  Adam J. Schwarz,et al.  Negative edges and soft thresholding in complex network analysis of resting state functional connectivity data , 2011, NeuroImage.

[97]  Graeme D. Jackson,et al.  Resting state functional connectivity changes induced by prior brain state are not network specific , 2015, NeuroImage.

[98]  W C Orr,et al.  Heart rate variability during waking and sleep in healthy males and females. , 1999, Sleep.

[99]  John Trinder,et al.  Sleep and cardiovascular regulation , 2011, Pflügers Archiv - European Journal of Physiology.

[100]  Xintao Hu,et al.  The integration of the internal and external milieu in the insula during dynamic emotional experiences , 2016, NeuroImage.

[101]  Thomas T. Liu,et al.  A component based noise correction method (CompCor) for BOLD and perfusion based fMRI , 2007, NeuroImage.