Quality assurance of human functional magnetic resonance imaging: a literature review.

Functional magnetic resonance imaging (fMRI) has been a popular approach in brain research over the past 20 years. It offers a noninvasive method to probe the brain and uses blood oxygenation level dependent (BOLD) signal changes to access brain function. However, the BOLD signal only represents a small fraction of the total MR signal. System instability and various noise have a strong impact on the BOLD signal. Additionally, fMRI applies fast imaging technique to record brain cognitive process over time, requiring high temporal stability of MR scanners. Furthermore, data acquisition, image quality, processing, and statistical analysis methods also have a great effect on the results of fMRI studies. Quality assurance (QA) programs for fMRI can test the stability of MR scanners, evaluate the quality of fMRI and help to find errors during fMRI scanning, thereby greatly enhancing the success rate of fMRI. In this review, we focus on previous studies which developed QA programs and methods in SCI/SCIE citation peer-reviewed publications over the last 20 years, including topics on existing fMRI QA programs, QA phantoms, image QA metrics, quality evaluation of existing preprocessing pipelines and fMRI statistical analysis methods. The summarized studies were classified into four categories: QA of fMRI systems, QA of fMRI data, quality evaluation of data processing pipelines and statistical methods and QA of task-related fMRI. Summary tables and figures of QA programs and metrics have been developed based on the comprehensive review of the literature.

[1]  Jonathan D. Power,et al.  Recent progress and outstanding issues in motion correction in resting state fMRI , 2015, NeuroImage.

[2]  N C Andreasen,et al.  Functional MRI statistical software packages: A comparative analysis , 1998, Human brain mapping.

[3]  Yoshio Tanaka,et al.  Real-time functional MRI: development and emerging applications. , 2006, Magnetic resonance in medical sciences : MRMS : an official journal of Japan Society of Magnetic Resonance in Medicine.

[4]  Hideo Shinagawa,et al.  Comparison of fMRI data analysis by SPM99 on different operating systems. , 2004, Journal of medical and dental sciences.

[5]  V. Renvall Functional magnetic resonance imaging reference phantom. , 2009, Magnetic resonance imaging.

[6]  R. Deichmann,et al.  Real-time functional magnetic resonance imaging: methods and applications. , 2007, Magnetic resonance imaging.

[7]  Abraham Z. Snyder,et al.  Spurious but systematic correlations in functional connectivity MRI networks arise from subject motion , 2012, NeuroImage.

[8]  Anders Nilsson,et al.  A two-compartment gel phantom for optimization and quality assurance in clinical BOLD fMRI. , 2008, Magnetic resonance imaging.

[9]  Alberto Llera,et al.  ICA-AROMA: A robust ICA-based strategy for removing motion artifacts from fMRI data , 2015, NeuroImage.

[10]  Mathias Davids,et al.  Fully-automated quality assurance in multi-center studies using MRI phantom measurements. , 2014, Magnetic resonance imaging.

[11]  Raveendran Paramesran,et al.  Review of medical image quality assessment , 2016, Biomed. Signal Process. Control..

[12]  Hans P. Op de Beeck,et al.  Against hyperacuity in brain reading: Spatial smoothing does not hurt multivariate fMRI analyses? , 2010, NeuroImage.

[13]  John Ashburner,et al.  SPM: A history , 2012, NeuroImage.

[14]  Lawrence L. Wald,et al.  Signal Fluctuation Sensitivity: An Improved Metric for Optimizing Detection of Resting-State fMRI Networks , 2015, Front. Neurosci..

[15]  Riitta Hari,et al.  Functional phantom for fMRI: a feasibility study. , 2006, Magnetic resonance imaging.

[16]  Stephen M. Smith,et al.  Probabilistic independent component analysis for functional magnetic resonance imaging , 2004, IEEE Transactions on Medical Imaging.

[17]  M S Cohen,et al.  Real-time functional magnetic resonance imaging. , 2001, Methods.

[18]  G. Glover,et al.  Neuroimaging at 1.5 T and 3.0 T: Comparison of oxygenation‐sensitive magnetic resonance imaging , 2001, Magnetic resonance in medicine.

[19]  L. Haase,et al.  The effect of stimulus delivery technique on perceived intensity functions for taste stimuli: Implications for fMRI studies , 2009, Attention, perception & psychophysics.

[20]  Michele T. Diaz,et al.  Function biomedical informatics research network recommendations for prospective multicenter functional MRI studies , 2012, Journal of magnetic resonance imaging : JMRI.

[21]  M. Farah,et al.  Progress and challenges in probing the human brain , 2015, Nature.

[22]  S Makeig,et al.  Analysis of fMRI data by blind separation into independent spatial components , 1998, Human brain mapping.

[23]  Markus Barth,et al.  Contrast‐to‐noise ratio (CNR) as a quality parameter in fMRI , 2007, Journal of magnetic resonance imaging : JMRI.

[24]  Maarten Mennes,et al.  Evaluation of ICA-AROMA and alternative strategies for motion artifact removal in resting state fMRI , 2015, NeuroImage.

[25]  Gary H. Glover,et al.  Automated Real-Time Behavioral and Physiological Data Acquisition and Display Integrated with Stimulus Presentation for fMRI , 2011, Front. Neuroinform..

[26]  R W Cox,et al.  Real‐Time Functional Magnetic Resonance Imaging , 1995, Magnetic resonance in medicine.

[27]  G. Parker,et al.  Cognitive generation of affect in bipolar depression: an fMRI study , 2004, The European journal of neuroscience.

[28]  Yang Fan,et al.  A high performance 3D cluster-based test of unsmoothed fMRI data , 2014, NeuroImage.

[29]  Michael B. Miller,et al.  fMRI reliability: Influences of task and experimental design , 2013, Cognitive, Affective, & Behavioral Neuroscience.

[30]  Michele T. Diaz,et al.  The Function Biomedical Informatics Research Network Data Repository , 2016, NeuroImage.

[31]  Bin Lu,et al.  Reproducibility of R‐fMRI metrics on the impact of different strategies for multiple comparison correction and sample sizes , 2018, Human brain mapping.

[32]  Deming Wang,et al.  A novel phantom and method for comprehensive 3-dimensional measurement and correction of geometric distortion in magnetic resonance imaging. , 2004, Magnetic resonance imaging.

[33]  Simon J Graham,et al.  Reliability of Task-Based fMRI for Preoperative Planning: A Test-Retest Study in Brain Tumor Patients and Healthy Controls , 2016, PloS one.

[34]  John A. D. Aston,et al.  A method for generating reproducible evidence in fMRI studies , 2006, NeuroImage.

[35]  J. Bernarding,et al.  A new concept of a unified parameter management, experiment control, and data analysis in fMRI: Application to real-time fMRI at 3T and 7T , 2008, Journal of Neuroscience Methods.

[36]  Joshua Carp,et al.  The secret lives of experiments: Methods reporting in the fMRI literature , 2012, NeuroImage.

[37]  E. Seto,et al.  Quantifying Head Motion Associated with Motor Tasks Used in fMRI , 2001, NeuroImage.

[38]  Timothy O. Laumann,et al.  Methods to detect, characterize, and remove motion artifact in resting state fMRI , 2014, NeuroImage.

[39]  Kerri Smith,et al.  Brain imaging: fMRI 2.0 , 2012, Nature.

[40]  J A Sorenson,et al.  ROC methods for evaluation of fMRI techniques , 1996, Magnetic resonance in medicine.

[41]  J Felblinger,et al.  Recordings of eye movements for stimulus control during fMRI by means of electro‐oculographic methods , 1996, Magnetic resonance in medicine.

[42]  R M Weisskoff,et al.  Simple measurement of scanner stability for functional NMR imaging of activation in the brain , 1996, Magnetic resonance in medicine.

[43]  Hans Knutsson,et al.  Does Parametric Fmri Analysis with Spm Yield Valid Results? -an Empirical Study of 1484 Rest Datasets Does Parametric Fmri Analysis with Spm Yield Valid Results? - an Empirical Study of 1484 Rest Datasets , 2022 .

[44]  Gary H. Glover,et al.  Reducing interscanner variability of activation in a multicenter fMRI study: Controlling for signal-to-fluctuation-noise-ratio (SFNR) differences , 2006, NeuroImage.

[45]  Soroosh Afyouni,et al.  Insight and inference for DVARS , 2017, NeuroImage.

[46]  Benoit M Dawant,et al.  Development of computer-generated phantoms for FMRI software evaluation. , 2005, Magnetic resonance imaging.

[47]  Todd B. Parrish,et al.  Hemodynamic response function in patients with stroke-induced aphasia: Implications for fMRI data analysis , 2007, NeuroImage.

[48]  Stephen C. Strother,et al.  Evaluation and comparison of GLM- and CVA-based fMRI processing pipelines with Java-based fMRI processing pipeline evaluation system , 2008, NeuroImage.

[49]  Qianjin Feng,et al.  Development of a calibration phantom set for MRI temperature imaging system quality assurance. , 2012, Academic radiology.

[50]  Stefan Brodoehl,et al.  Measuring eye states in functional MRI , 2016, BMC Neuroscience.

[51]  Wilkin Chau,et al.  An Empirical Comparison of SPM Preprocessing Parameters to the Analysis of fMRI Data , 2002, NeuroImage.

[52]  Brian A. Nosek,et al.  Power failure: why small sample size undermines the reliability of neuroscience , 2013, Nature Reviews Neuroscience.

[53]  Lee Friedman,et al.  Report on a multicenter fMRI quality assurance protocol , 2006, Journal of magnetic resonance imaging : JMRI.

[54]  Andy Wai Kan Yeung,et al.  An Updated Survey on Statistical Thresholding and Sample Size of fMRI Studies , 2018, Front. Hum. Neurosci..

[55]  Michael Brady,et al.  Improved Optimization for the Robust and Accurate Linear Registration and Motion Correction of Brain Images , 2002, NeuroImage.

[56]  Mary E. Meyerand,et al.  The influence of spatial resolution and smoothing on the detectability of resting-state and task fMRI , 2014, NeuroImage.

[57]  Abraham Z. Snyder,et al.  Human Connectome Project informatics: Quality control, database services, and data visualization , 2013, NeuroImage.

[58]  Peter Kirsch,et al.  Test–retest reliability of evoked BOLD signals from a cognitive–emotive fMRI test battery , 2012, NeuroImage.

[59]  George R Duensing,et al.  SmartPhantom--an fMRI simulator. , 2006, Magnetic resonance imaging.

[60]  Bing Chen,et al.  An open science resource for establishing reliability and reproducibility in functional connectomics , 2014, Scientific Data.

[61]  Mohammad Ali Oghabian,et al.  False positive control of activated voxels in single fMRI analysis using bootstrap resampling in comparison to spatial smoothing. , 2013, Magnetic resonance imaging.

[62]  Hans Knutsson,et al.  Cluster failure: Why fMRI inferences for spatial extent have inflated false-positive rates , 2016, Proceedings of the National Academy of Sciences.

[63]  Yihong Yang,et al.  Head motion suppression using real-time feedback of motion information and its effects on task performance in fMRI , 2005, NeuroImage.

[65]  Wolfgang Grodd,et al.  Principles of a brain-computer interface (BCI) based on real-time functional magnetic resonance imaging (fMRI) , 2004, IEEE Transactions on Biomedical Engineering.

[66]  Wen-Ming Luh,et al.  Differentiating BOLD and non-BOLD signals in fMRI time series using multi-echo EPI , 2012, NeuroImage.

[67]  Raimo Sepponen,et al.  Phantom‐based evaluation of geometric distortions in functional magnetic resonance and diffusion tensor imaging , 2007, Magnetic resonance in medicine.

[68]  Ning Xu,et al.  Computer-generated fMRI phantoms with motion-distortion interaction. , 2007, Magnetic resonance imaging.

[69]  Yufeng Zang,et al.  Standardizing the intrinsic brain: Towards robust measurement of inter-individual variation in 1000 functional connectomes , 2013, NeuroImage.

[70]  H. Yamasue,et al.  Head Motion and Correction Methods in Resting-state Functional MRI , 2015, Magnetic resonance in medical sciences : MRMS : an official journal of Japan Society of Magnetic Resonance in Medicine.

[71]  Mark E. Bastin,et al.  Single subject fMRI test–retest reliability metrics and confounding factors , 2013, NeuroImage.

[72]  Nick C Fox,et al.  The Alzheimer's disease neuroimaging initiative (ADNI): MRI methods , 2008, Journal of magnetic resonance imaging : JMRI.

[73]  Simon B. Eickhoff,et al.  One-year test–retest reliability of intrinsic connectivity network fMRI in older adults , 2012, NeuroImage.

[74]  Remco J. Renken,et al.  Automated correction of spin-history related motion artefacts in fMRI: Simulated and phantom data , 2005, IEEE Transactions on Biomedical Engineering.

[75]  Scott A. Huettel,et al.  The BOLD fMRI refractory effect is specific to stimulus attributes: evidence from a visual motion paradigm , 2004, NeuroImage.

[76]  X. Zuo,et al.  Test-retest reliabilities of resting-state FMRI measurements in human brain functional connectomics: A systems neuroscience perspective , 2014, Neuroscience & Biobehavioral Reviews.

[77]  Thomas E. Nichols,et al.  Scanning the horizon: towards transparent and reproducible neuroimaging research , 2016, Nature Reviews Neuroscience.

[78]  Mert R. Sabuncu,et al.  The influence of head motion on intrinsic functional connectivity MRI , 2012, NeuroImage.

[79]  Lawrence L. Wald,et al.  Comparison of physiological noise at 1.5 T, 3 T and 7 T and optimization of fMRI acquisition parameters , 2005, NeuroImage.

[80]  G. Barker,et al.  Study design in fMRI: Basic principles , 2006, Brain and Cognition.

[81]  Karl J. Friston,et al.  Movement‐Related effects in fMRI time‐series , 1996, Magnetic resonance in medicine.

[82]  Karl Zilles,et al.  Automated quality assurance routines for fMRI data applied to a multicenter study , 2005, Human brain mapping.

[83]  Kevin Murphy,et al.  Resting-state fMRI confounds and cleanup , 2013, NeuroImage.

[84]  T J Grabowski,et al.  Real‐time multiple linear regression for fMRI supported by time‐aware acquisition and processing , 2001, Magnetic resonance in medicine.

[85]  S C Williams,et al.  Quality control for functional magnetic resonance imaging using automated data analysis and Shewhart charting , 1999, Magnetic resonance in medicine.

[86]  Ben D. Fulcher,et al.  An evaluation of the efficacy, reliability, and sensitivity of motion correction strategies for resting-state functional MRI , 2017, NeuroImage.

[87]  Yong He,et al.  Addressing head motion dependencies for small-world topologies in functional connectomics , 2013, Front. Hum. Neurosci..

[88]  Wang Zhan,et al.  A Rotational Cylindrical fMRI Phantom for Image Quality Control , 2015, PloS one.

[89]  V L Morgan,et al.  Comparison of functional MRI image realignment tools using a computer‐generated phantom , 2001, Magnetic resonance in medicine.

[90]  James Voyvodic,et al.  A novel method for quantifying scanner instability in fMRI , 2011, Magnetic resonance in medicine.

[91]  R. DeCharms Applications of real-time fMRI , 2008, Nature Reviews Neuroscience.

[92]  Gary H Glover,et al.  Estimating sample size in functional MRI (fMRI) neuroimaging studies: Statistical power analyses , 2002, Journal of Neuroscience Methods.

[93]  Thomas M. Talavage,et al.  Reproducibility of fMRI activations associated with auditory sentence comprehension , 2011, NeuroImage.