Multisite Concordance of DSC-MRI Analysis for Brain Tumors: Results of a National Cancer Institute Quantitative Imaging Network Collaborative Project

DSC-MR imaging data were collected after a preload and during a bolus injection of gadolinium contrast agent using a gradient recalled-echo-EPI sequence. Forty-nine low-grade and high-grade glioma datasets were uploaded to The Cancer Imaging Archive. Datasets included a predetermined arterial input function, enhancing tumor ROIs, and ROIs necessary to create normalized relative CBV and CBF maps. Seven sites computed 20 different perfusion metrics. For normalized relative CBV and normalized CBF, 93% and 94% of entries showed good or excellent cross-site agreement. All metrics could distinguish low- from high-grade tumors. BACKGROUND AND PURPOSE: Standard assessment criteria for brain tumors that only include anatomic imaging continue to be insufficient. While numerous studies have demonstrated the value of DSC-MR imaging perfusion metrics for this purpose, they have not been incorporated due to a lack of confidence in the consistency of DSC-MR imaging metrics across sites and platforms. This study addresses this limitation with a comparison of multisite/multiplatform analyses of shared DSC-MR imaging datasets of patients with brain tumors. MATERIALS AND METHODS: DSC-MR imaging data were collected after a preload and during a bolus injection of gadolinium contrast agent using a gradient recalled-echo–EPI sequence (TE/TR = 30/1200 ms; flip angle = 72°). Forty-nine low-grade (n = 13) and high-grade (n = 36) glioma datasets were uploaded to The Cancer Imaging Archive. Datasets included a predetermined arterial input function, enhancing tumor ROIs, and ROIs necessary to create normalized relative CBV and CBF maps. Seven sites computed 20 different perfusion metrics. Pair-wise agreement among sites was assessed with the Lin concordance correlation coefficient. Distinction of low- from high-grade tumors was evaluated with the Wilcoxon rank sum test followed by receiver operating characteristic analysis to identify the optimal thresholds based on sensitivity and specificity. RESULTS: For normalized relative CBV and normalized CBF, 93% and 94% of entries showed good or excellent cross-site agreement (0.8 ≤ Lin concordance correlation coefficient ≤ 1.0). All metrics could distinguish low- from high-grade tumors. Optimum thresholds were determined for pooled data (normalized relative CBV = 1.4, sensitivity/specificity = 90%:77%; normalized CBF = 1.58, sensitivity/specificity = 86%:77%). CONCLUSIONS: By means of DSC-MR imaging data obtained after a preload of contrast agent, substantial consistency resulted across sites for brain tumor perfusion metrics with a common threshold discoverable for distinguishing low- from high-grade tumors.

[1]  Zachary S. Kelm,et al.  Impact of Software Modeling on the Accuracy of Perfusion MRI in Glioma , 2015, American Journal of Neuroradiology.

[2]  Eun Ja Lee,et al.  Perfusion MR Imaging in Gliomas: Comparison with Histologic Tumor Grade , 2001, Korean journal of radiology.

[3]  Yuan-Yu Hsu,et al.  Is Weisskoff model valid for the correction of contrast agent extravasation with combined T1 and T2* effects in dynamic susceptibility contrast MRI? , 2011, Medical physics.

[4]  Michael H Lev,et al.  Glial tumor grading and outcome prediction using dynamic spin-echo MR susceptibility mapping compared with conventional contrast-enhanced MR: confounding effect of elevated rCBV of oligodendrogliomas [corrected]. , 2004, AJNR. American journal of neuroradiology.

[5]  M. J. van den Bent,et al.  Pseudoprogression and pseudoresponse in the treatment of gliomas , 2009, Current opinion in neurology.

[6]  D. Aquino,et al.  MRI in Glioma Immunotherapy: Evidence, Pitfalls, and Perspectives , 2017, Journal of immunology research.

[7]  Wade M Mueller,et al.  Spatial discrimination of glioblastoma and treatment effect with histologically-validated perfusion and diffusion magnetic resonance imaging metrics , 2017, Journal of Neuro-Oncology.

[8]  Eric S. Paulson,et al.  Spiral Perfusion Imaging With Consecutive Echoes (SPICE™) for the Simultaneous Mapping of DSC- and DCE-MRI Parameters in Brain Tumor Patients: Theory and Initial Feasibility , 2016, Tomography.

[9]  Bradley J. Erickson,et al.  Dynamic Susceptibility Contrast-MRI Quantification Software Tool: Development and Evaluation , 2016, Tomography.

[10]  J. Boxerman,et al.  Dynamic Susceptibility Contrast MR Imaging in Glioma: Review of Current Clinical Practice. , 2016, Magnetic resonance imaging clinics of North America.

[11]  Susan M. Chang,et al.  Updated response assessment criteria for high-grade gliomas: response assessment in neuro-oncology working group. , 2010, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[12]  D. Hoffmann,et al.  Prognostic value of perfusion MR imaging in patients with oligodendroglioma: A survival study. , 2011, Journal of neuroradiology. Journal de neuroradiologie.

[13]  Leland S. Hu,et al.  Reevaluating the imaging definition of tumor progression: perfusion MRI quantifies recurrent glioblastoma tumor fraction, pseudoprogression, and radiation necrosis to predict survival , 2012, Neuro-oncology.

[14]  S. Heiland,et al.  Relative cerebral blood volume is a potential predictive imaging biomarker of bevacizumab efficacy in recurrent glioblastoma. , 2015, Neuro-oncology.

[15]  Thomas E. Yankeelov,et al.  Evaluating Multisite rCBV Consistency from DSC-MRI Imaging Protocols and Postprocessing Software Across the NCI Quantitative Imaging Network Sites Using a Digital Reference Object (DRO) , 2019, Tomography.

[16]  T. Hirai,et al.  Prognostic Value of Perfusion MR Imaging of High-Grade Astrocytomas: Long-Term Follow-Up Study , 2008, American Journal of Neuroradiology.

[17]  Susan M. Chang,et al.  Evaluation of MR markers that predict survival in patients with newly diagnosed GBM prior to adjuvant therapy , 2008, Journal of Neuro-Oncology.

[18]  T. Cascino,et al.  Response criteria for phase II studies of supratentorial malignant glioma. , 1990, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[19]  Junjie Yao,et al.  Imaging the aged brain: pertinence and methods. , 2019, Quantitative imaging in medicine and surgery.

[20]  Glyn Johnson,et al.  Low-grade gliomas: dynamic susceptibility-weighted contrast-enhanced perfusion MR imaging--prediction of patient clinical response. , 2006, Radiology.

[21]  D. Kong,et al.  Diagnostic Dilemma of Pseudoprogression in the Treatment of Newly Diagnosed Glioblastomas: The Role of Assessing Relative Cerebral Blood Flow Volume and Oxygen-6-Methylguanine-DNA Methyltransferase Promoter Methylation Status , 2011, American Journal of Neuroradiology.

[22]  Andrew D Norden,et al.  Response Assessment Challenges in Clinical Trials of Gliomas , 2010, Current oncology reports.

[23]  Stephen M. Moore,et al.  The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository , 2013, Journal of Digital Imaging.

[24]  Douglas C. Miller,et al.  Gliomas: predicting time to progression or survival with cerebral blood volume measurements at dynamic susceptibility-weighted contrast-enhanced perfusion MR imaging. , 2008, Radiology.

[25]  Kim Mouridsen,et al.  T1- and T*2-Dominant Extravasation Correction in DSC-MRI: Part I—Theoretical Considerations and Implications for Assessment of Tumor Hemodynamic Properties , 2011, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[26]  W. Mueller,et al.  Dynamic-susceptibility contrast agent MRI measures of relative cerebral blood volume predict response to bevacizumab in recurrent high-grade glioma. , 2014, Neuro-oncology.

[27]  K. Schmainda,et al.  Standardization of relative cerebral blood volume (rCBV) image maps for ease of both inter‐ and intrapatient comparisons , 2010, Magnetic resonance in medicine.

[28]  F. Yamasaki,et al.  Role of perfusion-weighted imaging at 3T in the histopathological differentiation between astrocytic and oligodendroglial tumors. , 2012, European journal of radiology.

[29]  E. Larsson,et al.  Calculation of cerebral perfusion parameters using regional arterial input functions identified by factor analysis , 2006, Journal of magnetic resonance imaging : JMRI.

[30]  Kamran Paynabar,et al.  Repeatability of Cerebral Perfusion Using Dynamic Susceptibility Contrast MRI in Glioblastoma Patients12 , 2015, Translational oncology.

[31]  R M Weisskoff,et al.  Relative cerebral blood volume maps corrected for contrast agent extravasation significantly correlate with glioma tumor grade, whereas uncorrected maps do not. , 2006, AJNR. American journal of neuroradiology.

[32]  K. Schmainda,et al.  Comparison of dynamic susceptibility-weighted contrast-enhanced MR methods: recommendations for measuring relative cerebral blood volume in brain tumors. , 2008, Radiology.

[33]  M Takahashi,et al.  Posttherapeutic intraaxial brain tumor: the value of perfusion-sensitive contrast-enhanced MR imaging for differentiating tumor recurrence from nonneoplastic contrast-enhancing tissue. , 2000, AJNR. American journal of neuroradiology.

[34]  Brian B. Avants,et al.  The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) , 2015, IEEE Transactions on Medical Imaging.

[35]  J. Boxerman,et al.  Effects of MRI Protocol Parameters, Preload Injection Dose, Fractionation Strategies, and Leakage Correction Algorithms on the Fidelity of Dynamic-Susceptibility Contrast MRI Estimates of Relative Cerebral Blood Volume in Gliomas , 2017, American Journal of Neuroradiology.

[36]  M. Malkin,et al.  Delta T1 Method: An Automatic Post-contrast ROI Selection Technique for Brain Tumors , 2010 .

[37]  B. D. Ward,et al.  Characterization of a first-pass gradient-echo spin-echo method to predict brain tumor grade and angiogenesis. , 2004, AJNR. American journal of neuroradiology.

[38]  Girolamo Crisi,et al.  Differences in Dynamic Susceptibility Contrast MR Perfusion Maps Generated by Different Methods Implemented in Commercial Software , 2014, Journal of computer assisted tomography.

[39]  Christopher Joseph Pal,et al.  Brain tumor segmentation with Deep Neural Networks , 2015, Medical Image Anal..

[40]  J E Heiserman,et al.  Relative Cerebral Blood Volume Values to Differentiate High-Grade Glioma Recurrence from Posttreatment Radiation Effect: Direct Correlation between Image-Guided Tissue Histopathology and Localized Dynamic Susceptibility-Weighted Contrast-Enhanced Perfusion MR Imaging Measurements , 2009, American Journal of Neuroradiology.

[41]  Leif Østergaard,et al.  Evaluation of four postprocessing methods for determination of cerebral blood volume and mean transit time by dynamic susceptibility contrast imaging , 2002, Magnetic resonance in medicine.

[42]  T. Cloughesy,et al.  MRI perfusion measurements calculated using advanced deconvolution techniques predict survival in recurrent glioblastoma treated with bevacizumab , 2015, Journal of Neuro-Oncology.

[43]  Glyn Johnson,et al.  Glioma grading: sensitivity, specificity, and predictive values of perfusion MR imaging and proton MR spectroscopic imaging compared with conventional MR imaging. , 2003, AJNR. American journal of neuroradiology.

[44]  J. Vymazal,et al.  Response patterns of recurrent glioblastomas treated with tumor-treating fields. , 2014, Seminars in oncology.

[45]  B. Rosen,et al.  Perfusion imaging with NMR contrast agents , 1990, Magnetic resonance in medicine.

[46]  Natenael B. Semmineh,et al.  A Population-Based Digital Reference Object (DRO) for Optimizing Dynamic Susceptibility Contrast (DSC)-MRI Methods for Clinical Trials , 2017, Tomography.

[47]  J. Boxerman,et al.  Moving Toward a Consensus DSC-MRI Protocol: Validation of a Low–Flip Angle Single-Dose Option as a Reference Standard for Brain Tumors , 2019, American Journal of Neuroradiology.

[48]  Longitudinal, leakage corrected and uncorrected rCBV during the first-line treatment of glioblastoma: a prospective study , 2019, Journal of Neuro-Oncology.

[49]  Bradley J Erickson,et al.  Variability and accuracy of different software packages for dynamic susceptibility contrast magnetic resonance imaging for distinguishing glioblastoma progression from pseudoprogression , 2015, Journal of medical imaging.