Accuracy and reliability assessment of CT and MR perfusion analysis software using a digital phantom.

PURPOSE To design a digital phantom data set for computed tomography (CT) perfusion and perfusion-weighted imaging on the basis of the widely accepted tracer kinetic theory in which the true values of cerebral blood flow (CBF), cerebral blood volume (CBV), mean transit time (MTT), and tracer arrival delay are known and to evaluate the accuracy and reliability of postprocessing programs using this digital phantom. MATERIALS AND METHODS A phantom data set was created by generating concentration-time curves reflecting true values for CBF (2.5-87.5 mL/100 g per minute), CBV (1.0-5.0 mL/100 g), MTT (3.4-24 seconds), and tracer delays (0-3.0 seconds). These curves were embedded in human brain images. The data were analyzed by using 13 algorithms each for CT and magnetic resonance (MR), including five commercial vendors and five academic programs. Accuracy was assessed by using the Pearson correlation coefficient (r) for true values. Delay-, MTT-, or CBV-dependent errors and correlations between time to maximum of residue function (Tmax) were also evaluated. RESULTS In CT, CBV was generally well reproduced (r > 0.9 in 12 algorithms), but not CBF and MTT (r > 0.9 in seven and four algorithms, respectively). In MR, good correlation (r > 0.9) was observed in one-half of commercial programs, while all academic algorithms showed good correlations for all parameters. Most algorithms had delay-dependent errors, especially for commercial software, as well as CBV dependency for CBF or MTT calculation and MTT dependency for CBV calculation. Correlation was good in Tmax except for one algorithm. CONCLUSION The digital phantom readily evaluated the accuracy and characteristics of the CT and MR perfusion analysis software. All commercial programs had delay-induced errors and/or insufficient correlations with true values, while academic programs for MR showed good correlations with true values. SUPPLEMENTAL MATERIAL http://radiology.rsna.org/lookup/suppl/doi:10.1148/radiol.12112618/-/DC1.

[1]  Kirsten Shuler,et al.  Computed tomography and magnetic resonance perfusion imaging in ischemic stroke: Definitions and thresholds , 2011, Annals of neurology.

[2]  Kohsuke Kudo,et al.  Prediction of Infarct Volume and Neurologic Outcome by using Automated Multiparametric Perfusion-Weighted Magnetic Resonance Imaging in a Primate Model of Permanent Middle Cerebral Artery Occlusion , 2011, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[3]  R. Bammer,et al.  Real‐time diffusion‐perfusion mismatch analysis in acute stroke , 2010, Journal of magnetic resonance imaging : JMRI.

[4]  Alan Connelly,et al.  The Physiological Significance of the Time-to-Maximum (Tmax) Parameter in Perfusion MRI , 2010, Stroke.

[5]  Kim Mouridsen,et al.  Comparison of 10 Perfusion MRI Parameters in 97 Sub-6-Hour Stroke Patients Using Voxel-Based Receiver Operating Characteristics Analysis , 2009, Stroke.

[6]  Hiroki Shirato,et al.  Difference in tracer delay-induced effect among deconvolution algorithms in CT perfusion analysis: quantitative evaluation with digital phantoms. , 2009, Radiology.

[7]  R. Bammer,et al.  Optimal Tmax Threshold for Predicting Penumbral Tissue in Acute Stroke , 2009, Stroke.

[8]  M. Luby,et al.  Acute Stroke Imaging Research Roadmap II , 2008, Stroke.

[9]  Keith Muir,et al.  Effects of alteplase beyond 3 h after stroke in the Echoplanar Imaging Thrombolytic Evaluation Trial (EPITHET): a placebo-controlled randomised trial , 2008, The Lancet Neurology.

[10]  Karl J. Friston,et al.  Bayesian estimation of cerebral perfusion using a physiological model of microvasculature , 2006, NeuroImage.

[11]  Ting-Yim Lee,et al.  Dynamic CT Perfusion imaging in subarachnoid hemorrhage related vasospasm , 2005, AJNR. American journal of neuroradiology.

[12]  A. Janke,et al.  Improved Prediction of Final Infarct Volume Using Bolus Delay–Corrected Perfusion-Weighted MRI: Implications for the Ischemic Penumbra , 2004, Stroke.

[13]  Rajan Jain,et al.  Carotid perfusion CT with balloon occlusion and acetazolamide challenge test: feasibility. , 2004, Radiology.

[14]  Geoffrey A. Donnan,et al.  Advances in Penumbra Imaging with MR , 2004, Cerebrovascular Diseases.

[15]  B. Rosen,et al.  Tracer arrival timing‐insensitive technique for estimating flow in MR perfusion‐weighted imaging using singular value decomposition with a block‐circulant deconvolution matrix , 2003, Magnetic resonance in medicine.

[16]  Christopher Putman,et al.  Utility of Perfusion-Weighted CT Imaging in Acute Middle Cerebral Artery Stroke Treated With Intra-Arterial Thrombolysis:: Prediction of Final Infarct Volume and Clinical Outcome , 2001, Stroke.

[17]  M. Wiesmann,et al.  Dynamic CT perfusion imaging of acute stroke. , 2000, AJNR. American journal of neuroradiology.

[18]  R. Craen,et al.  A CT method to measure hemodynamics in brain tumors: validation and application of cerebral blood flow maps. , 2000, AJNR. American journal of neuroradiology.

[19]  E Klotz,et al.  Perfusion measurements of the brain: using dynamic CT for the quantitative assessment of cerebral ischemia in acute stroke. , 1999, European journal of radiology.

[20]  B. Rosen,et al.  High resolution measurement of cerebral blood flow using intravascular tracer bolus passages. Part I: Mathematical approach and statistical analysis , 1996, Magnetic resonance in medicine.

[21]  K. Zierler,et al.  On the theory of the indicator-dilution method for measurement of blood flow and volume. , 1954, Journal of applied physiology.

[22]  Hiroki Shirato,et al.  Differences in CT perfusion maps generated by different commercial software: quantitative analysis by using identical source data of acute stroke patients. , 2010, Radiology.