Quantitative imaging to assess tumor response to therapy: common themes of measurement, truth data, and error sources.

RATIONALE Early detection of tumor response to therapy is a key goal. Finding measurement algorithms capable of early detection of tumor response could individualize therapy treatment as well as reduce the cost of bringing new drugs to market. On an individual basis, the urgency arises from the desire to prevent continued treatment of the patient with a high-cost and/or high-risk regimen with no demonstrated individual benefit and rapidly switch the patient to an alternative efficacious therapy for that patient. In the context of bringing new drugs to market, such algorithms could demonstrate efficacy in much smaller populations, which would allow phase 3 trials to achieve statistically significant decisions with fewer subjects in shorter trials. MATERIALS AND METHODS This consensus-based article describes multiple, image modality-independent means to assess the relative performance of algorithms for measuring tumor change in response to therapy. In this setting, we describe specifically the example of measurement of tumor volume change from anatomic imaging as well as provide an overview of other promising generic analytic methods that can be used to assess change in heterogeneous tumors. To support assessment of the relative performance of algorithms for measuring small tumor change, data sources of truth are required. RESULTS Very short interval clinical imaging examinations and phantom scans provide known truth for comparative evaluation of algorithms. CONCLUSIONS For a given category of measurement methods, the algorithm that has the smallest measurement noise and least bias on average will perform best in early detection of true tumor change.

[1]  Timothy D Johnson,et al.  Functional diffusion map as an early imaging biomarker for high-grade glioma: correlation with conventional radiologic response and overall survival. , 2008, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[2]  Changbao Wu,et al.  Jackknife, Bootstrap and Other Resampling Methods in Regression Analysis , 1986 .

[3]  Hyunjin Park,et al.  Quantitative growth measurement of lesions in hepatic interval CT exams , 2008, SPIE Medical Imaging.

[4]  Erniel B. Barrios,et al.  Bootstrap Methods , 2011, International Encyclopedia of Statistical Science.

[5]  D. DeMets,et al.  Biomarkers and surrogate endpoints: Preferred definitions and conceptual framework , 2001, Clinical pharmacology and therapeutics.

[6]  Eric A. Hoffman,et al.  Registration-based estimates of local lung tissue expansion compared to xenon CT measures of specific ventilation , 2008, Medical Image Anal..

[7]  Thomas E. Nichols,et al.  Thresholding of Statistical Maps in Functional Neuroimaging Using the False Discovery Rate , 2002, NeuroImage.

[8]  J M Bland,et al.  Statistical methods for assessing agreement between two methods of clinical measurement , 1986 .

[9]  Robert Ford,et al.  Individual patient data analysis to assess modifications to the RECIST criteria. , 2009, European journal of cancer.

[10]  J M Balter,et al.  A comparison of ventilatory prostate movement in four treatment positions. , 2000, International journal of radiation oncology, biology, physics.

[11]  B. Rosen,et al.  High resolution measurement of cerebral blood flow using intravascular tracer bolus passages. Part II: Experimental comparison and preliminary results , 1996, Magnetic resonance in medicine.

[12]  J. Sempau,et al.  MANTIS: combined x-ray, electron and optical Monte Carlo simulations of indirect radiation imaging systems , 2006, Physics in medicine and biology.

[13]  C. Meyer,et al.  Evaluation of the functional diffusion map as an early biomarker of time-to-progression and overall survival in high-grade glioma. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[14]  Daniel P Barboriak,et al.  Diffusion-weighted and perfusion MR imaging for brain tumor characterization and assessment of treatment response. , 2006, Radiology.

[15]  M. Christian,et al.  [New guidelines to evaluate the response to treatment in solid tumors]. , 2000, Bulletin du cancer.

[16]  Steve B. Jiang,et al.  The management of respiratory motion in radiation oncology report of AAPM Task Group 76. , 2006, Medical physics.

[17]  Wei Lin,et al.  Respiratory motion‐compensated radial dynamic contrast‐enhanced (DCE)‐MRI of chest and abdominal lesions , 2008, Magnetic resonance in medicine.

[18]  Antoni B. Chan,et al.  On measuring the change in size of pulmonary nodules , 2006, IEEE Transactions on Medical Imaging.

[19]  Steve B. Jiang,et al.  The management of respiratory motion in radiation oncology report of AAPM Task Group 76. , 2006, Medical physics.

[20]  Mark Lubberink,et al.  Use of H2(15)O-PET and DCE-MRI to measure tumor blood flow. , 2008, The oncologist.

[21]  T. Perneger What's wrong with Bonferroni adjustments , 1998, BMJ.

[22]  Daniel P Barboriak,et al.  Magnetic resonance assessment of response to therapy: tumor change measurement, truth data and error sources. , 2009, Translational oncology.

[23]  Geoffrey McLennan,et al.  PET/CT Assessment of Response to Therapy: Tumor Change Measurement, Truth Data, and Error. , 2009, Translational oncology.

[24]  L. Broemeling,et al.  Interobserver and intraobserver variability in measurement of non-small-cell carcinoma lung lesions: implications for assessment of tumor response. , 2003, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[25]  Joel Karp,et al.  Consensus recommendations for the use of 18F-FDG PET as an indicator of therapeutic response in patients in National Cancer Institute Trials. , 2006, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[26]  Ella A. Kazerooni,et al.  Interobserver and Intraobserver Variability in the Assessment of Pulmonary Nodule Size on CT Using Film and Computer Display Methods1 , 2005 .

[27]  M. Christian,et al.  Measuring response in solid tumors: unidimensional versus bidimensional measurement. , 1999, Journal of the National Cancer Institute.

[28]  M. Knopp,et al.  Estimating kinetic parameters from dynamic contrast‐enhanced t1‐weighted MRI of a diffusable tracer: Standardized quantities and symbols , 1999, Journal of magnetic resonance imaging : JMRI.

[29]  Wendy Brown,et al.  Variability in response assessment in solid tumors: effect of number of lesions chosen for measurement. , 2003, Clinical cancer research : an official journal of the American Association for Cancer Research.

[30]  Matthijs Oudkerk,et al.  Perfusion MR imaging for differentiation of benign and malignant meningiomas , 2008, Neuroradiology.

[31]  Bradford A Moffat,et al.  Functional diffusion map: a noninvasive MRI biomarker for early stratification of clinical brain tumor response. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[32]  Geoffrey McLennan,et al.  Computed tomography assessment of response to therapy: tumor volume change measurement, truth data, and error. , 2009, Translational oncology.

[33]  J Bogaerts,et al.  Evaluation of lymph nodes with RECIST 1.1. , 2009, European journal of cancer.

[34]  Benoit Desjardins,et al.  Interobserver and intraobserver variability in the assessment of pulmonary nodule size on CT using film and computer display methods. , 2005, Academic radiology.

[35]  B. Rosen,et al.  High resolution measurement of cerebral blood flow using intravascular tracer bolus passages. Part I: Mathematical approach and statistical analysis , 1996, Magnetic resonance in medicine.

[36]  F. Mosteller,et al.  Understanding robust and exploratory data analysis , 1985 .

[37]  Richard C. Pais,et al.  Evaluation of Lung MDCT Nodule Annotation Across Radiologists and Methods 1 , 2006 .

[38]  D. Barboriak,et al.  Repeatability of quantitative parameters derived from diffusion tensor imaging in patients with glioblastoma multiforme , 2009, Journal of magnetic resonance imaging : JMRI.

[39]  C E Metz,et al.  Observer performance in detecting multiple radiographic signals. Prediction and analysis using a generalized ROC approach. , 1976, Radiology.

[40]  J W Belliveau,et al.  Functional cerebral imaging by susceptibility‐contrast NMR , 1990, Magnetic resonance in medicine.

[41]  Binsheng Zhao,et al.  Small pulmonary nodules: volumetrically determined growth rates based on CT evaluation. , 2000, Radiology.

[42]  K. Marten,et al.  Inadequacy of manual measurements compared to automated CT volumetry in assessment of treatment response of pulmonary metastases using RECIST criteria , 2006, European Radiology.

[43]  William P. Dillon,et al.  Perfusion CT compared to H215O/O15O PET in patients with chronic cervical carotid artery occlusion , 2008, Neuroradiology.

[44]  Zaid J. Towfic,et al.  The Lung Image Database Consortium (LIDC) data collection process for nodule detection and annotation , 2007, SPIE Medical Imaging.

[45]  R. A. Leibler,et al.  On Information and Sufficiency , 1951 .

[46]  S. Sourbron,et al.  Choice of the regularization parameter for perfusion quantification with MRI. , 2004, Physics in medicine and biology.

[47]  B. Wiens A fixed sequence Bonferroni procedure for testing multiple endpoints , 2003 .

[48]  Timothy D Johnson,et al.  The parametric response map is an imaging biomarker for early cancer treatment outcome , 2009, Nature Medicine.

[49]  C. Sigman,et al.  New science-based endpoints to accelerate oncology drug development. , 2005, European journal of cancer.

[50]  G. Mead,et al.  Radiotherapy versus carboplatin for stage I seminoma: Updated analysis of the MRC/EORTC randomized trial (ISRCTN27163214) , 2008 .

[51]  Jean-Philippe Thirion,et al.  Deformation Analysis to Detect and Quantify Active Lesions in 3D Medical Image Sequences , 1999, IEEE Trans. Medical Imaging.

[52]  H. Rolf Jäger,et al.  T2‐ and T2*‐W DCE‐MRI: Blood Perfusion and Volume Estimation using Bolus Tracking , 2004 .

[53]  D. Mankoff,et al.  Reproducibility of quantifying tracer uptake with PET/CT for evaluation of response to therapy , 2007, 2007 IEEE Nuclear Science Symposium Conference Record.

[54]  C.E. Burton,et al.  Systems, networks, and computation: Multivariable methods , 1976, Proceedings of the IEEE.

[55]  Geoffrey McLennan,et al.  The Lung Image Database Consortium (LIDC): an evaluation of radiologist variability in the identification of lung nodules on CT scans. , 2007, Academic radiology.

[56]  A. Beckett,et al.  AKUFO AND IBARAPA. , 1965, Lancet.

[57]  Peter J. Ell,et al.  Metabolic–flow relationships in primary breast cancer: feasibility of combined PET/dynamic contrast-enhanced CT , 2009, European Journal of Nuclear Medicine and Molecular Imaging.

[58]  M. Okada,et al.  [New response evaluation criteria in solid tumours-revised RECIST guideline (version 1.1)]. , 2009, Gan to kagaku ryoho. Cancer & chemotherapy.

[59]  L. Schwartz,et al.  Lung cancer: computerized quantification of tumor response--initial results. , 2006, Radiology.

[60]  N G Papadakis,et al.  A comparative study of acquisition schemes for diffusion tensor imaging using MRI. , 1999, Journal of magnetic resonance.

[61]  L. Clarke,et al.  Quantitative imaging for evaluation of response to cancer therapy. , 2009, Translational oncology.

[62]  L P Clarke,et al.  The Reference Image Database to Evaluate Response to Therapy in Lung Cancer (RIDER) Project: A Resource for the Development of Change‐Analysis Software , 2008, Clinical pharmacology and therapeutics.

[63]  George T. Y. Chen,et al.  Artifacts in computed tomography scanning of moving objects. , 2004, Seminars in radiation oncology.