ePAD: An Image Annotation and Analysis Platform for Quantitative Imaging

Medical imaging is critical for assessing the response of patients to new cancer therapies. Quantitative lesion assessment on images is time-consuming, and adopting new promising quantitative imaging biomarkers of response in clinical trials is challenging. The electronic Physician Annotation Device (ePAD) is a freely available web-based zero-footprint software application for viewing, annotation, and quantitative analysis of radiology images designed to meet the challenges of quantitative evaluation of cancer lesions. For imaging researchers, ePAD calculates a variety of quantitative imaging biomarkers that they can analyze and compare in ePAD to identify potential candidates as surrogate endpoints in clinical trials. For clinicians, ePAD provides clinical decision support tools for evaluating cancer response through reports summarizing changes in tumor burden based on different imaging biomarkers. As a workflow management and study oversight tool, ePAD lets clinical trial project administrators create worklists for users and oversee the progress of annotations created by research groups. To support interoperability of image annotations, ePAD writes all image annotations and results of quantitative imaging analyses in standardized file formats, and it supports migration of annotations from various propriety formats. ePAD also provides a plugin architecture supporting MATLAB server-side modules in addition to client-side plugins, permitting the community to extend the ePAD platform in various ways for new cancer use cases. We present an overview of ePAD as a platform for medical image annotation and quantitative analysis. We also discuss use cases and collaborations with different groups in the Quantitative Imaging Network and future directions.

[1]  M. Rosen,et al.  Primer on imaging technologies for cancer. , 2006, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[2]  Rémy Guillevin,et al.  Response assessment in recurrent glioblastoma treated with irinotecan-bevacizumab: comparative analysis of the Macdonald, RECIST, RANO, and RECIST + F criteria. , 2012, Neuro-oncology.

[3]  Matthew B Hoy HTML5: A New Standard for the Web , 2011, Medical reference services quarterly.

[4]  Hakmook Kang,et al.  The Attenuation Distribution Across the Long Axis (ADLA): Preliminary Findings for Assessing Response to Cancer Treatment. , 2016, Academic radiology.

[5]  Chintan Parmar,et al.  Associations Between Somatic Mutations and Metabolic Imaging Phenotypes in Non–Small Cell Lung Cancer , 2017, The Journal of Nuclear Medicine.

[6]  Olivier Gevaert,et al.  Noninvasive radiomics signature based on quantitative analysis of computed tomography images as a surrogate for microvascular invasion in hepatocellular carcinoma: a pilot study , 2017, Journal of medical imaging.

[7]  A P Reeves,et al.  Data sets for the qualification of volumetric CT as a quantitative imaging biomarker in lung cancer. , 2010, Optics express.

[8]  M. Ratain Phase II Oncology Trials: Let's Be Positive , 2005, Clinical Cancer Research.

[9]  Haesun Choi,et al.  Response evaluation of gastrointestinal stromal tumors. , 2008, The oncologist.

[10]  G. Rosner,et al.  Phase II placebo-controlled randomized discontinuation trial of sorafenib in patients with metastatic renal cell carcinoma. , 2006, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[11]  Daniel C Sullivan,et al.  Functional imaging in lung cancer. , 2005, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[12]  R. Wahl,et al.  From RECIST to PERCIST: Evolving Considerations for PET Response Criteria in Solid Tumors , 2009, Journal of Nuclear Medicine.

[13]  Olivier Gevaert,et al.  Core samples for radiomics features that are insensitive to tumor segmentation: method and pilot study using CT images of hepatocellular carcinoma , 2015, Journal of medical imaging.

[14]  Xin Li,et al.  The Evaluation of Esophageal Adenocarcinoma Using Dynamic Contrast-Enhanced Magnetic Resonance Imaging , 2007, Journal of Gastrointestinal Surgery.

[15]  E. Eisenhauer,et al.  Re: New Guidelines to Evaluate the Response to Treatment in Solid Tumors (Ovarian Cancer) , 2005 .

[16]  Haesun Choi,et al.  We should desist using RECIST, at least in GIST. , 2007, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[17]  Kevin W Eliceiri,et al.  NIH Image to ImageJ: 25 years of image analysis , 2012, Nature Methods.

[18]  L. T. Handoko Committee , 2019, 2019 International Conference on Radar, Antenna, Microwave, Electronics, and Telecommunications (ICRAMET).

[19]  小柳 仁 American Association for Thoracic Surgery (AATS) , 2003 .

[20]  S. Larson,et al.  Preoperative F-18 fluorodeoxyglucose-positron emission tomography maximal standardized uptake value predicts survival after lung cancer resection. , 2004, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[21]  Pattanasak Mongkolwat,et al.  Informatics in radiology: An open-source and open-access cancer biomedical informatics grid annotation and image markup template builder. , 2012, Radiographics : a review publication of the Radiological Society of North America, Inc.

[22]  C. Langlotz RadLex: a new method for indexing online educational materials. , 2006, Radiographics : a review publication of the Radiological Society of North America, Inc.

[23]  Shetal N Shah,et al.  Assessing tumor response and detecting recurrence in metastatic renal cell carcinoma on targeted therapy: importance of size and attenuation on contrast-enhanced CT. , 2010, AJR. American journal of roentgenology.

[24]  Olivier Gevaert,et al.  A Rapid Segmentation-Insensitive “Digital Biopsy” Method for Radiomic Feature Extraction: Method and Pilot Study Using CT Images of Non–Small Cell Lung Cancer , 2016, Tomography.

[25]  Timothy D Johnson,et al.  The parametric response map is an imaging biomarker for early cancer treatment outcome , 2009, Nature Medicine.

[26]  Hakmook Kang,et al.  The Attenuation Distribution Across the Long Axis of Breast Cancer Liver Metastases at CT: A Quantitative Biomarker for Predicting Overall Survival. , 2018, AJR. American journal of roentgenology.

[27]  James H Thrall,et al.  Using imaging biomarkers to accelerate drug development and clinical trials. , 2005, Drug discovery today.

[28]  Susan M. Chang,et al.  Updated response assessment criteria for high-grade gliomas: response assessment in neuro-oncology working group. , 2010, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[29]  Haesun Choi,et al.  Correlation of computed tomography and positron emission tomography in patients with metastatic gastrointestinal stromal tumor treated at a single institution with imatinib mesylate: proposal of new computed tomography response criteria. , 2007, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[30]  R. Gillies,et al.  Quantitative imaging in cancer evolution and ecology. , 2013, Radiology.

[31]  Eric P Tamm,et al.  CT evaluation of the response of gastrointestinal stromal tumors after imatinib mesylate treatment: a quantitative analysis correlated with FDG PET findings. , 2004, AJR. American journal of roentgenology.

[32]  D. DeMets,et al.  Biomarkers and surrogate endpoints: Preferred definitions and conceptual framework , 2001, Clinical pharmacology and therapeutics.

[33]  M Van Glabbeke,et al.  New guidelines to evaluate the response to treatment in solid tumors. European Organization for Research and Treatment of Cancer, National Cancer Institute of the United States, National Cancer Institute of Canada. , 2000, Journal of the National Cancer Institute.

[34]  James H Thrall,et al.  Biomarkers in imaging: realizing radiology's future. , 2003, Radiology.

[35]  H. Greenspan,et al.  Automated retrieval of CT images of liver lesions on the basis of image similarity: method and preliminary results. , 2010, Radiology.

[36]  Olivier Gevaert,et al.  Non-small cell lung cancer: identifying prognostic imaging biomarkers by leveraging public gene expression microarray data--methods and preliminary results. , 2012, Radiology.

[37]  John Suckling,et al.  Informatics in Radiology (infoRAD): Magnetic Resonance Imaging Workbench: analysis and visualization of dynamic contrast-enhanced MR imaging data. , 2006, Radiographics : a review publication of the Radiological Society of North America, Inc.

[38]  E. Eisenhauer,et al.  RECIST revisited: a review of validation studies on tumour assessment. , 2006, European journal of cancer.

[39]  P. Workman,et al.  Discovering novel chemotherapeutic drugs for the third millennium. , 1999, European journal of cancer.

[40]  Haejun Lee,et al.  Building and Querying RDF/OWL Database of Semantically Annotated Nuclear Medicine Images , 2017, Journal of Digital Imaging.

[41]  N. Villari,et al.  The Medici Project first anthropological and paleopathological results of the exploration of the Medici tombs in Florence. , 2007, Medicina nei secoli.

[42]  Yi Liu,et al.  On the Feasibility of Predicting Radiological Observations from Computational Imaging Features of Liver Lesions in CT Scans , 2011, 2011 IEEE First International Conference on Healthcare Informatics, Imaging and Systems Biology.

[43]  Bruce D Cheson,et al.  Progress and Promise of FDG-PET Imaging for Cancer Patient Management and Oncologic Drug Development , 2005, Clinical Cancer Research.

[44]  Ron Kikinis,et al.  3D Slicer as a tool for interactive brain tumor segmentation , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[45]  Daniel L. Rubin,et al.  3D Markup of Radiological Images in ePAD, a Web-Based Image Annotation Tool , 2015, 2015 IEEE 28th International Symposium on Computer-Based Medical Systems.

[46]  G. McLennan,et al.  Quantitative imaging test approval and biomarker qualification: interrelated but distinct activities. , 2011, Radiology.

[47]  Olivier Gevaert,et al.  Non–Small Cell Lung Cancer Radiogenomics Map Identifies Relationships between Molecular and Imaging Phenotypes with Prognostic Implications , 2017, Radiology.

[48]  E. Eisenhauer,et al.  Review of phase II trial designs used in studies of molecular targeted agents: outcomes and predictors of success in phase III. , 2008, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[49]  L. Schwartz,et al.  New response evaluation criteria in solid tumours: revised RECIST guideline (version 1.1). , 2009, European journal of cancer.

[50]  G. Parker,et al.  DCE-MRI biomarkers in the clinical evaluation of antiangiogenic and vascular disrupting agents , 2007, British Journal of Cancer.

[51]  Tej D. Azad,et al.  Magnetic resonance image features identify glioblastoma phenotypic subtypes with distinct molecular pathway activities , 2015, Science Translational Medicine.

[52]  S. Larson,et al.  Preoperative 18[F]-fluorodeoxyglucose positron emission tomography standardized uptake values predict survival after esophageal adenocarcinoma resection. , 2006, The Annals of thoracic surgery.

[53]  D. Hanahan,et al.  The Hallmarks of Cancer , 2000, Cell.

[54]  Mark J Ratain,et al.  Phase II studies of modern drugs directed against new targets: if you are fazed, too, then resist RECIST. , 2004, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[55]  E. Eisenhauer,et al.  Re: New guidelines to evaluate the response to treatment in solid tumors (ovarian cancer). , 2005, Journal of the National Cancer Institute.

[56]  Apurva A Desai,et al.  Sorafenib in advanced clear-cell renal-cell carcinoma. , 2007, The New England journal of medicine.

[57]  A. Guermazi,et al.  Commentary: PET poised to alter the current paradigm for response assessment of non-Hodgkin's lymphoma. , 2006, The British journal of radiology.

[58]  Ron Kikinis,et al.  3D Slicer , 2012, 2004 2nd IEEE International Symposium on Biomedical Imaging: Nano to Macro (IEEE Cat No. 04EX821).

[59]  Wolfgang A Weber,et al.  Assessing Tumor Response to Therapy , 2009, Journal of Nuclear Medicine.

[60]  Milan Sonka,et al.  3D Slicer as an image computing platform for the Quantitative Imaging Network. , 2012, Magnetic resonance imaging.

[61]  Dimitri Van De Ville,et al.  Rotation–Covariant Texture Learning Using Steerable Riesz Wavelets , 2014, IEEE Transactions on Image Processing.

[62]  Paul Workman,et al.  Minimally invasive pharmacokinetic and pharmacodynamic technologies in hypothesis-testing clinical trials of innovative therapies. , 2006, Journal of the National Cancer Institute.

[63]  Benoit M Dawant,et al.  A nonrigid registration algorithm for longitudinal breast MR images and the analysis of breast tumor response. , 2009, Magnetic resonance imaging.

[64]  Wolfgang Meier,et al.  eXist: An Open Source Native XML Database , 2002, Web, Web-Services, and Database Systems.

[65]  A. Haug,et al.  Validation of Several SUV-Based Parameters Derived from 18F-FDG PET for Prediction of Survival After SIRT of Hepatic Metastases from Colorectal Cancer , 2013, The Journal of Nuclear Medicine.

[66]  Nicholas Petrick,et al.  Volumetric CT in lung cancer: an example for the qualification of imaging as a biomarker. , 2010, Academic radiology.

[67]  Bradley J Erickson,et al.  Validation of neuroradiologic response assessment in gliomas: measurement by RECIST, two-dimensional, computer-assisted tumor area, and computer-assisted tumor volume methods. , 2006, Neuro-oncology.

[68]  Daniel L. Rubin,et al.  Quantitative Image Feature Engine (QIFE): an Open-Source, Modular Engine for 3D Quantitative Feature Extraction from Volumetric Medical Images , 2018, Journal of Digital Imaging.

[69]  Thomas E Yankeelov,et al.  Dynamic Contrast Enhanced Magnetic Resonance Imaging in Oncology: Theory, Data Acquisition, Analysis, and Examples. , 2007, Current medical imaging reviews.

[70]  Daniel L. Rubin,et al.  Tool Support to Enable Evaluation of the Clinical Response to Treatment , 2008, AMIA.

[71]  D. Rubin,et al.  Computational approaches to assist in the evaluation of cancer treatment response , 2011 .

[72]  J. Choi,et al.  Clinical Investigation : Gynecologic Cancer Prognostic Significance of Tumor Response as Assessed by Sequential 18 F-Fluorodeoxyglucose-Positron Emission Tomography / Computed Tomography During Concurrent Chemoradiation Therapy for Cervical Cancer , 2013 .

[73]  Daniel L. Rubin,et al.  Medical Imaging on the Semantic Web: Annotation and Image Markup , 2008, AAAI Spring Symposium: Semantic Scientific Knowledge Integration.

[74]  Daniel L. Rubin,et al.  Semantic Reasoning with Image Annotations for Tumor Assessment , 2009, AMIA.

[75]  Xue Meng,et al.  New strategy for monitoring targeted therapy: molecular imaging , 2013, International journal of nanomedicine.

[76]  John C Waterton,et al.  Qualification of imaging biomarkers for oncology drug development. , 2012, European journal of cancer.

[77]  Paul G. Nagy,et al.  Leveraging Internet Technologies with DICOM WADO , 2012, Journal of Digital Imaging.

[78]  T. Chenevert,et al.  Diffusion-Weighted MRI as a Biomarker of Tumor Radiation Treatment Response Heterogeneity: A Comparative Study of Whole-Volume Histogram Analysis versus Voxel-Based Functional Diffusion Map Analysis. , 2013, Translational oncology.

[79]  Daniel L. Rubin,et al.  Managing Biomedical Image Metadata for Search and Retrieval of Similar Images , 2011, Journal of Digital Imaging.

[80]  Paul Nagy,et al.  Benefits of Using the DCM4CHE DICOM Archive , 2007, Journal of Digital Imaging.

[81]  Fernando Boada,et al.  Informatics methods to enable sharing of quantitative imaging research data. , 2012, Magnetic resonance imaging.

[82]  Gerhard Jentzsch,et al.  Working group on , 1991 .

[83]  Daniel L. Rubin,et al.  The caBIG™ Annotation and Image Markup Project , 2009, Journal of Digital Imaging.

[84]  D. Rubin,et al.  Automated tracking of quantitative assessments of tumor burden in clinical trials. , 2014, Translational oncology.

[85]  B. Cheson The International Harmonization Project for response criteria in lymphoma clinical trials. , 2007, Hematology/oncology clinics of North America.

[86]  A. Jackson,et al.  Quantitative imaging biomarkers in the clinical development of targeted therapeutics: current and future perspectives. , 2008, The Lancet. Oncology.

[87]  Eva Segelov,et al.  The North American Neuroendocrine Tumor Society Consensus Guidelines for Surveillance and Medical Management of Midgut Neuroendocrine Tumors , 2017, Pancreas.

[88]  Olivier Gevaert,et al.  Abstract 5561: Radiogenomic analysis indicates MR images are potentially predictive of EGFR mutation status in glioblastoma multiforme , 2012 .

[89]  Gabor Fichtinger,et al.  dcmqi: An Open Source Library for Standardized Communication of Quantitative Image Analysis Results Using DICOM. , 2017, Cancer research.

[90]  R. Munden,et al.  Imaging of the patient with non-small cell lung cancer. , 2005, Radiology.

[91]  Daniel L. Rubin,et al.  A Semantic Image Annotation Model to Enable Integrative Translational Research , 2009, Summit on translational bioinformatics.

[92]  Osman Ratib,et al.  OsiriX: An Open-Source Software for Navigating in Multidimensional DICOM Images , 2004, Journal of Digital Imaging.

[93]  Daniel L. Rubin,et al.  Adaptive local window for level set segmentation of CT and MRI liver lesions , 2016, Medical Image Anal..

[94]  Konstantin Nikolaou,et al.  Visualization, imaging and new preclinical diagnostics in radiation oncology , 2014, Radiation oncology.

[95]  M. Leggas,et al.  Sunitinib malate for the treatment of metastatic renal cell carcinoma and gastrointestinal stromal tumors. , 2007, Clinical therapeutics.

[96]  Peter D. Poullos,et al.  Pancreatic neuroendocrine tumours: hypoenhancement on arterial phase computed tomography predicts biological aggressiveness. , 2014, HPB : the official journal of the International Hepato Pancreato Biliary Association.

[97]  Billy W. Loo,et al.  RT_Image: An Open-Source Tool for Investigating PET in Radiation Oncology , 2007, Technology in cancer research & treatment.

[98]  Richard Pazdur,et al.  End points and United States Food and Drug Administration approval of oncology drugs. , 2003, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[99]  David A Hormuth,et al.  Incorporating drug delivery into an imaging-driven, mechanics-coupled reaction diffusion model for predicting the response of breast cancer to neoadjuvant chemotherapy: theory and preliminary clinical results , 2018, Physics in medicine and biology.