Rapid development of image analysis research tools: Bridging the gap between researcher and clinician with pyOsiriX

We present pyOsiriX, a plugin built for the already popular dicom viewer OsiriX that provides users the ability to extend the functionality of OsiriX through simple Python scripts. This approach allows users to integrate the many cutting-edge scientific/image-processing libraries created for Python into a powerful DICOM visualisation package that is intuitive to use and already familiar to many clinical researchers. Using pyOsiriX we hope to bridge the apparent gap between basic imaging scientists and clinical practice in a research setting and thus accelerate the development of advanced clinical image processing. We provide arguments for the use of Python as a robust scripting language for incorporation into larger software solutions, outline the structure of pyOsiriX and how it may be used to extend the functionality of OsiriX, and we provide three case studies that exemplify its utility. For our first case study we use pyOsiriX to provide a tool for smooth histogram display of voxel values within a user-defined region of interest (ROI) in OsiriX. We used a kernel density estimation (KDE) method available in Python using the scikit-learn library, where the total number of lines of Python code required to generate this tool was 22. Our second example presents a scheme for segmentation of the skeleton from CT datasets. We have demonstrated that good segmentation can be achieved for two example CT studies by using a combination of Python libraries including scikit-learn, scikit-image, SimpleITK and matplotlib. Furthermore, this segmentation method was incorporated into an automatic analysis of quantitative PET-CT in a patient with bone metastases from primary prostate cancer. This enabled repeatable statistical evaluation of PET uptake values for each lesion, before and after treatment, providing estaimes maximum and median standardised uptake values (SUVmax and SUVmed respectively). Following treatment we observed a reduction in lesion volume, SUVmax and SUVmed for all lesions, in agreement with a reduction in concurrent measures of serum prostate-specific antigen (PSA).

[1]  Osman Ratib,et al.  General Consumer Communication Tools for Improved Image Management and Communication in Medicine , 2005, Journal of Digital Imaging.

[2]  Davide Fontanarosa,et al.  Review of ultrasound image guidance in external beam radiotherapy: I. Treatment planning and inter-fraction motion management , 2015, Physics in medicine and biology.

[3]  M. Rosenblatt.  Remarks on Some Nonparametric Estimates of a Density Function , 1956 .

[4]  John D. Hunter,et al.  Matplotlib: A 2D Graphics Environment , 2007, Computing in Science & Engineering.

[5]  Milan Sonka,et al.  3D Slicer as an image computing platform for the Quantitative Imaging Network. , 2012, Magnetic resonance imaging.

[6]  Y. Assaf,et al.  Diffusion Tensor Imaging (DTI)-based White Matter Mapping in Brain Research: A Review , 2007, Journal of Molecular Neuroscience.

[7]  P Videbech,et al.  PET measurements of brain glucose metabolism and blood flow in major depressive disorder: a critical review , 2000, Acta psychiatrica Scandinavica.

[8]  Sue Chua,et al.  18F-fluoride PET: changes in uptake as a method to assess response in bone metastases from castrate-resistant prostate cancer patients treated with 223Ra-chloride (Alpharadin) , 2011, EJNMMI research.

[9]  Travis E. Oliphant,et al.  Python for Scientific Computing , 2007, Computing in Science & Engineering.

[10]  A. Rutman,et al.  Radiogenomics: creating a link between molecular diagnostics and diagnostic imaging. , 2009, European journal of radiology.

[11]  D. Pennell,et al.  Cardiovascular magnetic resonance , 2001, Heart.

[12]  Yan Kang,et al.  A new accurate and precise 3-D segmentation method for skeletal structures in volumetric CT data , 2003, IEEE Transactions on Medical Imaging.

[13]  Bernd J. Pichler,et al.  PET/MRI hybrid imaging: devices and initial results , 2008, European Radiology.

[14]  T. Peabody,et al.  Staging of bone tumors: a review with illustrative examples. , 2006, AJR. American journal of roentgenology.

[15]  Bernd J Pichler,et al.  Multimodal imaging approaches: PET/CT and PET/MRI. , 2008, Handbook of experimental pharmacology.

[16]  Sim Heng Ong,et al.  Fast segmentation of bone in CT images using 3D adaptive thresholding , 2010, Comput. Biol. Medicine.

[17]  D. Collins,et al.  Computed diffusion-weighted MR imaging may improve tumor detection. , 2011, Radiology.

[18]  Ciprian Catana,et al.  Simultaneous PET-MRI: a new approach for functional and morphological imaging , 2008, Nature Medicine.

[19]  Tianhu Lei,et al.  Statistical approach to X-ray CT imaging and its applications in image analysis. I. Statistical analysis of X-ray CT imaging , 1992, IEEE Trans. Medical Imaging.

[20]  Ferenc A. Jolesz,et al.  Radiogenomic Mapping of Edema/Cellular Invasion MRI-Phenotypes in Glioblastoma Multiforme , 2011, PloS one.

[21]  D. Collins,et al.  Whole-body diffusion-weighted MR imaging in cancer: current status and research directions. , 2011, Radiology.

[22]  Osman Ratib,et al.  OsiriX: An Open-Source Software for Navigating in Multidimensional DICOM Images , 2004, Journal of Digital Imaging.

[23]  M Van Glabbeke,et al.  New guidelines to evaluate the response to treatment in solid tumors. European Organization for Research and Treatment of Cancer, National Cancer Institute of the United States, National Cancer Institute of Canada. , 2000, Journal of the National Cancer Institute.

[24]  J Kotzerke,et al.  Sensitivity in detecting osseous lesions depends on anatomic localization: planar bone scintigraphy versus 18F PET. , 1999, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[25]  T. Villines,et al.  Prognostic value of cardiac computed tomography angiography: a systematic review and meta-analysis. , 2011, Journal of the American College of Cardiology.

[26]  A. Alavi,et al.  PET/MR imaging: technical aspects and potential clinical applications. , 2013, Radiology.

[27]  M. Cerqueira,et al.  Standardized myocardial segmentation and nomenclature for tomographic imaging of the heart: A statement for healthcare professionals from the Cardiac Imaging Committee of the Council on Clinical Cardiology of the American Heart Association , 2002, The international journal of cardiovascular imaging.

[28]  Kyle J Myers,et al.  Quantitative imaging biomarkers: A review of statistical methods for computer algorithm comparisons , 2014, Statistical methods in medical research.

[29]  D. Collins,et al.  Assessment of Treatment Response by Total Tumor Volume and Global Apparent Diffusion Coefficient Using Diffusion-Weighted MRI in Patients with Metastatic Bone Disease: A Feasibility Study , 2014, PloS one.

[30]  M. Cerqueira,et al.  Standardized myocardial segmentation and nomenclature for tomographic imaging of the heart. A statement for healthcare professionals from the Cardiac Imaging Committee of the Council on Clinical Cardiology of the American Heart Association. , 2002, Circulation.

[31]  Thomas C. Kwee,et al.  Combined FDG-PET/CT for the detection of unknown primary tumors: systematic review and meta-analysis , 2008, European Radiology.

[32]  Eric Jones,et al.  SciPy: Open Source Scientific Tools for Python , 2001 .

[33]  M. van Glabbeke,et al.  New guidelines to evaluate the response to treatment in solid tumors , 2000, Journal of the National Cancer Institute.

[34]  A. Alexander,et al.  Diffusion tensor imaging of the brain , 2007, Neurotherapeutics.

[35]  K. Jarrod Millman,et al.  Python for Scientists and Engineers , 2011, Comput. Sci. Eng..

[36]  Astrid Langer,et al.  A systematic review of PET and PET/CT in oncology: A way to personalize cancer treatment in a cost-effective manner? , 2010, BMC health services research.

[37]  M. Blau,et al.  Fluorine-18: a new isotope for bone scanning. , 1962, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[38]  P. Lambin,et al.  Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach , 2014, Nature Communications.

[39]  E. Parzen.  On Estimation of a Probability Density Function and Mode , 1962 .

[40]  Steven C. Horii,et al.  Review: Understanding and Using DICOM, the Data Interchange Standard for Biomedical Imaging , 1997, J. Am. Medical Informatics Assoc..

[41]  B. Sobel,et al.  Cardiac Positron Emission Tomography , 1996, Developments in Cardiovascular Medicine.

[42]  Mithat Gönen,et al.  Quantitative imaging biomarkers: A review of statistical methods for technical performance assessment , 2015, Statistical methods in medical research.

[43]  Antoine Rosset,et al.  Informatics in radiology (infoRAD): navigating the fifth dimension: innovative interface for multidimensional multimodality image navigation. , 2006, Radiographics : a review publication of the Radiological Society of North America, Inc.

[44]  Larry S. Davis,et al.  Efficient Kernel Density Estimation Using the Fast Gauss Transform with Applications to Color Modeling and Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[45]  良治 祐延,et al.  DICOM Digital Imaging and Communications in Medicine, ダイコム , 2003 .

[46]  Sarah L Kerns,et al.  Radiogenomics: using genetics to identify cancer patients at risk for development of adverse effects following radiotherapy. , 2014, Cancer discovery.

[47]  Beat Schmutz,et al.  Effects of CT image segmentation methods on the accuracy of long bone 3D reconstructions. , 2011, Medical engineering & physics.

[48]  H. Barnhart,et al.  The emerging science of quantitative imaging biomarkers terminology and definitions for scientific studies and regulatory submissions , 2015, Statistical methods in medical research.

[49]  John C Waterton,et al.  Qualification of imaging biomarkers for oncology drug development. , 2012, European journal of cancer.

[50]  Andre Dekker,et al.  Radiomics: the process and the challenges. , 2012, Magnetic resonance imaging.

[51]  T Lei,et al.  Statistical approach to X-ray CT imaging and its applications in image analysis. II. A new stochastic model-based image segmentation technique for X-ray CT image , 1992, IEEE Trans. Medical Imaging.

[52]  Baris Turkbey,et al.  Review of functional/anatomical imaging in oncology , 2012, Nuclear medicine communications.

[53]  Eyal Mishani,et al.  Assessment of malignant skeletal disease: initial experience with 18F-fluoride PET/CT and comparison between 18F-fluoride PET and 18F-fluoride PET/CT. , 2004, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[54]  Emmanuelle Gouillart,et al.  scikit-image: image processing in Python , 2014, PeerJ.

[55]  Martin O. Leach,et al.  Reproducibility and changes in the apparent diffusion coefficients of solid tumours treated with combretastatin A4 phosphate and bevacizumab in a two-centre phase I clinical trial , 2009, European Radiology.

[56]  A R Padhani,et al.  Screening with magnetic resonance imaging and mammography of a UK population at high familial risk of breast cancer: a prospective multicentre cohort study (MARIBS) , 2005, The Lancet.

[57]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[58]  N. Logothetis.  What we can do and what we cannot do with fMRI , 2008, Nature.

[59]  S. Millington,et al.  Point of Care Cardiac Ultrasound Applications in the Emergency Department and Intensive Care Unit - A Review , 2012, Current cardiology reviews.

[60]  James D. Thomas,et al.  3D echocardiography: a review of the current status and future directions. , 2007, Journal of the American Society of Echocardiography : official publication of the American Society of Echocardiography.

[61]  Michael J Ackerman,et al.  Engineering and algorithm design for an image processing Api: a technical report on ITK--the Insight Toolkit. , 2002, Studies in health technology and informatics.

[62]  Martin O. Leach,et al.  The utility of whole-body diffusion-weighted MRI for delineating regions of interest in PET , 2013 .

[63]  Patrick Granton,et al.  Radiomics: extracting more information from medical images using advanced feature analysis. , 2012, European journal of cancer.

[64]  L. Schwartz,et al.  New response evaluation criteria in solid tumours: revised RECIST guideline (version 1.1). , 2009, European journal of cancer.

[65]  Gaël Varoquaux,et al.  The NumPy Array: A Structure for Efficient Numerical Computation , 2011, Computing in Science & Engineering.

[66]  L. Fass.  Imaging and cancer: A review , 2008, Molecular oncology.

[67]  Howard Y. Chang,et al.  Decoding global gene expression programs in liver cancer by noninvasive imaging , 2007, Nature Biotechnology.

[68]  U. Metser,et al.  The detection of bone metastases in patients with high-risk prostate cancer: 99mTc-MDP Planar bone scintigraphy, single- and multi-field-of-view SPECT, 18F-fluoride PET, and 18F-fluoride PET/CT. , 2006, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[69]  David Huard,et al.  PyMC: Bayesian Stochastic Modelling in Python. , 2010, Journal of statistical software.