Multi-objective Parameter Auto-tuning for Tissue Image Segmentation Workflows

We propose a software platform that integrates methods and tools for multi-objective parameter auto-tuning in tissue image segmentation workflows. The goal of our work is to provide an approach for improving the accuracy of nucleus/cell segmentation pipelines by tuning their input parameters. The shape, size, and texture features of nuclei in tissue are important biomarkers for disease prognosis, and accurate computation of these features depends on accurate delineation of boundaries of nuclei. Input parameters in many nucleus segmentation workflows affect segmentation accuracy and have to be tuned for optimal performance. This is a time-consuming and computationally expensive process; automating this step facilitates more robust image segmentation workflows and enables more efficient application of image analysis in large image datasets. Our software platform adjusts the parameters of a nuclear segmentation algorithm to maximize the quality of image segmentation results while minimizing the execution time. It implements several optimization methods to search the parameter space efficiently. In addition, the methodology is developed to execute on high-performance computing systems to reduce the execution time of the parameter tuning phase. These capabilities are packaged in a Docker container for easy deployment and can be used through a friendly interface extension in 3D Slicer. Our results using three real-world image segmentation workflows demonstrate that the proposed solution is able to (1) search a small fraction (about 100 points) of the parameter space, which contains billions to trillions of points, and improve the quality of segmentation output by × 1.20, × 1.29, and × 1.29, on average; (2) decrease the execution time of a segmentation workflow by up to 11.79× while improving output quality; and (3) effectively use parallel systems to accelerate parameter tuning and segmentation phases.

[1]  Andrew Janowczyk,et al.  Automated Tubule Nuclei Quantification and Correlation with Oncotype DX risk categories in ER+ Breast Cancer Whole Slide Images , 2016, Scientific Reports.

[2]  Ernst J. Rummeny,et al.  Intra- and inter-observer variability in measurement of target lesions: implication on response evaluation according to RECIST 1.1 , 2012, Radiology and oncology.

[3]  Nikolaos V. Sahinidis,et al.  Derivative-free optimization: a review of algorithms and comparison of software implementations , 2013, J. Glob. Optim..

[4]  L. Paquete,et al.  Easy to say they are Hard, but Hard to see they are Easy— Towards a Categorization of Tractable Multiobjective Combinatorial Optimization Problems , 2017 .

[5]  Joel H. Saltz,et al.  Hadoop-GIS: A High Performance Spatial Data Warehousing System over MapReduce , 2013, Proc. VLDB Endow..

[6]  Iver Petersen,et al.  Interobserver variability in the application of the novel IASLC/ATS/ERS classification for pulmonary adenocarcinomas , 2012, European Respiratory Journal.

[7]  Andrew H. Beck,et al.  Systematic Analysis of Breast Cancer Morphology Uncovers Stromal Features Associated with Survival , 2011, Science Translational Medicine.

[8]  Dirk Merkel,et al.  Docker: lightweight Linux containers for consistent development and deployment , 2014 .

[9]  Philipp J. Keller,et al.  Whole-brain functional imaging at cellular resolution using light-sheet microscopy , 2013, Nature Methods.

[10]  Kaisa Miettinen,et al.  On scalarizing functions in multiobjective optimization , 2002, OR Spectr..

[11]  S D Greenberg,et al.  Lung cancer heterogeneity: a blinded and randomized study of 100 consecutive cases. , 1985, Human pathology.

[12]  Max D. Morris,et al.  Factorial sampling plans for preliminary computational experiments , 1991 .

[13]  Jiong Wu,et al.  Molecular subtype can predict the response and outcome of Chinese locally advanced breast cancer patients treated with preoperative therapy. , 2010, Oncology reports.

[14]  Lars Egevad,et al.  The reasons behind variation in Gleason grading of prostatic biopsies: areas of agreement and misconception among 266 European pathologists , 2014, Histopathology.

[15]  Donald R. Jones,et al.  A Taxonomy of Global Optimization Methods Based on Response Surfaces , 2001, J. Glob. Optim..

[16]  Todd H. Stokes,et al.  Pathology imaging informatics for quantitative analysis of whole-slide images , 2013, Journal of the American Medical Informatics Association : JAMIA.

[17]  Thomas Fahringer,et al.  A multi-objective auto-tuning framework for parallel codes , 2012, 2012 International Conference for High Performance Computing, Networking, Storage and Analysis.

[18]  George Lee,et al.  Evaluating stability of histomorphometric features across scanner and staining variations: predicting biochemical recurrence from prostate cancer whole slide images , 2016, SPIE Medical Imaging.

[19]  Joel H. Saltz,et al.  Hierarchical nucleus segmentation in digital pathology images , 2016, SPIE Medical Imaging.

[20]  A. Madabhushi,et al.  Histopathological Image Analysis: A Review , 2009, IEEE Reviews in Biomedical Engineering.

[21]  May D. Wang,et al.  Biomedical imaging informatics in the era of precision medicine: progress, challenges, and opportunities , 2013, J. Am. Medical Informatics Assoc..

[22]  Ce Zhang,et al.  Predicting non-small cell lung cancer prognosis by fully automated microscopic pathology image features , 2016, Nature Communications.

[23]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[24]  Thomas Schultz,et al.  Open-Box Spectral Clustering: Applications to Medical Image Analysis , 2013, IEEE Transactions on Visualization and Computer Graphics.

[25]  Jérémie Bourdon,et al.  A multi-objective constraint-based approach for modeling genome-scale microbial ecosystems , 2017, PloS one.

[26]  Joel H. Saltz,et al.  Machine-Based Morphologic Analysis of Glioblastoma Using Whole-Slide Pathology Images Uncovers Clinically Relevant Molecular Correlates , 2013, PloS one.

[27]  Vahid Tabatabaee,et al.  Parallel Parameter Tuning for Applications with Performance Variability , 2005, ACM/IEEE SC 2005 Conference (SC'05).

[28]  Peter J Campbell,et al.  Bone marrow pathology in essential thrombocythemia: interobserver reliability and utility for identifying disease subtypes. , 2008, Blood.

[29]  Martial Hebert,et al.  Discriminative random fields: a discriminative framework for contextual interaction in classification , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[30]  Christopher R. Cabanski,et al.  Validation of interobserver agreement in lung cancer assessment: hematoxylin-eosin diagnostic reproducibility for non-small cell lung cancer: the 2004 World Health Organization classification and therapeutically relevant subsets. , 2013, Archives of pathology & laboratory medicine.

[31]  Yi Gao,et al.  Algorithm sensitivity analysis and parameter tuning for tissue image segmentation pipelines , 2017, Bioinform..

[32]  Andrea Saltelli,et al.  An effective screening design for sensitivity analysis of large models , 2007, Environ. Model. Softw..

[33]  Kaisa Miettinen,et al.  Nonlinear multiobjective optimization , 1998, International series in operations research and management science.

[34]  Derek Hoiem,et al.  Learning CRFs Using Graph Cuts , 2008, ECCV.

[35]  A. Gazdar,et al.  Interobserver variability in histopathologic subtyping and grading of pulmonary adenocarcinoma , 1993, Cancer.

[36]  Peter J. Fleming,et al.  Preference-Inspired Coevolutionary Algorithms for Many-Objective Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[37]  Jimeng Sun,et al.  Trends in biomedical informatics: automated topic analysis of JAMIA articles , 2015, J. Am. Medical Informatics Assoc..

[38]  Milan Sonka,et al.  3D Slicer as an image computing platform for the Quantitative Imaging Network. , 2012, Magnetic resonance imaging.

[39]  Jasper Snoek,et al.  Practical Bayesian Optimization of Machine Learning Algorithms , 2012, NIPS.

[40]  Peter Bankhead,et al.  QuPath: Open source software for digital pathology image analysis , 2017, Scientific Reports.

[41]  Akiko Miyagi Maeshima,et al.  Interobserver Agreement in the Nuclear Grading of Primary Pulmonary Adenocarcinoma , 2013, Journal of thoracic oncology : official publication of the International Association for the Study of Lung Cancer.

[42]  Hans-Peter Kriegel,et al.  The R*-tree: an efficient and robust access method for points and rectangles , 1990, SIGMOD '90.

[43]  Soon Ho Yoon,et al.  Observer variability in RECIST-based tumour burden measurements: a meta-analysis. , 2016, European journal of cancer.

[44]  Arthur T. Johnson,et al.  Quantitative comparison of immunohistochemical staining measured by digital image analysis versus pathologist visual scoring , 2012, Diagnostic Pathology.

[45]  J. Epstein,et al.  Interobserver reproducibility of Gleason grading of prostatic carcinoma: general pathologist. , 2001, Human pathology.

[46]  Joel H. Saltz,et al.  Scalable analysis of Big pathology image data cohorts using efficient methods and high-performance computing strategies , 2015, BMC Bioinformatics.

[47]  Jun Kong,et al.  Computer-aided prognosis of neuroblastoma on whole-slide images: Classification of stromal development , 2009, Pattern Recognit..

[48]  Jun Kong,et al.  Integrated morphologic analysis for the identification and characterization of disease subtypes , 2012, J. Am. Medical Informatics Assoc..

[49]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems (Genetic and Evolutionary Computation) , 2006 .

[50]  Allan Hanbury,et al.  Metrics for evaluating 3D medical image segmentation: analysis, selection, and tool , 2015, BMC Medical Imaging.

[51]  Bruno Sareni,et al.  Fitness sharing and niching methods revisited , 1998, IEEE Trans. Evol. Comput..

[52]  Gary B. Lamont,et al.  Evolutionary algorithms for solving multi-objective problems, Second Edition , 2007, Genetic and evolutionary computation series.

[53]  Andrew D. Zelenetz,et al.  Expert Second Opinion Pathology Review of Lymphoma in the Era of the World Health Organization Classification. , 2007 .

[54]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[55]  Lassi Paavolainen,et al.  Systems pathology by multiplexed immunohistochemistry and whole-slide digital image analysis , 2017, Scientific Reports.

[56]  Ghassan Hamarneh,et al.  Is a Single Energy Functional Sufficient? Adaptive Energy Functionals and Automatic Initialization , 2007, MICCAI.

[57]  Jun Kong,et al.  Region Templates: Data Representation and Management for Large-Scale Image Analysis , 2014, ArXiv.

[58]  Hans-Christian Hege,et al.  Tuner: Principled Parameter Finding for Image Segmentation Algorithms Using Visual Response Surface Exploration , 2011, IEEE Transactions on Visualization and Computer Graphics.

[59]  Jun Kong,et al.  Comparative Performance Analysis of Intel (R) Xeon Phi (TM), GPU, and CPU: A Case Study from Microscopy Image Analysis , 2014, 2014 IEEE 28th International Parallel and Distributed Processing Symposium.

[60]  Jonathan I. Epstein,et al.  Interobserver variability in histologic evaluation of radical prostatectomy between central and local pathologists: findings of TAX 3501 multinational clinical trial. , 2011, Urology.

[61]  Jun Kong,et al.  Parallel and Efficient Sensitivity Analysis of Microscopy Image Segmentation Workflows in Hybrid Systems , 2017, 2017 IEEE International Conference on Cluster Computing (CLUSTER).

[62]  Dipti Srinivasan,et al.  A Survey of Multiobjective Evolutionary Algorithms Based on Decomposition , 2017, IEEE Transactions on Evolutionary Computation.

[63]  Ralf Palmisano,et al.  Approaches to automatic parameter fitting in a microscopy image segmentation pipeline: An exploratory parameter space analysis , 2013, Journal of pathology informatics.

[64]  M. J. van de Vijver,et al.  The impact of inter-observer variation in pathological assessment of node-negative breast cancer on clinical risk assessment and patient selection for adjuvant systemic treatment. , 2010, Annals of oncology : official journal of the European Society for Medical Oncology.