Interactive Lesion Segmentation with Shape Priors From Offline and Online Learning

In medical image segmentation, tumors and other lesions demand the highest levels of accuracy but still call for the highest levels of manual delineation. One factor holding back automatic segmentation is the exemption of pathological regions from shape modelling techniques that rely on high-level shape information not offered by lesions. This paper introduces two new statistical shape models (SSMs) that combine radial shape parameterization with machine learning techniques from the field of nonlinear time series analysis. We then develop two dynamic contour models (DCMs) using the new SSMs as shape priors for tumor and lesion segmentation. From training data, the SSMs learn the lower level shape information of boundary fluctuations, which we prove to be nevertheless highly discriminant. One of the new DCMs also uses online learning to refine the shape prior for the lesion of interest based on user interactions. Classification experiments reveal superior sensitivity and specificity of the new shape priors over those previously used to constrain DCMs. User trials with the new interactive algorithms show that the shape priors are directly responsible for improvements in accuracy and reductions in user demand.

[1]  Purang Abolmaesumi,et al.  Prostate Cancer Probability Maps Based on Ultrasound RF Time Series and SVM Classifiers , 2008, MICCAI.

[2]  Abhinanda Sarkar,et al.  Shape Description by Time Series , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  A. H. Mir,et al.  Description of shapes in CT images. The usefulness of time-series modeling techniques for identifying organs , 1999, IEEE Engineering in Medicine and Biology Magazine.

[4]  Daniel P. Huttenlocher,et al.  Comparing Images Using the Hausdorff Distance , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  D. Drasdo,et al.  Individual cell‐based models of the spatial‐temporal organization of multicellular systems—Achievements and limitations , 2006, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[6]  D. Drasdo,et al.  A single-cell-based model of tumor growth in vitro: monolayers and spheroids , 2005, Physical biology.

[7]  M Reza Rahimi Tabar,et al.  Stochastic analysis and regeneration of rough surfaces. , 2003, Physical review letters.

[8]  José M. N. Leitão,et al.  Wall position and thickness estimation from sequences of echocardiographic images , 1996, IEEE Trans. Medical Imaging.

[9]  H. Risken The Fokker-Planck equation : methods of solution and applications , 1985 .

[10]  Daniel Rueckert,et al.  Medical Image Computing and Computer-Assisted Intervention − MICCAI 2017: 20th International Conference, Quebec City, QC, Canada, September 11-13, 2017, Proceedings, Part II , 2017, Lecture Notes in Computer Science.

[11]  Cornelis H. Slump,et al.  Multiple Sclerosis Detection in Multispectral Magnetic Resonance Images with Principal Components Analysis. , 2008, The MIDAS Journal.

[12]  Carlos Alberola,et al.  A Bayesian Approach to in vivo Kidney Ultrasound Contour Detection Using Markov Random Fields , 2002 .

[13]  D. Mackay,et al.  Introduction to Gaussian processes , 1998 .

[14]  Patrick Pérez,et al.  JetStream: probabilistic contour extraction with particles , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[15]  P J Beek,et al.  Fokker-Planck perspective on stochastic delay systems: exact solutions and data analysis of biological systems. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[16]  C. Taylor,et al.  Active shape models - 'Smart Snakes'. , 1992 .

[17]  Bart De Dobbelaer,et al.  Segmentation of Liver Metastases Using a Level Set Method with Spiral-Scanning Technique and Supervised Fuzzy Pixel Classification , 2008, The MIDAS Journal.

[18]  Yang He,et al.  2-D Shape Classification Using Hidden Markov Model , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  L. R. Dice Measures of the Amount of Ecologic Association Between Species , 1945 .

[20]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[21]  Jiang Liu,et al.  Semi-automatic Segmentation of 3D Liver Tumors from CT Scans Using Voxel Classification and Propagational Learning , 2008, The MIDAS Journal.

[22]  D.L. Plummer,et al.  DispImage: Un mezzo di analisi e presentazione per iconografia medica , 1992 .

[23]  R. Engelmann,et al.  Segmentation of pulmonary nodules in three-dimensional CT images by use of a spiral-scanning technique. , 2007, Medical physics.

[24]  Daniel Cremers,et al.  Fast Matching of Planar Shapes in Sub-cubic Runtime , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[25]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[26]  J. Swets ROC analysis applied to the evaluation of medical imaging techniques. , 1979, Investigative radiology.

[27]  Z. Tu,et al.  Automatic Segmentation of MS Lesions Using a Contextual Model for the MICCAI Grand Challenge , 2008, The MIDAS Journal.

[28]  Jean Stawiaski,et al.  Interactive Liver Tumor Segmentation Using Graph-cuts and Watershed , 2008, The MIDAS Journal.

[29]  Kiyosi Itô Stochastic Differential Equations , 2018, The Control Systems Handbook.

[30]  P. Bazin,et al.  Multiple Sclerosis Lesion Segmentation Using Statistical and Topological Atlases , 2008, The MIDAS Journal.

[31]  D. Drasdo,et al.  A Monte-Carlo Approach to Growing Solid Non-Vascular Tumors , 1998 .

[32]  Radford M. Neal Monte Carlo Implementation of Gaussian Process Models for Bayesian Regression and Classification , 1997, physics/9701026.

[33]  Susan M. Astley,et al.  Statistical Appearance Models of Mammographic Masses , 2008, Digital Mammography / IWDM.

[34]  Moumita Das,et al.  Statistical signal modeling techniques for automated recognition of water-borne microbial shapes , 1996, Proceedings of the 39th Midwest Symposium on Circuits and Systems.

[35]  Wei Xiong,et al.  Semi-automatic Segmentation of Liver Tumors from CT Scans Using Bayesian Rule-based 3 D Region Growing , 2008 .

[36]  Azriel Rosenfeld,et al.  Compact Object Recognition Using Energy-Function-Based Optimization , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  Jan Raethjen,et al.  Extracting model equations from experimental data , 2000 .

[38]  M. Horsfield,et al.  Quantitative assessment of MRI lesion load in monitoring the evolution of multiple sclerosis. , 1995, Brain : a journal of neurology.

[39]  Tony Shepherd,et al.  Dynamical models and machine learning for supervised segmentation , 2009 .

[40]  Yrjö Häme Liver Tumor Segmentation Using Implicit Surface Evolution , 2008 .

[41]  Christian Barillot,et al.  A robust Expectation-Maximization algorithm for Multiple Sclerosis lesion segmentation , 2008, The MIDAS Journal.

[42]  Philip N. Klein,et al.  On Aligning Curves , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[43]  Daniel Cremers,et al.  Shape priors in variational image segmentation: Convexity, Lipschitz continuity and globally optimal solutions , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[44]  Mário A. T. Figueiredo,et al.  Bayesian estimation of ventricular contours in angiographic images , 1992, IEEE Trans. Medical Imaging.

[45]  Rama Chellappa,et al.  Stochastic models for closed boundary analysis: Representation and reconstruction , 1981, IEEE Trans. Inf. Theory.

[46]  G. Gerig,et al.  Automatic MS Lesion Segmentation by Outlier Detection and Information Theoretic Region Partitioning , 2008, The MIDAS Journal.

[47]  Timothy F. Cootes,et al.  A minimum description length approach to statistical shape modeling , 2002, IEEE Transactions on Medical Imaging.

[48]  Anil K. Jain,et al.  A modified Hausdorff distance for object matching , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[49]  B. Ginneken,et al.  3D Segmentation in the Clinic: A Grand Challenge , 2007 .

[50]  Maria Athelogou,et al.  Cognition Network Technology for a Fully Automated 3D Segmentation of Liver , 2007 .

[51]  Grégoire Malandain,et al.  An Automatic Segmentation of T2-FLAIR Multiple Sclerosis Lesions , 2008, The MIDAS Journal.

[52]  Christophe Collet,et al.  MS Lesion Segmentation based on Hidden Markov Chains , 2008, The MIDAS Journal.

[53]  F O'Sullivan,et al.  Incorporation of tumor shape into an assessment of spatial heterogeneity for human sarcomas imaged with FDG-PET. , 2005, Biostatistics.

[54]  Moses Rodriguez,et al.  Distinct Patterns of Multiple Sclerosis Pathology Indicates Heterogeneity in Pathogenesis , 1996, Brain pathology.

[55]  Jerry L. Prince,et al.  Gradient vector flow: a new external force for snakes , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[56]  Bart De Dobbelaer,et al.  Semi-automatic level set segmentation of liver tumors combining a spiral-scanning technique with supervised fuzzy pixel classification , 2010, Medical Image Anal..

[57]  Gregory C Sharp,et al.  A review of image-guided radiotherapy , 2009, Radiological physics and technology.