Fully Automated Segmentation Using Distance Regularised Level Set and Deep-Structured Learning and Inference

We introduce a new segmentation methodology that combines the structured output inference from deep belief networks and the delineation from level set methods to produce accurate segmentation of anatomies from medical images. Deep belief networks can be used in the implementation of accurate segmentation models if large annotated training sets are available, but the limited availability of such large datasets in medical image analysis problems motivates the development of methods that can circumvent this demand. In this chapter, we propose the use of level set methods containing several shape and appearance terms, where one of the terms consists of the result from the deep belief network. This combination reduces the demand for large annotated training sets from the deep belief network and at the same time increases the capacity of the level set method to model more effectively the shape and appearance of the visual object of interest. We test our methodology on the Medical Image Computing and Computer Assisted Intervention (MICCAI) 2009 left ventricle segmentation challenge dataset and on Japanese Society of Radiological Technology (JSRT) lung segmentation dataset, where our approach achieves the most accurate results of the field using the semi-automated methodology and state-of-the-art results for the fully automated challenge.

[1]  Daniel Cremers,et al.  Kernel Density Estimation and Intrinsic Alignment for Shape Priors in Level Set Segmentation , 2006, International Journal of Computer Vision.

[2]  Alejandro F. Frangi,et al.  Active shape model segmentation with optimal features , 2002, IEEE Transactions on Medical Imaging.

[3]  Gökhan BakIr,et al.  Predicting Structured Data , 2008 .

[4]  Bram van Ginneken,et al.  Segmentation of anatomical structures in chest radiographs using supervised methods: a comparative study on a public database , 2006, Medical Image Anal..

[5]  Ian R. Fasel,et al.  Deep Belief Networks for Real-Time Extraction of Tongue Contours from Ultrasound During Speech , 2010, 2010 20th International Conference on Pattern Recognition.

[6]  Vladimir Pavlovic,et al.  A graphical model framework for coupling MRFs and deformable models , 2004, CVPR 2004.

[7]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[8]  Alexander Dick,et al.  Segmentation of Left Ventricle in Cardiac Cine MRI: An Automatic Image-Driven Method , 2009, FIMH.

[9]  Dana Cobzas,et al.  Increased discrimination in level set methods with embedded conditional random fields , 2009, CVPR.

[10]  Gustavo Carneiro,et al.  Left ventricle segmentation from cardiac MRI combining level set methods with deep belief networks , 2013, 2013 IEEE International Conference on Image Processing.

[11]  Thomas Hofmann,et al.  Large Margin Methods for Structured and Interdependent Output Variables , 2005, J. Mach. Learn. Res..

[12]  Dimitris N. Metaxas,et al.  CRF-driven Implicit Deformable Model , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  van Hc Hans Assen,et al.  LV Challenge LKEB Contribution: Fully Automated Myocardial Contour Detection , 2009, The MIDAS Journal.

[14]  J M Carreira,et al.  Automatic calculation of total lung capacity from automatically traced lung boundaries in postero-anterior and lateral digital chest radiographs. , 1998, Medical physics.

[15]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[16]  Amer Dawoud,et al.  Lung segmentation in chest radiographs by fusing shape information in iterative thresholding , 2011 .

[17]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Huaifei Hu,et al.  Hybrid segmentation of left ventricle in cardiac MRI using Gaussian-mixture model and region restricted dynamic programming. , 2013, Magnetic resonance imaging.

[19]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .

[20]  Frédérique Frouin,et al.  Fully automated segmentation of the left ventricle applied to cine MR images: Description and results on a database of 45 Subjects , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[21]  Wieslaw Lucjan Nowinski,et al.  An Image-Based Comprehensive Approach for Automatic Segmentation of Left Ventricle from Cardiac Short Axis Cine MR Images , 2011, Journal of Digital Imaging.

[22]  Gustavo Carneiro,et al.  Fully Automated Non-rigid Segmentation with Distance Regularized Level Set Evolution Initialized and Constrained by Deep-Structured Inference , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Gustavo Carneiro,et al.  Lung segmentation in chest radiographs using distance regularized level set and deep-structured learning and inference , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[24]  Yann LeCun,et al.  Scene parsing with Multiscale Feature Learning, Purity Trees, and Optimal Covers , 2012, ICML.

[25]  Dorin Comaniciu,et al.  Database-guided segmentation of anatomical structures with complex appearance , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[26]  Michael Collins,et al.  Discriminative Training Methods for Hidden Markov Models: Theory and Experiments with Perceptron Algorithms , 2002, EMNLP.

[27]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[28]  Caroline Petitjean,et al.  A review of segmentation methods in short axis cardiac MR images , 2011, Medical Image Anal..

[29]  K. Doi,et al.  Development of a digital image database for chest radiographs with and without a lung nodule: receiver operating characteristic analysis of radiologists' detection of pulmonary nodules. , 2000, AJR. American journal of roentgenology.

[30]  Hugues Talbot,et al.  4D Morphological segmentation and the MICCAI LV-segmentation grand challenge , 2009, The MIDAS Journal.

[31]  Paul F. Whelan,et al.  Segmenting the Left Ventricle in 3D Using a Coupled ASM and a Learned Non-Rigid Spatial Model , 2009, The MIDAS Journal.

[32]  Chunming Li,et al.  Distance Regularized Level Set Evolution and Its Application to Image Segmentation , 2010, IEEE Transactions on Image Processing.

[33]  Jiebo Luo,et al.  Shape regularized active contour using iterative global search and local optimization , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[34]  Clement J. McDonald,et al.  Lung Segmentation in Chest Radiographs Using Anatomical Atlases With Nonrigid Registration , 2014, IEEE Transactions on Medical Imaging.

[35]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[36]  Paul Suetens,et al.  Minimal Shape and Intensity Cost Path Segmentation , 2007, IEEE Transactions on Medical Imaging.

[37]  Patrick Clarysse,et al.  A dynamic elastic model for segmentation and tracking of the heart in MR image sequences , 2010, Medical Image Anal..