Hybrid method combining superpixel, random walk and active contour model for fast and accurate liver segmentation

Organ segmentation is an important pre-processing step in surgery planning and computer-aided diagnosis. In this paper, we propose a fast and accurate liver segmentation framework. Our proposed method combines a knowledge-based slice-by-slice Random Walk (RW) segmentation algorithm (proposed in our previous work) with a superpixel algorithm called the Contrast-enhanced Compact Watershed (CCWS) method to reduce computing time and memory costs. Compared to the commonly used Simple Linear Iterative Clustering (SLIC), we demonstrate that our CCWS is more appropriate for liver segmentation. To improve the methods accuracy, we use a modified narrow band active contour model as a refinement after the initial segmentation. The experiments showed that the superpixel-based slice-by-slice RW could segment the entire liver with improved speed, and the modified active contour model is more precise than the original Chan-Vese Model. As a result, the proposed framework is able to quickly and accurately segment the entire liver.

[1]  Leo Grady,et al.  Random Walks for Image Segmentation , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Yen-Wei Chen,et al.  Automated segmentation of the liver from 3D CT images using probabilistic atlas and multilevel statistical shape model. , 2008, Academic radiology.

[3]  Wenxian Yang,et al.  User-Friendly Interactive Image Segmentation Through Unified Combinatorial User Inputs , 2010, IEEE Transactions on Image Processing.

[4]  Fabrice Heitz,et al.  Random forests on hierarchical multi-scale supervoxels for liver tumor segmentation in dynamic contrast-enhanced CT scans , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[5]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[6]  Matthias Kirschner,et al.  Fast automatic liver segmentation combining learned shape priors with observed shape deviation , 2010, 2010 IEEE 23rd International Symposium on Computer-Based Medical Systems (CBMS).

[7]  Shih-Fu Chang,et al.  Learning with Partially Absorbing Random Walks , 2012, NIPS.

[8]  Peer Neubert,et al.  Compact Watershed and Preemptive SLIC: On Improving Trade-offs of Superpixel Segmentation Algorithms , 2014, 2014 22nd International Conference on Pattern Recognition.

[9]  Yihong Gong,et al.  Active contour model based on local and global intensity information for medical image segmentation , 2016, Neurocomputing.

[10]  Ling Shao,et al.  Higher Order Energies for Image Segmentation , 2017, IEEE Transactions on Image Processing.

[11]  Benjamin Perret,et al.  Evaluation of Morphological Hierarchies for Supervised Segmentation , 2015, ISMM.

[12]  Xuelong Li,et al.  Video Supervoxels Using Partially Absorbing Random Walks , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Ling Shao,et al.  Sub-Markov Random Walk for Image Segmentation , 2016, IEEE Transactions on Image Processing.

[14]  Martin Styner,et al.  Comparison and Evaluation of Methods for Liver Segmentation From CT Datasets , 2009, IEEE Transactions on Medical Imaging.

[15]  Yadong Wang,et al.  Shape–intensity prior level set combining probabilistic atlas and probability map constrains for automatic liver segmentation from abdominal CT images , 2016, International Journal of Computer Assisted Radiology and Surgery.

[16]  Sang Uk Lee,et al.  Generative Image Segmentation Using Random Walks with Restart , 2008, ECCV.

[17]  Manuel Desco,et al.  Liver Segmentation and Volume Estimation from Preoperative CT Images in Hepatic Surgical Planning: Application of a Semiautomatic Method Based on 3D Level Sets , 2011 .

[18]  Xinjian Chen,et al.  Automatic Liver Segmentation Based on Shape Constraints and Deformable Graph Cut in CT Images , 2015, IEEE Transactions on Image Processing.

[19]  Yen-Wei Chen,et al.  A knowledge-based interactive liver segmentation using random walks , 2015, 2015 12th International Conference on Fuzzy Systems and Knowledge Discovery (FSKD).

[20]  Leo Grady,et al.  Random walks based multi-image segmentation: Quasiconvexity results and GPU-based solutions , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Ling Shao,et al.  Video Salient Object Detection via Fully Convolutional Networks , 2017, IEEE Transactions on Image Processing.

[22]  Aboul Ella Hassanien,et al.  Region Growing Segmentation with Iterative K-means for CT Liver Images , 2015, 2015 4th International Conference on Advanced Information Technology and Sensor Application (AITS).

[23]  Yen-Wei Chen,et al.  Segmentation of liver and spleen based on computational anatomy models , 2015, Comput. Biol. Medicine.

[24]  Guillermo Sapiro,et al.  Geodesic Active Contours , 1995, International Journal of Computer Vision.

[25]  Jialin Peng,et al.  Automatic 3D liver segmentation based on deep learning and globally optimized surface evolution , 2016, Physics in medicine and biology.

[26]  Hervé Delingette,et al.  Regional appearance modeling based on the clustering of intensity profiles , 2013, Comput. Vis. Image Underst..

[27]  Xuelong Li,et al.  Interactive Segmentation Using Constrained Laplacian Optimization , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[28]  Camille Couprie,et al.  Power Watershed: A Unifying Graph-Based Optimization Framework , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[30]  Kaleem Siddiqi,et al.  Flux Maximizing Geometric Flows , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Ling Shao,et al.  Submodular Trajectories for Better Motion Segmentation in Videos , 2018, IEEE Transactions on Image Processing.

[32]  Yen-Wei Chen,et al.  Simultaneous Segmentation of Multiple Organs Using Random Walks , 2016, J. Inf. Process..

[33]  Serge Beucher,et al.  Use of watersheds in contour detection , 1979 .

[34]  Bastian Leibe,et al.  Superpixels: An evaluation of the state-of-the-art , 2016, Comput. Vis. Image Underst..

[35]  Ling Shao,et al.  Interactive Cosegmentation Using Global and Local Energy Optimization , 2015, IEEE Transactions on Image Processing.

[36]  Fang Lu,et al.  Automatic 3D liver location and segmentation via convolutional neural network and graph cut , 2016, International Journal of Computer Assisted Radiology and Surgery.

[37]  Zhenfeng Zhang,et al.  Superpixel-Based Segmentation for 3D Prostate MR Images , 2016, IEEE Transactions on Medical Imaging.

[38]  Xuelong Li,et al.  Lazy Random Walks for Superpixel Segmentation , 2014, IEEE Transactions on Image Processing.

[39]  Ling Shao,et al.  Real-Time Superpixel Segmentation by DBSCAN Clustering Algorithm , 2016, IEEE Transactions on Image Processing.

[40]  Yen-Wei Chen,et al.  Liver segmentation using superpixel-based graph cuts and restricted regions of shape constrains , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[41]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Gilles Bertrand,et al.  Watershed Cuts: Minimum Spanning Forests and the Drop of Water Principle , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Ross T. Whitaker,et al.  A Level-Set Approach to 3D Reconstruction from Range Data , 1998, International Journal of Computer Vision.

[44]  Leo Grady,et al.  A Seeded Image Segmentation Framework Unifying Graph Cuts And Random Walker Which Yields A New Algorithm , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[45]  Matthias Kirschner,et al.  The Probabilistic Active Shape Model: From Model Construction to Flexible Medical Image Segmentation , 2013 .

[46]  Xuelong Li,et al.  High-Order Energies for Stereo Segmentation , 2016, IEEE Transactions on Cybernetics.

[47]  Zhongwen Hu,et al.  Watershed superpixel , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[48]  Hayit Greenspan,et al.  Fully Convolutional Network for Liver Segmentation and Lesions Detection , 2016, LABELS/DLMIA@MICCAI.

[49]  Yong Yin,et al.  Supervised Variational Model With Statistical Inference and Its Application in Medical Image Segmentation , 2015, IEEE Transactions on Biomedical Engineering.

[50]  Gareth Funka-Lea,et al.  Graph Cuts and Efficient N-D Image Segmentation , 2006, International Journal of Computer Vision.