Efficient interactive 3D Livewire segmentation of complex objects with arbitrary topology

We present a novel interactive method based on a 3D Livewire approach for segmenting complex objects of arbitrary topologies. Our proposed technique automatically and seamlessly handles objects with branchings, concavities, protrusions, and non-spherical topologies with minimal user-input. Given sparse interactively segmented contours on orthogonal slices, our proposed method determines Livewire seedpoints on all slices in the third orthogonal direction, which are used to mimic user-guided segmentation. In doing so, our method pre-processes these points to increase algorithm robustness, and uses a novel seedpoint sorting method using ideas from L-system's Turtle algorithm. Moreover, we present a segmentation tool based on our proposed framework and demonstrate the robustness of our approach on real medical data. Results highlight the superior performance of the proposed method with validation tests on synthetic and real MRI and CT data, with segmentation reproducibility exceeding 95% and segmentation task time decreasing to less than 20% when compared to performing 2D Livewire on each volume slice.

[1]  Jacques-Olivier Lachaud,et al.  Deformable meshes with automated topology changes for coarse-to-fine three-dimensional surface extraction , 1999, Medical Image Anal..

[2]  S. Osher,et al.  Implicit, Nonparametric Shape Reconstruction from Unorganized Points Using A Variational Level Set M , 1998 .

[3]  Hervé Delingette,et al.  General Object Reconstruction Based on Simplex Meshes , 1999, International Journal of Computer Vision.

[4]  Edsger W. Dijkstra,et al.  A note on two problems in connexion with graphs , 1959, Numerische Mathematik.

[5]  S. Osher,et al.  Geometric Level Set Methods in Imaging, Vision, and Graphics , 2011, Springer New York.

[6]  Johan Montagnat,et al.  A review of deformable surfaces: topology, geometry and deformation , 2001, Image Vis. Comput..

[7]  Ghassan Hamarneh,et al.  Segmentation of complex objects with non-spherical topologies from volumetric medical images using 3D livewire , 2007, SPIE Medical Imaging.

[8]  A. Ardeshir Goshtasby,et al.  Approximating Digital 3D Shapes by Rational Gaussian Surfaces , 2003, IEEE Trans. Vis. Comput. Graph..

[9]  Sung Yong Shin,et al.  Enhanced lane: interactive image segmentation by incremental path map construction , 2002, Graph. Model..

[10]  J. Sethian Level set methods : evolving interfaces in geometry, fluid mechanics, computer vision, and materials science , 1996 .

[11]  Taku Komura,et al.  Topology matching for fully automatic similarity estimation of 3D shapes , 2001, SIGGRAPH.

[12]  Martin Rumpf,et al.  Level set segmentation in graphics hardware , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[13]  Ghassan Hamarneh,et al.  3D live-wire-based semi-automatic segmentation of medical images , 2005, SPIE Medical Imaging.

[14]  Yan Kang,et al.  Interactive 3D editing tools for image segmentation , 2004, Medical Image Anal..

[15]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[16]  Heinz-Otto Peitgen,et al.  Local-cost computation for efficient segmentation of 3D objects with live wire , 2001, SPIE Medical Imaging.

[17]  Martin Urschler,et al.  The Live Wire Approach for the Segmentation of Left Ventricle Electron-Beam CT Images , 2002 .

[18]  Stanley Osher,et al.  Level Set Methods , 2003 .

[19]  M J Ackerman,et al.  The Visible Human Project , 1998, Proc. IEEE.

[20]  Alexandre X. Falcão,et al.  Interactive volume segmentation with differential image foresting transforms , 2004, IEEE Transactions on Medical Imaging.

[21]  William A. Barrett,et al.  Interactive live-wire boundary extraction , 1997, Medical Image Anal..

[22]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Demetri Terzopoulos,et al.  Deformable models in medical image analysis: a survey , 1996, Medical Image Anal..

[24]  Jayaram K. Udupa,et al.  A 3D generalization of user-steered live-wire segmentation , 2000, Medical Image Anal..

[25]  James F. O'Brien,et al.  Shape transformation using variational implicit functions , 1999, SIGGRAPH Courses.

[26]  Jayaram K. Udupa,et al.  An ultra-fast user-steered image segmentation paradigm: live wire on the fly , 2000, IEEE Transactions on Medical Imaging.

[27]  Arnold W. M. Smeulders,et al.  Interaction in the segmentation of medical images: A survey , 2001, Medical Image Anal..

[28]  Ghassan Hamarneh,et al.  Color lesion boundary detection using live wire , 2005, SPIE Medical Imaging.

[29]  William E. Higgins,et al.  Improved 3D live-wire method with application to 3D CT chest image analysis , 2006, SPIE Medical Imaging.

[30]  Heinz-Otto Peitgen,et al.  Efficient Semiautomatic Segmentation of 3D Objects in Medical Images , 2000, MICCAI.

[31]  Guillermo Sapiro,et al.  Geodesic Active Contours , 1995, International Journal of Computer Vision.

[32]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[33]  Tony DeRose,et al.  Surface reconstruction from unorganized points , 1992, SIGGRAPH.

[34]  Demetri Terzopoulos,et al.  United Snakes , 1999, Medical Image Anal..

[35]  Demetri Terzopoulos,et al.  T-snakes: Topology adaptive snakes , 2000, Medical Image Anal..

[36]  Leo Grady,et al.  Random Walks for Image Segmentation , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Jayaram K. Udupa,et al.  User-Steered Image Segmentation Paradigms: Live Wire and Live Lane , 1998, Graph. Model. Image Process..

[38]  Gareth Funka-Lea,et al.  Graph Cuts and Efficient N-D Image Segmentation , 2006, International Journal of Computer Vision.

[39]  Jayaram K. Udupa,et al.  Iterative live wire and live snake: new user-steered 3D image segmentation paradigms , 2006, SPIE Medical Imaging.

[40]  Stanley Osher,et al.  Implicit and Nonparametric Shape Reconstruction from Unorganized Data Using a Variational Level Set Method , 2000, Comput. Vis. Image Underst..

[41]  Xavier Bresson,et al.  Fast Global Minimization of the Active Contour/Snake Model , 2007, Journal of Mathematical Imaging and Vision.

[42]  Frithjof Kruggel,et al.  Segmentation of MR images with intensity inhomogeneities , 1998, Image Vis. Comput..

[43]  William A. Barrett,et al.  Interactive livewire boundary extraction , 2003 .

[44]  Andrew J Wheaton,et al.  Cartilage volume quantification via Live Wire segmentation. , 2004, Academic radiology.

[45]  Guido Gerig,et al.  User-guided 3D active contour segmentation of anatomical structures: Significantly improved efficiency and reliability , 2006, NeuroImage.

[46]  Seymour Papert,et al.  Mindstorms: Children, Computers, and Powerful Ideas , 1981 .

[47]  Filip Malmberg,et al.  A 3D Live-Wire Segmentation Method for Volume Images Using Haptic Interaction , 2006, DGCI.

[48]  Laurent D. Cohen,et al.  Global Minimum for Active Contour Models: A Minimal Path Approach , 1997, International Journal of Computer Vision.