Interactive 3D medical image segmentation with energy-minimizing implicit functions

We present an interactive segmentation method for 3D medical images that reconstructs the surface of an object using energy-minimizing, smooth, implicit functions. This reconstruction problem is called variational interpolation. For an intuitive segmentation of medical images, variational interpolation can be based on a set of user-drawn, planar contours that can be arbitrarily oriented in 3D space. This also allows an easy integration of the algorithm into the common manual segmentation workflow, where objects are segmented by drawing contours around them on each slice of a 3D image. Because variational interpolation is computationally expensive, we show how to speed up the algorithm to achieve almost real-time calculation times while preserving the overall segmentation quality. Moreover, we show how to improve the robustness of the algorithm by transforming it from an interpolation to an approximation problem and we discuss a local interpolation scheme. A first evaluation of our algorithm by two experienced radiology technicians on 15 liver metastases and 1 liver has shown that the segmentation times can be reduced by a factor of about 2 compared to a slice-wise manual segmentation and only about one fourth of the contours are necessary compared to the number of contours necessary for a manual segmentation.

[1]  Heinz-Otto Peitgen,et al.  IWT-interactive watershed transform: a hierarchical method for efficient interactive and automated segmentation of multidimensional gray-scale images , 2003, SPIE Medical Imaging.

[2]  Tao Zhang,et al.  Model-based segmentation of medical imagery by matching distributions , 2005, IEEE Transactions on Medical Imaging.

[3]  Denis Friboulet,et al.  Compactly Supported Radial Basis Functions Based Collocation Method for Level-Set Evolution in Image Segmentation , 2007, IEEE Transactions on Image Processing.

[4]  Jan Modersitzki,et al.  Numerical Methods for Image Registration , 2004 .

[5]  Bernhard Schölkopf,et al.  Implicit Surface Modelling with a Globally Regularised Basis of Compact Support , 2006, Comput. Graph. Forum.

[6]  James F. O'Brien,et al.  Implicit surfaces that interpolate , 2001, Proceedings International Conference on Shape Modeling and Applications.

[7]  Richard K. Beatson,et al.  Smooth surface reconstruction from noisy range data , 2003, GRAPHITE '03.

[8]  Arnold W. M. Smeulders,et al.  Interaction in the segmentation of medical images: A survey , 2001, Medical Image Anal..

[9]  Tim McInerney.  SketchSnakes: Sketch-line initialized Snakes for efficient interactive medical image segmentation , 2008, Comput. Medical Imaging Graph..

[10]  Yoshitaka Masutani.  RBF-Based Representation of Volumetric Data: Application in Visualization and Segmentation , 2002, MICCAI.

[11]  William A. Barrett,et al.  Interactive live-wire boundary extraction , 1997, Medical Image Anal..

[12]  Kalpathi R. Subramanian,et al.  Active Contours Using a Constraint-Based Implicit Representation , 2005, CVPR.

[13]  Joachim Hornegger,et al.  Two-stage Semi-automatic Organ Segmentation Framework using Radial Basis Functions and Level Sets , 2007 .

[14]  Gert Vegter,et al.  In handbook of discrete and computational geometry , 1997 .

[15]  James F. O'Brien,et al.  Shape transformation using variational implicit functions , 1999, SIGGRAPH Courses.

[16]  Longin Jan Latecki,et al.  Convexity Rule for Shape Decomposition Based on Discrete Contour Evolution , 1999, Comput. Vis. Image Underst..

[17]  J. Bunch,et al.  Decomposition of a symmetric matrix , 1976 .

[18]  Jean-Philippe Thiran,et al.  Non-Euclidean image-adaptive Radial Basis Functions for 3D interactive segmentation , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[19]  Heinz-Otto Peitgen,et al.  Efficient Semiautomatic Segmentation of 3D Objects in Medical Images , 2000, MICCAI.

[20]  Richard K. Beatson,et al.  Reconstruction and representation of 3D objects with radial basis functions , 2001, SIGGRAPH.

[21]  Günther Greiner,et al.  Surface Reconstruction Based on Hierarchical Floating Radial Basis Functions , 2010, Comput. Graph. Forum.

[22]  Thomas Martin Deserno,et al.  A General Discrete Contour Model in Two, Three, and Four Dimensions for Topology-Adaptive Multichannel Segmentation , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Leo Grady,et al.  Random Walks for Image Segmentation , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Bernhard Preim,et al.  Interaktive Systeme - Band 1: Grundlagen, Graphical User Interfaces, Informationsvisualisierung , 2010 .

[25]  D CohenLaurent.  On active contour models and balloons , 1991 .

[26]  Lu Liu,et al.  Surface Reconstruction From Non‐parallel Curve Networks , 2008, Comput. Graph. Forum.

[27]  Matthew S. Horritt,et al.  A statistical active contour model for SAR image segmentation , 1999, Image Vis. Comput..

[28]  Frans Vos,et al.  Interactive 3D segmentation using connected orthogonal contours , 2004, Comput. Biol. Medicine.

[29]  Kalpathi R. Subramanian,et al.  Interpolating implicit surfaces from scattered surface data using compactly supported radial basis functions , 2001, Proceedings International Conference on Shape Modeling and Applications.

[30]  James F. O'Brien,et al.  Modelling with implicit surfaces that interpolate , 2005, SIGGRAPH Courses.

[31]  Geoff Wyvill,et al.  Data structure forsoft objects , 1986, The Visual Computer.

[32]  Hans-Peter Seidel,et al.  3D scattered data interpolation and approximation with multilevel compactly supported RBFs , 2005, Graph. Model..

[33]  J. Udupa,et al.  Shape-based interpolation of multidimensional objects. , 1990, IEEE transactions on medical imaging.

[34]  Laurent D. Cohen,et al.  On active contour models and balloons , 1991, CVGIP Image Underst..

[35]  Greg Turk,et al.  Robust Creation of Implicit Surfaces from Polygonal Meshes , 2002, IEEE Trans. Vis. Comput. Graph..

[36]  Hong Yi,et al.  A survey of the marching cubes algorithm , 2006, Comput. Graph..

[37]  Richard K. Beatson,et al.  Surface interpolation with radial basis functions for medical imaging , 1997, IEEE Transactions on Medical Imaging.

[38]  Greg Turk,et al.  Reconstructing Surfaces by Volumetric Regularization Using Radial Basis Functions , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Gregory G. Slabaugh,et al.  A Variational Approach to the Evolution of Radial Basis Functions for Image Segmentation , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.