Real-time 3D interactive segmentation of echocardiographic data through user-based deformation of B-spline explicit active surfaces

Image segmentation is an ubiquitous task in medical image analysis, which is required to estimate morphological or functional properties of given anatomical targets. While automatic processing is highly desirable, image segmentation remains to date a supervised process in daily clinical practice. Indeed, challenging data often requires user interaction to capture the required level of anatomical detail. To optimize the analysis of 3D images, the user should be able to efficiently interact with the result of any segmentation algorithm to correct any possible disagreement. Building on a previously developed real-time 3D segmentation algorithm, we propose in the present work an extension towards an interactive application where user information can be used online to steer the segmentation result. This enables a synergistic collaboration between the operator and the underlying segmentation algorithm, thus contributing to higher segmentation accuracy, while keeping total analysis time competitive. To this end, we formalize the user interaction paradigm using a geometrical approach, where the user input is mapped to a non-cartesian space while this information is used to drive the boundary towards the position provided by the user. Additionally, we propose a shape regularization term which improves the interaction with the segmented surface, thereby making the interactive segmentation process less cumbersome. The resulting algorithm offers competitive performance both in terms of segmentation accuracy, as well as in terms of total analysis time. This contributes to a more efficient use of the existing segmentation tools in daily clinical practice. Furthermore, it compares favorably to state-of-the-art interactive segmentation software based on a 3D livewire-based algorithm.

[1]  Elsa D. Angelini,et al.  Real-time segmentation by Active Geometric Functions , 2010, Comput. Methods Programs Biomed..

[2]  Ghassan Hamarneh,et al.  3D live-wire-based semi-automatic segmentation of medical images , 2005, SPIE Medical Imaging.

[3]  Gareth Funka-Lea,et al.  Graph Cuts and Efficient N-D Image Segmentation , 2006, International Journal of Computer Vision.

[4]  Jayaram K. Udupa,et al.  A 3D generalization of user-steered live-wire segmentation , 2000, Medical Image Anal..

[5]  Guido Gerig,et al.  User-guided 3D active contour segmentation of anatomical structures: Significantly improved efficiency and reliability , 2006, NeuroImage.

[6]  Leo Grady,et al.  Minimal Surfaces Extend Shortest Path Segmentation Methods to 3D , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Denis Friboulet,et al.  Fast and fully automatic 3-d echocardiographic segmentation using B-spline explicit active surfaces: feasibility study and validation in a clinical setting. , 2013, Ultrasound in medicine & biology.

[8]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[9]  Guoliang Xu,et al.  G2 surface modeling using minimal mean-curvature-variation flow , 2007, Comput. Aided Des..

[10]  Denis Friboulet,et al.  Compactly Supported Radial Basis Functions Based Collocation Method for Level-Set Evolution in Image Segmentation , 2007, IEEE Transactions on Image Processing.

[11]  Gerard van Burken,et al.  Automatic active appearance model segmentation of 3D echocardiograms , 2010, 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[12]  Denis Friboulet,et al.  Quantification of left ventricular volume and global function using a fast automated segmentation tool: validation in a clinical setting , 2012, The International Journal of Cardiovascular Imaging.

[13]  Jayaram K. Udupa,et al.  An ultra-fast user-steered image segmentation paradigm: live wire on the fly , 2000, IEEE Transactions on Medical Imaging.

[14]  Allen R. Tannenbaum,et al.  Localizing Region-Based Active Contours , 2008, IEEE Transactions on Image Processing.

[15]  W. J. Hedley,et al.  Left ventricular mass and volume: fast calculation with guide-point modeling on MR images. , 2000, Radiology.

[16]  Allen R. Tannenbaum,et al.  Interactive MRI segmentation with controlled active vision , 2011, IEEE Conference on Decision and Control and European Control Conference.

[17]  Johan Montagnat,et al.  Shape and Topology Constraints on Parametric Active Contours , 2001, Comput. Vis. Image Underst..

[18]  Denis Friboulet,et al.  B-Spline Explicit Active Surfaces: An Efficient Framework for Real-Time 3-D Region-Based Segmentation , 2012, IEEE Transactions on Image Processing.

[19]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[20]  Vladimir Kolmogorov,et al.  An experimental comparison of min-cut/max- flow algorithms for energy minimization in vision , 2001, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Ghassan Hamarneh,et al.  Active Learning for Interactive 3D Image Segmentation , 2011, MICCAI.

[22]  Kashif Rajpoot,et al.  The evaluation of single-view and multi-view fusion 3D echocardiography using image-driven segmentation and tracking , 2011, Medical Image Anal..

[23]  Michael Unser,et al.  Fast parametric snakes for 3D microscopy , 2012, 2012 9th IEEE International Symposium on Biomedical Imaging (ISBI).

[24]  Yan Kang,et al.  Interactive 3 D editing tools for image segmentation q , 2003 .

[25]  Ghassan Hamarneh,et al.  Spotlight: Automated Confidence-Based User Guidance for Increasing Efficiency in Interactive 3D Image Segmentation , 2010, MCV.

[26]  Michael Unser,et al.  Variational B-Spline Level-Set: A Linear Filtering Approach for Fast Deformable Model Evolution , 2009, IEEE Transactions on Image Processing.

[27]  Jos B. T. M. Roerdink,et al.  Fast Sparse Level Sets on Graphics Hardware , 2013, IEEE Transactions on Visualization and Computer Graphics.

[28]  David E. Breen,et al.  Interactive free-form level-set surface-editing operators , 2010, Comput. Graph..

[29]  Joseph Ross Mitchell,et al.  A work-efficient GPU algorithm for level set segmentation , 2010, HPG '10.

[30]  Frans Vos,et al.  Interactive 3D segmentation using connected orthogonal contours , 2004, Comput. Biol. Medicine.

[31]  Anthony J. Yezzi,et al.  A Fully Global Approach to Image Segmentation via Coupled Curve Evolution Equations , 2002, J. Vis. Commun. Image Represent..

[32]  Piet Claus,et al.  On the calculation of principle curvatures of the left-ventricular surfaces , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[33]  Fredrik Orderud,et al.  Real-Time Active Shape Models for Segmentation of 3D Cardiac Ultrasound , 2007, CAIP.

[34]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Michael Unser,et al.  Splines: a perfect fit for signal and image processing , 1999, IEEE Signal Process. Mag..

[36]  William E. Higgins,et al.  Interactive segmentation based on the live wire for 3D CT chest image analysis , 2007, International Journal of Computer Assisted Radiology and Surgery.

[37]  Heinz-Otto Peitgen,et al.  Interactive 3D medical image segmentation with energy-minimizing implicit functions , 2011, Comput. Graph..

[38]  Arnold W. M. Smeulders,et al.  Interaction in the segmentation of medical images: A survey , 2001, Medical Image Anal..

[39]  Demetri Terzopoulos,et al.  United Snakes , 1999, Medical Image Anal..

[40]  Ghassan Hamarneh,et al.  Efficient interactive 3D Livewire segmentation of complex objects with arbitrary topology , 2008, Comput. Medical Imaging Graph..

[41]  D. M,et al.  A level set formulation for Willmore flow , 2004 .

[42]  Martha Elizabeth Shenton,et al.  A 3D interactive multi-object segmentation tool using local robust statistics driven active contours , 2012, Medical Image Anal..

[43]  A. Laine,et al.  Segmentation of real-time three-dimensional ultrasound for quantification of ventricular function: a clinical study on right and left ventricles. , 2005, Ultrasound in medicine & biology.