Laplacian Shape Editing with Local Patch Based Force Field for Interactive Segmentation

Segmenting structure-of-interest is a fundamental problem in medical image analysis. Numerous automatic segmentation algorithms have been extensively studied for the task. However, misleading image information and the complex organ structures with high curvature boundaries may cause under- or over-segmentation for the deformable models. Learning based approaches can alleviate this issue, while they usually require a large number of representative training samples for each use case, which may not be available in practice. On the other hand, manually correcting segmentation errors produces good results and doctors would like such tools to improve accuracy in local areas. Therefore, we propose a 3D editing framework to interactively and efficiently refine the segmentation results, by editing the mesh directly. Specifically, the shape editing framework is modeled by integrating the Laplacian coordinates, image context information and user specified control points. We employ a local patch based optimization to enhance the supplement force field near the control points to improve correction accuracy. Our method requires few (and intuitive) user inputs, and the experimental results show competitive performance of our interactive refinement compared to other state-of-the-art methods.

[1]  Daoqiang Zhang,et al.  A generative probability model of joint label fusion for multi-atlas based brain segmentation , 2014, Medical Image Anal..

[2]  Dorin Comaniciu,et al.  Four-Chamber Heart Modeling and Automatic Segmentation for 3-D Cardiac CT Volumes Using Marginal Space Learning and Steerable Features , 2008, IEEE Transactions on Medical Imaging.

[3]  Marie-Pierre Jolly,et al.  Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[4]  Ghassan Hamarneh,et al.  Spotlight: Automated Confidence-Based User Guidance for Increasing Efficiency in Interactive 3D Image Segmentation , 2010, MCV.

[5]  Junzhou Huang,et al.  A 3D Laplacian-driven parametric deformable model , 2011, 2011 International Conference on Computer Vision.

[6]  Leo Grady,et al.  Random Walks for Image Segmentation , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Yiqiang Zhan,et al.  Cross Modality Deformable Segmentation Using Hierarchical Clustering and Learning , 2009, MICCAI.

[8]  Dorin Comaniciu,et al.  Hierarchical, learning-based automatic liver segmentation , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Marc Alexa,et al.  Laplacian mesh optimization , 2006, GRAPHITE '06.

[10]  Dimitris N. Metaxas,et al.  Metamorphs: Deformable Shape and Appearance Models , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[12]  Jerry L. Prince,et al.  Snakes, shapes, and gradient vector flow , 1998, IEEE Trans. Image Process..

[13]  Ghassan Hamarneh,et al.  Active Learning for Interactive 3D Image Segmentation , 2011, MICCAI.

[14]  Junzhou Huang,et al.  Towards robust and effective shape modeling: Sparse shape composition , 2012, Medical Image Anal..

[15]  Bing Li,et al.  Active Contour External Force Using Vector Field Convolution for Image Segmentation , 2007, IEEE Transactions on Image Processing.