Volume cutout

We present a novel method for cutting out 3D volumetric structures based on simple strokes that are drawn directly on volume rendered images. The freehand strokes roughly mark out objects of interest and background. Our system then automatically segments the regions of interest and refines their boundaries in the rendered image. These 2D segmentation results provide constraints for 3D segmentation in the volume dataset. The objects of interest are then efficiently cut out from the volume via a combination of our novel two-pass graph cuts algorithm and the pre-computed over-segmentation. Our method improves traditional, fully automatic segmentation by involving human users in the process, yet minimizing user input and providing timely feedback. Our experiments show that our method extracts volumetric structures precisely and efficiently while requiring little skill or effort from the user.

[1]  Marie-Pierre Jolly,et al.  Interactive Graph Cuts for Optimal Boundary and Region Segmentation of Objects in N-D Images , 2001, ICCV.

[2]  Vladimir Kolmogorov,et al.  An experimental comparison of min-cut/max- flow algorithms for energy minimization in vision , 2001, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  William A. Barrett,et al.  Intelligent scissors for image composition , 1995, SIGGRAPH.

[4]  Harry Shum,et al.  Lazy snapping , 2004, ACM Trans. Graph..

[5]  Ravin Balakrishnan,et al.  Using deformations for browsing volumetric data , 2003, IEEE Visualization, 2003. VIS 2003..

[6]  Kwan-Liu Ma,et al.  A cluster-space visual interface for arbitrary dimensional classification of volume data , 2004, VISSYM'04.

[7]  Eduard Gröller,et al.  Two-Level Volume Rendering , 2001, IEEE Trans. Vis. Comput. Graph..

[8]  Kwan-Liu Ma,et al.  A novel interface for higher-dimensional classification of volume data , 2003, IEEE Visualization, 2003. VIS 2003..

[9]  David Salesin,et al.  Keyframe-based tracking for rotoscoping and animation , 2004, ACM Trans. Graph..

[10]  Hanspeter Pfister,et al.  Generation of transfer functions with stochastic search techniques , 1996, Proceedings of Seventh Annual IEEE Visualization '96.

[11]  Paul A. Beardsley,et al.  Design galleries: a general approach to setting parameters for computer graphics and animation , 1997, SIGGRAPH.

[12]  Thomas Ertl,et al.  Fast and Interactive 3D-Segmentation of Medical Volume Data , 1998 .

[13]  Markus Hadwiger,et al.  High-quality two-level volume rendering of segmented data sets on consumer graphics hardware , 2003, IEEE Visualization, 2003. VIS 2003..

[14]  Ivan Viola,et al.  Importance-driven volume rendering , 2004, IEEE Visualization 2004.

[15]  Yuriko Takeshima,et al.  Topological volume skeletonization and its application to transfer function design , 2004, Graph. Model..

[16]  William A. Barrett,et al.  Intelligent selection tools , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[17]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[18]  Yuriko Takeshima,et al.  Automating transfer function design for comprehensible volume rendering based on 3D field topology analysis , 1999, Proceedings Visualization '99 (Cat. No.99CB37067).

[19]  Narendra Ahuja,et al.  Selecting Objects With Freehand Sketches , 2001, ICCV.

[20]  Joe Michael Kniss,et al.  Multidimensional Transfer Functions for Interactive Volume Rendering , 2002, IEEE Trans. Vis. Comput. Graph..

[21]  William A. Barrett,et al.  Toboggan-based intelligent scissors with a four-parameter edge model , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[22]  Eric N. Mortensen Vision-assisted image editing , 1999, COMG.

[23]  Frank Nielsen,et al.  Volume catcher , 2005, I3D '05.

[24]  J. Fairfield,et al.  Toboggan contrast enhancement for contrast segmentation , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[25]  Xu Yao,et al.  Fast image segmentation by sliding in the derivative terrain , 1992, Other Conferences.

[26]  Kwan-Liu Ma,et al.  RGVis: Region Growing Based Visualization Techniques for Volume Visualization , 2003 .

[27]  Maneesh Agrawala,et al.  Interactive video cutout , 2005, ACM Trans. Graph..