ProbExplorer: Uncertainty‐guided Exploration and Editing of Probabilistic Medical Image Segmentation

In this paper, we develop an interactive analysis and visualization tool for probabilistic segmentation results in medical imaging. We provide a systematic approach to analyze, interact and highlight regions of segmentation uncertainty. We introduce a set of visual analysis widgets integrating different approaches to analyze multivariate probabilistic field data with direct volume rendering. We demonstrate the user's ability to identify suspicious regions (e.g. tumors) and correct the misclassification results using a novel uncertainty‐based segmentation editing technique. We evaluate our system and demonstrate its usefulness in the context of static and time‐varying medical imaging datasets.

[1]  Demetri Terzopoulos,et al.  Deformable models in medical image analysis: a survey , 1996, Medical Image Anal..

[2]  Joe Michael Kniss,et al.  Multidimensional Transfer Functions for Interactive Volume Rendering , 2002, IEEE Trans. Vis. Comput. Graph..

[3]  Alex T. Pang,et al.  Approaches to uncertainty visualization , 1996, The Visual Computer.

[4]  Penny Rheingans,et al.  Point-based probabilistic surfaces to show surface uncertainty , 2004, IEEE Transactions on Visualization and Computer Graphics.

[5]  Alex T. Pang,et al.  Visualizing scalar volumetric data with uncertainty , 2002, Comput. Graph..

[6]  Yan Kang,et al.  Interactive 3D editing tools for image segmentation , 2004, Medical Image Anal..

[7]  T. J. Jankun-Kelly,et al.  A Study of Transfer Function Generation for Time-Varying Volume Data , 2001, VG.

[8]  Alex T. Pang,et al.  Glyphs for Visualizing Uncertainty in Vector Fields , 1996, IEEE Trans. Vis. Comput. Graph..

[9]  Arnold W. M. Smeulders,et al.  Interaction in the segmentation of medical images: A survey , 2001, Medical Image Anal..

[10]  Robert S. Laramee,et al.  Uncertainty Visualization Methods in Isosurface Rendering , 2003, Eurographics.

[11]  Kwan-Liu Ma,et al.  A cluster-space visual interface for arbitrary dimensional classification of volume data , 2004, VISSYM'04.

[12]  Marc Stamminger,et al.  Spatialized Transfer Functions , 2005, EuroVis.

[13]  William A. Barrett,et al.  Interactive segmentation of image volumes with Live Surface , 2007, Comput. Graph..

[14]  William A. Barrett,et al.  Interactive livewire boundary extraction , 2003 .

[15]  Ross T. Whitaker,et al.  Curvature-based transfer functions for direct volume rendering: methods and applications , 2003, IEEE Visualization, 2003. VIS 2003..

[16]  Kwan-Liu Ma,et al.  An intelligent system approach to higher-dimensional classification of volume data , 2005, IEEE Transactions on Visualization and Computer Graphics.

[17]  Markus Hadwiger,et al.  Real-time volume graphics , 2006, Eurographics.

[18]  Anders Ynnerman,et al.  Local Histograms for Design of Transfer Functions in Direct Volume Rendering , 2006, IEEE Transactions on Visualization and Computer Graphics.

[19]  Gareth Funka-Lea,et al.  An Energy Minimization Approach to the Data Driven Editing of Presegmented Images/Volumes , 2006, MICCAI.

[20]  William A. Barrett,et al.  Interactive Segmentation with Intelligent Scissors , 1998, Graph. Model. Image Process..

[21]  Stephen M. Smith,et al.  Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm , 2001, IEEE Transactions on Medical Imaging.

[22]  Ghassan Hamarneh,et al.  Simultaneous Segmentation, Kinetic Parameter Estimation, and Uncertainty Visualization of Dynamic PET Images , 2007, MICCAI.

[23]  Chris R. Johnson Top Scientific Visualization Research Problems , 2004, IEEE Computer Graphics and Applications.

[24]  Joe Michael Kniss,et al.  Statistically quantitative volume visualization , 2005, VIS 05. IEEE Visualization, 2005..

[25]  Olga Veksler,et al.  Fast approximate energy minimization via graph cuts , 2001, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[26]  Anders Ynnerman,et al.  Uncertainty Visualization in Medical Volume Rendering Using Probabilistic Animation , 2007, IEEE Transactions on Visualization and Computer Graphics.

[27]  Leo Grady,et al.  Random Walks for Image Segmentation , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Pushmeet Kohli,et al.  Measuring uncertainty in graph cut solutions , 2008, Comput. Vis. Image Underst..

[29]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[30]  T. Hengl,et al.  Visualisation of uncertainty using the HSI colour model : computations with colours , 2003 .

[31]  T. Humphries,et al.  Segmentation-based regularization of dynamic SPECT reconstruction , 2009, 2009 IEEE Nuclear Science Symposium Conference Record (NSS/MIC).

[32]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[33]  William A. Barrett,et al.  Interactive live-wire boundary extraction , 1997, Medical Image Anal..