Visual Analytics for model-based medical image segmentation: Opportunities and challenges

Segmentation of medical images is a prerequisite in clinical practice. Many segmentation algorithms use statistical shape models. Due to the lack of tools providing prior information on the data, standard models are frequently used. However, they do not necessarily describe the data in an optimal way. Model-based segmentation can be supported by Visual Analytics tools, which give the user a deeper insight into the correspondence between data and model result. Combining both approaches, better models for segmentation of organs in medical images are created. In this work, we identify the main tasks and problems in model-based image segmentation. As a proof of concept, we show that already small visual-interactive extensions can be very beneficial. Based on these results, we present research challenges for Visual Analytics in this area.

[1]  Ivan Viola,et al.  Guided Visualization of Ultrasound Image Sequences , 2010, VCBM.

[2]  Roy A. Ruddle,et al.  Visualization of Parameter Space for Image Analysis , 2011, IEEE Transactions on Visualization and Computer Graphics.

[3]  Peter Filzmoser,et al.  Uncertainty‐Aware Exploration of Continuous Parameter Spaces Using Multivariate Prediction , 2011, Comput. Graph. Forum.

[4]  Tobias Schreck,et al.  Techniques for Precision-Based Visual Analysis of Projected Data , 2010, Inf. Vis..

[5]  Bernhard Preim,et al.  Visualization in Medicine: Theory, Algorithms, and Applications , 2007 .

[6]  Tobias Schreck,et al.  Visual Cluster Analysis of Trajectory Data with Interactive Kohonen Maps , 2009 .

[7]  Ruxandra Stoean,et al.  Modeling medical decision making by support vector machines, explaining by rules of evolutionary algorithms with feature selection , 2013, Expert Syst. Appl..

[8]  Arjan Kuijper,et al.  MobileAR Browser - A generic architecture for rapid AR-multi-level development , 2013, Expert Syst. Appl..

[9]  Tobias Schreck,et al.  Visual analysis of graphs with multiple connected components , 2009, 2009 IEEE Symposium on Visual Analytics Science and Technology.

[10]  Arjan Kuijper,et al.  An automatic cell segmentation method for differential interference contrast microscopy , 2008, 2008 19th International Conference on Pattern Recognition.

[11]  Stefan Wesarg,et al.  Construction of groupwise consistent shape parameterizations by propagation , 2010, Medical Imaging.

[12]  Martin Styner,et al.  Comparison and Evaluation of Methods for Liver Segmentation From CT Datasets , 2009, IEEE Transactions on Medical Imaging.

[13]  Paulo Novais,et al.  A visual analytics framework for cluster analysis of DNA microarray data , 2013, Expert Syst. Appl..

[14]  Tobias Schreck,et al.  Visual analytics of time dependent 2D point clouds , 2009, CGI.

[15]  Hans-Peter Meinzer,et al.  Statistical shape models for 3D medical image segmentation: A review , 2009, Medical Image Anal..

[16]  Charl P. Botha,et al.  Eurographics/ Ieee-vgtc Symposium on Visualization 2010 Dynamic Multi-view Exploration of Shape Spaces , 2022 .

[17]  Stefan Wesarg,et al.  Active shape models unleashed , 2011, Medical Imaging.

[18]  Stefan Wesarg,et al.  3D Active Shape Model Segmentation with Nonlinear Shape Priors , 2011, MICCAI.

[19]  Daniel A. Keim,et al.  Visual Analytics: Scope and Challenges , 2008, Visual Data Mining.

[20]  Arjan Kuijper,et al.  Mutual information aspects of scale space images , 2004, Pattern Recognit..

[21]  Yi-Ping Phoebe Chen,et al.  Computational intelligence for heart disease diagnosis: A medical knowledge driven approach , 2013, Expert Syst. Appl..

[22]  Heidrun Schumann,et al.  The Visualization of Uncertain Data: Methods and Problems , 2006, SimVis.

[23]  Ben Shneiderman,et al.  Readings in information visualization - using vision to think , 1999 .

[24]  Stefan Bruckner,et al.  Eurographics/ Ieee-vgtc Symposium on Visualization 2010 Isosurface Similarity Maps , 2022 .