Gaussian mixture model-based target feature extraction and visualization

Effective extraction and visualization of complex target features from volume data are an important task, which allows the user to analyze and get insights of the complex features, and thus to make reasonable decisions. Some state-of-the-art techniques allow the user to perform such a task by interactively exploring in multiple linked parameter space views. However, interactions in the parameter space using trial and error may be unintuitive and time-consuming. Furthermore, switching between multiple views may be distracting. Some other state-of-the-art techniques allow the user to extract the complex features by directly interacting in the data space and subsequently visualize the extracted features in 3D view. They are intuitive and effective techniques for the user, as the user is familiar with the data space, and they do not require many trial and error to get the features. However, these techniques usually generate less accurate features. In this paper, we proposed a semiautomatic Gaussian mixture model-based target feature extraction and visualization method, which allows the user to quickly label single or multiple complex target features using lasso on two slices of the volume data and subsequently visualize the automatically extracted features in 3D view. We have applied it to various univariate or multivariate volume datasets from the medical field to demonstrate its effectiveness. Moreover, we have performed both qualitative and quantitative experiments to compare its results against the results from two state-of-the-art techniques and the ground truths. The experimental results showed that our method is able to generate the closest results to the ground truth.

[1]  Sim Heng Ong,et al.  A two-level clustering approach for multidimensional transfer function specification in volume visualization , 2015, The Visual Computer.

[2]  Joe Michael Kniss,et al.  Supervised Manifold Distance Segmentation , 2011, IEEE Transactions on Visualization and Computer Graphics.

[3]  Xin Zhao,et al.  Multi-dimensional Reduction and Transfer Function Design using Parallel Coordinates , 2010, VG@Eurographics.

[4]  Maryann E. Martone,et al.  Dimensionality Reduction on Multi-Dimensional Transfer Functions for Multi-Channel Volume Data Sets , 2010, Inf. Vis..

[5]  Changhe Tu,et al.  Analogy-based volume exploration using ellipsoidal Gaussian transfer functions , 2018, J. Vis..

[6]  Kwan-Liu Ma,et al.  An intelligent system approach to higher-dimensional classification of volume data , 2005, IEEE Transactions on Visualization and Computer Graphics.

[7]  Tzong-Jer Chen,et al.  Fuzzy c-means clustering with spatial information for image segmentation , 2006, Comput. Medical Imaging Graph..

[8]  Jian Huang,et al.  Distribution-Driven Visualization of Volume Data , 2009, IEEE Transactions on Visualization and Computer Graphics.

[9]  Sim Heng Ong,et al.  A clustering-based system to automate transfer function design for medical image visualization , 2011, The Visual Computer.

[10]  Xiaoru Yuan,et al.  Multi-dimensional transfer function design based on flexible dimension projection embedded in parallel coordinates , 2011, 2011 IEEE Pacific Visualization Symposium.

[11]  Brian B. Avants,et al.  The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) , 2015, IEEE Transactions on Medical Imaging.

[12]  Gordon L. Kindlmann,et al.  Semi-Automatic Generation of Transfer Functions for Direct Volume Rendering , 1998, VVS.

[13]  H. Handels,et al.  Extra Tree forests for sub-acute ischemic stroke lesion segmentation in MR sequences , 2015, Journal of Neuroscience Methods.

[14]  Deukhee Lee,et al.  Automatic spine segmentation from CT images using Convolutional Neural Network via redundant generation of class labels , 2019, J. Comput. Des. Eng..

[15]  Jian Zhang,et al.  Efficient Volume Exploration Using the Gaussian Mixture Model , 2011, IEEE Transactions on Visualization and Computer Graphics.

[16]  Jian Zhang,et al.  Efficient Volume Exploration Using the Gaussian Mixture Model. , 2011, IEEE transactions on visualization and computer graphics.

[17]  Stefan Wesarg,et al.  3D Visualization of Medical Image Data Employing 2D Histograms , 2009, 2009 Second International Conference in Visualisation.

[18]  Kenneth I. Joy,et al.  Local Data Models for Probabilistic Transfer Function Design , 2013, EuroVis.

[19]  Anna Vilanova,et al.  Visualization of boundaries in volumetric data sets using LH histograms , 2006, IEEE Transactions on Visualization and Computer Graphics.

[20]  Joseph JáJá,et al.  Hierarchical Exploration of Volumes Using Multilevel Segmentation of the Intensity-Gradient Histograms , 2012, IEEE Transactions on Visualization and Computer Graphics.

[21]  Stefan Bruckner,et al.  Volume visualization based on statistical transfer-function spaces , 2010, 2010 IEEE Pacific Visualization Symposium (PacificVis).

[22]  Sim Heng Ong,et al.  Rule‐Enhanced Transfer Function Generation for Medical Volume Visualization , 2015, Comput. Graph. Forum.

[23]  Kwan-Liu Ma,et al.  The Occlusion Spectrum for Volume Classification and Visualization , 2009, IEEE Transactions on Visualization and Computer Graphics.

[24]  Han-Wei Shen,et al.  Uncertainty visualization for variable associations analysis , 2017, The Visual Computer.

[25]  Edsger W. Dijkstra,et al.  A note on two problems in connexion with graphs , 1959, Numerische Mathematik.

[26]  Jian Zhang,et al.  Automating Transfer Function Design with Valley Cell‐Based Clustering of 2D Density Plots , 2012, Comput. Graph. Forum.

[27]  Xin Zhao,et al.  Modified Dendrogram of Attribute Space for Multidimensional Transfer Function Design , 2012, IEEE Transactions on Visualization and Computer Graphics.

[28]  L. Zhou,et al.  GuideME: Slice‐guided Semiautomatic Multivariate Exploration of Volumes , 2014, Comput. Graph. Forum.

[29]  Han-Wei Shen,et al.  Distribution Driven Extraction and Tracking of Features for Time-varying Data Analysis , 2016, IEEE Transactions on Visualization and Computer Graphics.