Rule‐Enhanced Transfer Function Generation for Medical Volume Visualization

In volume visualization, transfer functions are used to classify the volumetric data and assign optical properties to the voxels. In general, transfer functions are generated in a transfer function space, which is the feature space constructed by data values and properties derived from the data. If volumetric objects have the same or overlapping data values, it would be difficult to separate them in the transfer function space. In this paper, we present a rule‐enhanced transfer function design method that allows important structures of the volume to be more effectively separated and highlighted. We define a set of rules based on the local frequency distribution of volume attributes. A rule‐selection method based on a genetic algorithm is proposed to learn the set of rules that can distinguish the user‐specified target tissue from other tissues. In the rendering stage, voxels satisfying these rules are rendered with higher opacities in order to highlight the target tissue. The proposed method was tested on various volumetric datasets to enhance the visualization of important structures that are difficult to be visualized by traditional transfer function design methods. The results demonstrate the effectiveness of the proposed method.

[1]  Joe Michael Kniss,et al.  Supervised Manifold Distance Segmentation , 2011, IEEE Transactions on Visualization and Computer Graphics.

[2]  Kwan-Liu Ma,et al.  The Occlusion Spectrum for Volume Classification and Visualization , 2009, IEEE Transactions on Visualization and Computer Graphics.

[3]  Anna Vilanova,et al.  Visualization of boundaries in volumetric data sets using LH histograms , 2006, IEEE Transactions on Visualization and Computer Graphics.

[4]  Kwan-Liu Ma,et al.  An intelligent system approach to higher-dimensional classification of volume data , 2005, IEEE Transactions on Visualization and Computer Graphics.

[5]  Anthony J. Sherbondy,et al.  Fast volume segmentation with simultaneous visualization using programmable graphics hardware , 2003, IEEE Visualization, 2003. VIS 2003..

[6]  David S. Ebert,et al.  Structuring Feature Space: A Non-Parametric Method for Volumetric Transfer Function Generation , 2009, IEEE Transactions on Visualization and Computer Graphics.

[7]  Jian Pei,et al.  Mining frequent patterns without candidate generation , 2000, SIGMOD '00.

[8]  Maryann E. Martone,et al.  Dimensionality Reduction on Multi-Dimensional Transfer Functions for Multi-Channel Volume Data Sets , 2010, Inf. Vis..

[9]  Virginia E. Barker,et al.  Expert systems for configuration at Digital: XCON and beyond , 1989, Commun. ACM.

[10]  Penny Rheingans,et al.  Texture-based Transfer Functions for Direct Volume Rendering , 2008, IEEE Transactions on Visualization and Computer Graphics.

[11]  Kwan-Liu Ma,et al.  A cluster-space visual interface for arbitrary dimensional classification of volume data , 2004, VISSYM'04.

[12]  Jian Huang,et al.  Distribution-Driven Visualization of Volume Data , 2009, IEEE Transactions on Visualization and Computer Graphics.

[13]  Joseph JáJá,et al.  Hierarchical Exploration of Volumes Using Multilevel Segmentation of the Intensity-Gradient Histograms , 2012, IEEE Transactions on Visualization and Computer Graphics.

[14]  Stefan Bruckner,et al.  Volume visualization based on statistical transfer-function spaces , 2010, 2010 IEEE Pacific Visualization Symposium (PacificVis).

[15]  Yuriko Takeshima,et al.  Automating transfer function design for comprehensible volume rendering based on 3D field topology analysis , 1999, Proceedings Visualization '99 (Cat. No.99CB37067).

[16]  Xin Zhao,et al.  Multi-dimensional Reduction and Transfer Function Design using Parallel Coordinates , 2010, VG@Eurographics.

[17]  Valerio Pascucci,et al.  The contour spectrum , 1997, Proceedings. Visualization '97 (Cat. No. 97CB36155).

[18]  Ramakrishnan Srikant,et al.  Fast Algorithms for Mining Association Rules in Large Databases , 1994, VLDB.

[19]  Christof Rezk-Salama,et al.  High-Level User Interfaces for Transfer Function Design with Semantics , 2006, IEEE Transactions on Visualization and Computer Graphics.

[20]  Carla Maria Dal Sasso Freitas,et al.  Design of Multi-dimensional Transfer Functions Using Dimensional Reduction , 2007, EuroVis.

[21]  Sim Heng Ong,et al.  A clustering-based system to automate transfer function design for medical image visualization , 2011, The Visual Computer.

[22]  William J. Clancey,et al.  Rule-based expert systems , 2017, Radiopaedia.org.

[23]  Fei Yang,et al.  Skeleton Cuts—An Efficient Segmentation Method for Volume Rendering , 2011, IEEE Transactions on Visualization and Computer Graphics.

[24]  Rakesh Agarwal,et al.  Fast Algorithms for Mining Association Rules , 1994, VLDB 1994.

[25]  Jian Zhang,et al.  Automating Transfer Function Design with Valley Cell‐Based Clustering of 2D Density Plots , 2012, Comput. Graph. Forum.

[26]  Edward H. Shortliffe,et al.  Rule Based Expert Systems: The Mycin Experiments of the Stanford Heuristic Programming Project (The Addison-Wesley series in artificial intelligence) , 1984 .

[27]  Kwan-Liu Ma,et al.  RGVis: region growing based techniques for volume visualization , 2003, 11th Pacific Conference onComputer Graphics and Applications, 2003. Proceedings..

[28]  Lars Linsen,et al.  Surface Extraction from Multi-field Particle Volume Data Using Multi-dimensional Cluster Visualization , 2008, IEEE Transactions on Visualization and Computer Graphics.

[29]  Chad Creighton,et al.  Mining gene expression databases for association rules , 2003, Bioinform..

[30]  Stefan Wesarg,et al.  3D Visualization of Medical Image Data Employing 2D Histograms , 2009, 2009 Second International Conference in Visualisation.

[31]  Ramakrishnan Srikant,et al.  Mining quantitative association rules in large relational tables , 1996, SIGMOD '96.

[32]  Gordon L. Kindlmann,et al.  Semi-Automatic Generation of Transfer Functions for Direct Volume Rendering , 1998, VVS.

[33]  E. Shortliffe.  Mycin: computer-based medical consultations , 1976 .

[34]  Tomasz Imielinski,et al.  Mining association rules between sets of items in large databases , 1993, SIGMOD Conference.

[35]  Xin Zhao,et al.  Modified Dendrogram of Attribute Space for Multidimensional Transfer Function Design , 2012, IEEE Transactions on Visualization and Computer Graphics.

[36]  Ivan Viola,et al.  Automatic Transfer Functions Based on Informational Divergence , 2011, IEEE Transactions on Visualization and Computer Graphics.

[37]  Kwan-Liu Ma,et al.  A novel interface for higher-dimensional classification of volume data , 2003, IEEE Visualization, 2003. VIS 2003..

[38]  Kwan-Liu Ma,et al.  Size-based Transfer Functions: A New Volume Exploration Technique , 2008, IEEE Transactions on Visualization and Computer Graphics.

[39]  Sim Heng Ong,et al.  Automatic transfer function design for medical visualization using visibility distributions and projective color mapping , 2013, Comput. Medical Imaging Graph..

[40]  Xiaoru Yuan,et al.  Multi-dimensional transfer function design based on flexible dimension projection embedded in parallel coordinates , 2011, 2011 IEEE Pacific Visualization Symposium.

[41]  Bruce G. Buchanan,et al.  Heuristic DENDRAL - A program for generating explanatory hypotheses in organic chemistry. , 1968 .

[42]  Dirk Van Oudheusden,et al.  The City Trip Planner: An expert system for tourists , 2011, Expert Syst. Appl..

[43]  John Gaschnig,et al.  MODEL DESIGN IN THE PROSPECTOR CONSULTANT SYSTEM FOR MINERAL EXPLORATION , 1981 .

[44]  Jaideep Srivastava,et al.  Web usage mining: discovery and applications of usage patterns from Web data , 2000, SKDD.

[45]  Kwan-Liu Ma,et al.  Visibility Histograms and Visibility-Driven Transfer Functions , 2011, IEEE Transactions on Visualization and Computer Graphics.

[46]  Stefan Bruckner,et al.  Semantic Layers for Illustrative Volume Rendering , 2007, IEEE Transactions on Visualization and Computer Graphics.