WYSIWYP: What You See Is What You Pick

Scientists, engineers and physicians are used to analyze 3D data with slice-based visualizations. Radiologists for example are trained to read slices of medical imaging data. Despite the numerous examples of sophisticated 3D rendering techniques, domain experts, who still prefer slice-based visualization do not consider these to be very useful. Since 3D renderings have the advantage of providing an overview at a glance, while 2D depictions better serve detailed analyses, it is of general interest to better combine these methods. Recently there have been attempts to bridge this gap between 2D and 3D renderings. These attempts include specialized techniques for volume picking in medical imaging data that result in repositioning slices. In this paper, we present a new volume picking technique called WYSIWYP (“what you see is what you pick”) that, in contrast to previous work, does not require pre-segmented data or metadata and thus is more generally applicable. The positions picked by our method are solely based on the data itself, the transfer function, and the way the volumetric rendering is perceived by the user. To demonstrate the utility of the proposed method, we apply it to automated positioning of slices in volumetric scalar fields from various application areas. Finally, we present results of a user study in which 3D locations selected by users are compared to those resulting from WYSIWYP. The user study confirms our claim that the resulting positions correlate well with those perceived by the user.

[1]  Hans-Christian Hege,et al.  amira: A Highly Interactive System for Visual Data Analysis , 2005, The Visualization Handbook.

[2]  H. Lugt,et al.  Introduction to vortex theory , 1996 .

[3]  Timo Ropinski,et al.  Voreen: A Rapid-Prototyping Environment for Ray-Casting-Based Volume Visualizations , 2009, IEEE Computer Graphics and Applications.

[4]  William J. Schroeder,et al.  The Visualization Toolkit , 2005, The Visualization Handbook.

[5]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[6]  Jaap Smit,et al.  Image Quality Improvements in Volume Rendering , 1996, VBC.

[7]  Stefan Bruckner,et al.  BrainGazer - Visual Queries for Neurobiology Research , 2009, IEEE Transactions on Visualization and Computer Graphics.

[8]  Paolo Sabella,et al.  A rendering algorithm for visualizing 3D scalar fields , 1988, SIGGRAPH.

[9]  Nelson L. Max,et al.  Optical Models for Direct Volume Rendering , 1995, IEEE Trans. Vis. Comput. Graph..

[10]  James T. Enns,et al.  Attention and Visual Memory in Visualization and Computer Graphics , 2012, IEEE Transactions on Visualization and Computer Graphics.

[11]  Stefan Bruckner,et al.  LiveSync++: enhancements of an interaction metaphor , 2008, Graphics Interface.

[12]  Enrico Gobbetti,et al.  Interactive virtual angioscopy , 1998, Proceedings Visualization '98 (Cat. No.98CB36276).

[13]  Eduard Gröller,et al.  Feature peeling , 2007, GI '07.

[14]  Takeo Igarashi,et al.  Automatic Cross-Sectioning Based on Topological Volume Skeletonization , 2005, Smart Graphics.

[15]  Tobias Isenberg,et al.  Efficient Structure-Aware Selection Techniques for 3D Point Cloud Visualizations with 2DOF Input , 2012, IEEE Transactions on Visualization and Computer Graphics.

[16]  Ferran Argelaguet,et al.  Efficient 3D Pointing Selection in Cluttered Virtual Environments , 2009, IEEE Computer Graphics and Applications.

[17]  Rüdiger Westermann,et al.  Acceleration techniques for GPU-based volume rendering , 2003, IEEE Visualization, 2003. VIS 2003..

[18]  W. D. Bidgood,et al.  Introduction to the ACR-NEMA DICOM standard. , 1992, Radiographics : a review publication of the Radiological Society of North America, Inc.

[19]  Stefan Bruckner,et al.  LiveSync: Deformed Viewing Spheres for Knowledge-Based Navigation , 2007, IEEE Transactions on Visualization and Computer Graphics.

[20]  Kwan-Liu Ma,et al.  Visibility-driven transfer functions , 2009, 2009 IEEE Pacific Visualization Symposium.

[21]  Markus Hadwiger,et al.  Real-time volume graphics , 2006, Eurographics.

[22]  Han-Wei Shen,et al.  View selection for volume rendering , 2005, VIS 05. IEEE Visualization, 2005..

[23]  Hanchuan Peng,et al.  V3D enables real-time 3D visualization and quantitative analysis of large-scale biological image data sets , 2010, Nature Biotechnology.

[24]  Amy Henderson Squilacote The Paraview Guide , 2008 .

[25]  Stefan Bruckner,et al.  Integrating volume visualization techniques into medical applications , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[26]  Jian Zhang,et al.  Efficient opacity specification based on feature visibilities in direct volume rendering , 2011, Comput. Graph. Forum.

[27]  Enrico Gobbetti,et al.  GPU Accelerated Direct Volume Rendering on an Interactive Light Field Display , 2008, Comput. Graph. Forum.

[28]  Klaus D. Tönnies,et al.  Volume rendering for interactive 3D segmentation , 1997, Medical Imaging.

[29]  Frank Nielsen,et al.  Volume catcher , 2005, I3D '05.

[30]  Hans-Christian Hege,et al.  Perception-Oriented Picking of Structures in Direct Volumetric , 2011 .

[31]  H. Barlow Vision: A computational investigation into the human representation and processing of visual information: David Marr. San Francisco: W. H. Freeman, 1982. pp. xvi + 397 , 1983 .

[32]  Andreas Kolb,et al.  Opacity Peeling for Direct Volume Rendering , 2006, Comput. Graph. Forum.

[33]  Stefan Bruckner,et al.  Contextual picking of volumetric structures , 2009, 2009 IEEE Pacific Visualization Symposium.

[34]  Melanie Tory,et al.  Human factors in visualization research , 2004, IEEE Transactions on Visualization and Computer Graphics.