Slice WIM: a multi-surface, multi-touch interface for overview+detail exploration of volume datasets in virtual reality

We present Slice WIM, a method for overview+detail visualization of volume datasets that explores the potential of new interfaces made possible by a virtual reality (VR) environment made of two display surfaces: an interactive multi-touch table, and a stereoscopic display wall. Slice WIM displays a miniature version of the 3D dataset within a head-tracked stereoscopic view such that it appears to float directly above the multi-touch table. Multi-touch gestures on the table are then used to navigate through the dataset and to set slices (cutting planes) through the data. Leveraging the unique table+wall hardware setup, horizontal slices through the data are projected (like a shadow) down onto the table surface, providing a useful 2D data overview to complement the 3D views as well as a data context for interpreting 2D multi-touch gestures made on the table. We demonstrate several strategies for interacting with 2D "shadow slices" on the table surface as a method for controlling the WIM and exploring volumetric datasets. Applications of the interface to explore two different volume datasets are presented, and design decisions and limitations are discussed along with feedback from both casual users and domain scientists.

[1]  Ferran Argelaguet,et al.  Complexity and Occlusion Management for the World-in-Miniature Metaphor , 2009, Smart Graphics.

[2]  Gabriel Robles-De-La-Torre,et al.  The importance of the sense of touch in virtual and real environments , 2006, IEEE MultiMedia.

[3]  Melanie Tory,et al.  Visualization task performance with 2D, 3D, and combination displays , 2006, IEEE Transactions on Visualization and Computer Graphics.

[4]  Joseph J. LaViola,et al.  Hands-free multi-scale navigation in virtual environments , 2001, I3D '01.

[5]  H. Hauser,et al.  Interactive focus+context visualization with linked 2D/3D scatterplots , 2004, Proceedings. Second International Conference on Coordinated and Multiple Views in Exploratory Visualization, 2004..

[6]  Daniel C. Robbins,et al.  Interactive shadows , 1992, UIST '92.

[7]  Chi-Wing Fu,et al.  Scalable WIM: Effective Exploration in Large-scale Astrophysical Environments , 2006, IEEE Transactions on Visualization and Computer Graphics.

[8]  Raimund Dachselt,et al.  PaperLens: advanced magic lens interaction above the tabletop , 2009, ITS '09.

[9]  Harvey S. Smallman,et al.  The Use of 2D and 3D Displays for Shape-Understanding versus Relative-Position Tasks , 2001, Hum. Factors.

[10]  Yi Sun,et al.  A Process for Design, Verification, Validation, and Manufacture of Medical Devices Using Immersive VR Environments , 2010 .

[11]  Tobias Isenberg,et al.  FI3D: Direct-Touch Interaction for the Exploration of 3D Scientific Visualization Spaces , 2010, IEEE Transactions on Visualization and Computer Graphics.

[12]  Randy F. Pausch,et al.  Navigation and locomotion in virtual worlds via flight into hand-held miniatures , 1995, SIGGRAPH.

[13]  Doug A. Bowman,et al.  Overcoming World in Miniature Limitations by a Scaled and Scrolling WIM , 2006, 3D User Interfaces (3DUI'06).

[14]  Yvonne Rogers,et al.  Collaboration and interference: awareness with mice or touch input , 2008, CSCW.

[15]  Daniel F. Keefe,et al.  Particle flurries: synoptic 3D pulsatile flow visualization. , 2004, IEEE computer graphics and applications.

[16]  Bernd Fröhlich,et al.  The Responsive Workbench [virtual work environment] , 1994, IEEE Computer Graphics and Applications.

[17]  Benjamin B. Bederson,et al.  A review of overview+detail, zooming, and focus+context interfaces , 2009, CSUR.

[18]  Christian H. Bischof,et al.  Interactive Blood Damage Analysis for Ventricular Assist Devices , 2008, IEEE Transactions on Visualization and Computer Graphics.

[19]  Martin Hachet,et al.  The Interaction Table - a New Input Device Designed for Interaction in Immersive Large Display Environments , 2002, EGVE.

[20]  Jefferson Y. Han.  Low-cost multi-touch sensing through frustrated total internal reflection , 2005, UIST.

[21]  Daniel F. Keefe,et al.  Low Cost VR Meets Low Cost Multi-touch , 2010, ISVC.

[22]  Brian P. Bailey,et al.  An Evaluation of Techniques for Controlling Focus+Context Screens , 2004, Graphics Interface.

[23]  Fotis Sotiropoulos,et al.  Erratum to: Simulation of the Three-Dimensional Hinge Flow Fields of a Bileaflet Mechanical Heart Valve Under Aortic Conditions , 2010, Annals of Biomedical Engineering.

[24]  Randy Pausch,et al.  Virtual reality on a WIM: interactive worlds in miniature , 1995, CHI '95.

[25]  Tovi Grossman,et al.  The design and evaluation of selection techniques for 3D volumetric displays , 2006, UIST.

[26]  Tobias Isenberg,et al.  Depth-Dependent Halos: Illustrative Rendering of Dense Line Data , 2009, IEEE Transactions on Visualization and Computer Graphics.

[27]  Allison Woodruff,et al.  Guidelines for using multiple views in information visualization , 2000, AVI '00.

[28]  Patrick Baudisch,et al.  Focus plus context screens: combining display technology with visualization techniques , 2001, UIST '01.

[29]  Steven K. Feiner,et al.  Balloon Selection: A Multi-Finger Technique for Accurate Low-Fatigue 3D Selection , 2007, 2007 IEEE Symposium on 3D User Interfaces.

[30]  Patrick Baudisch,et al.  Keeping things in context: a comparative evaluation of focus plus context screens, overviews, and zooming , 2002, CHI.

[31]  William Ribarsky,et al.  Multi-Focused Geospatial Analysis Using Probes , 2008, IEEE Transactions on Visualization and Computer Graphics.

[32]  Steve Bryson.  Virtual reality in scientific visualization , 1993, Comput. Graph..

[33]  Tony DeRose,et al.  Determining the benefits of direct-touch, bimanual, and multifinger input on a multitouch workstation , 2009, Graphics Interface.

[34]  Daniel J. Wigdor,et al.  Table-centric interactive spaces for real-time collaboration , 2006, AVI '06.

[35]  Klaus H. Hinrichs,et al.  Touching Floating Objects in Projection-based Virtual Reality Environments , 2010, EGVE/EuroVR/VEC.