Reach the virtual environment: 3D tangible interaction with scientific data

In this paper we present an augmented virtuality system with a set of tangible devices for interactive visualization with scientific data (volumetric scalar field data and molecular data). We describe the design concepts and application scenarios that underlie the development of the interfaces and system. The prototype system allows users to interact with scientific data by manipulating tangible devices, such as a graspable cube, pen and plane frame. These devices provide passive haptic cues that help the user to maintain position awareness and relative spatial relation during three-dimensional (3D) interaction. Active stereoscopic shutter glasses can be used to provide a 3D display, whenever necessary. We describe the differences with traditional fish tank and fully immersive virtual reality (VR) systems. At the end of the paper, we discuss the user experience and the research questions related to VR system with tangible interfaces for visualization application. Our planned activities for obtaining a more in-depth understanding of some of the usability issues involved through user study are described as well.

[1]  N. Guex,et al.  SWISS‐MODEL and the Swiss‐Pdb Viewer: An environment for comparative protein modeling , 1997, Electrophoresis.

[2]  Wolfgang Straßer,et al.  Enabling classification and shading for 3D texture mapping based volume rendering using OpenGL and extensions , 1999, VIS '99.

[3]  Dieter Schmalstieg,et al.  “Studierstube”: An environment for collaboration in augmented reality , 1998, Virtual Reality.

[4]  Jean-Bernard Martens,et al.  Tangible user interfaces for 3D clipping plane interaction with volumetric data: a case study , 2005, ICMI '05.

[5]  K Schulten,et al.  VMD: visual molecular dynamics. , 1996, Journal of molecular graphics.

[6]  J. C. Mulder,et al.  The personal space station: Bringing interaction within reach , 2002 .

[7]  Frederick P. Brooks.  What's Real About Virtual Reality? , 1999, IEEE Computer Graphics and Applications.

[8]  Leonid Zhukov,et al.  Computational Field Visualization , 2001 .

[9]  Ivan Poupyrev,et al.  3D User Interfaces: Theory and Practice , 2004 .

[10]  Hiroshi Ishii,et al.  Immersive design of DMA molecules with a tangible interface , 2004, IEEE Visualization 2004.

[11]  Torsten Fröhlich,et al.  Molecular Dynamics Simulation in Virtual Environments , 1998, Comput. Graph. Forum.

[12]  Tara Matthews,et al.  EEWWW!!: tangible interfaces for navigating into the human body , 2003, CHI Extended Abstracts.

[13]  Hiroshi Ishii,et al.  Emerging frameworks for tangible user interfaces , 2000, IBM Syst. J..

[14]  A. Limaye,et al.  UNIVIS-2000: An indigenously developed comprehensive visualization package , 2001 .

[15]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[16]  Mary C. Whitton,et al.  Passive haptics significantly enhances virtual environments , 2001 .

[17]  Loren G. Terveen,et al.  Let's Stop Pushing the Envelope and Start Addressing It: A Reference Task Agenda for HCI , 2000, Hum. Comput. Interact..

[18]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[19]  Ulrich Lang,et al.  Evaluation of a Collaborative Volume Rendering Application in a Distributed Virtual Environment , 2002, EGVE.

[20]  Steve Bryson,et al.  Virtual reality in scientific visualization , 1993, CACM.

[21]  Kellogg S. Booth,et al.  Fish tank virtual reality , 1993, INTERCHI.

[22]  P BrooksFrederick.  What's Real About Virtual Reality? , 1999 .

[23]  Bernd Fröhlich,et al.  The cubic mouse: a new device for three-dimensional input , 2000, CHI.

[24]  Robert van Liere,et al.  Experiencing 3D interactions in virtual reality and augmented reality , 2004, EUSAI '04.

[25]  R A Sayle,et al.  RASMOL: biomolecular graphics for all. , 1995, Trends in biochemical sciences.

[26]  A Engel,et al.  Real-time isocontouring and texture mapping meet new challenges in interactive molecular graphics applications. , 1996, Journal of structural biology.

[27]  Vladimir Pavlovic,et al.  Speech/Gesture Interface to a Visual-Computing Environment , 2000, IEEE Computer Graphics and Applications.

[28]  Robert van Liere,et al.  Search Space Reduction in Optical Tracking , 2003, IPT/EGVE.

[29]  Robert W. Lindeman,et al.  Towards usable VR: an empirical study of user interfaces for immersive virtual environments , 1999, CHI '99.

[30]  Charles Hansen,et al.  The Visualization Handbook , 2011 .

[31]  Joseph J. LaViola,et al.  Immersive VR for Scientific Visualization: A Progress Report , 2000, IEEE Computer Graphics and Applications.

[32]  Ken Hinckley,et al.  Haptic issues for virtual manipulation , 1997 .

[33]  Robert van Liere,et al.  Optical tracking using projective invariant marker pattern properties , 2003, IEEE Virtual Reality, 2003. Proceedings..