Tangible interfaces for structural molecular biology.

The evolving technology of computer autofabrication makes it possible to produce physical models for complex biological molecules and assemblies. Augmented reality has recently developed as a computer interface technology that enables the mixing of real-world objects and computer-generated graphics. We report an application that demonstrates the use of autofabricated tangible models and augmented reality for research and communication in molecular biology. We have extended our molecular modeling environment, PMV, to support the fabrication of a wide variety of physical molecular models, and have adapted an augmented reality system to allow virtual 3D representations to be overlaid onto the tangible molecular models. Users can easily change the overlaid information, switching between different representations of the molecule, displays of molecular properties, or dynamic information. The physical models provide a powerful, intuitive interface for manipulating the computer models, streamlining the interface between human intent, the physical model, and the computational activity.

[1]  Michel F. Sanner,et al.  Role of haptics in teaching structural molecular biology , 2003, 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003. HAPTICS 2003. Proceedings..

[2]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[3]  Frederick P. Brooks,et al.  Using a manipulator for force display in molecular docking , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[4]  Hiroshi Ishii,et al.  Tangible interfaces for remote collaboration and communication , 1998, CSCW '98.

[5]  Woodrow Barfield,et al.  Measuring Presence in Virtual Environments: A Presence Questionnaire , 1998, Presence.

[6]  Dinesh Manocha,et al.  OBBTree: a hierarchical structure for rapid interference detection , 1996, SIGGRAPH.

[7]  Frederick P. Brooks,et al.  What's Real About Virtual Reality? , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[8]  Hirokazu Kato,et al.  Collaborative Mixed Reality , 1999 .

[9]  A. Olson,et al.  Approximation and characterization of molecular surfaces , 1993, Biopolymers.

[10]  F. Crick,et al.  Molecular Structure of Nucleic Acids: A Structure for Deoxyribose Nucleic Acid , 1953, Nature.

[11]  Hiroshi Ishii,et al.  Bricks: laying the foundations for graspable user interfaces , 1995, CHI '95.

[12]  Michel F Sanner,et al.  A component-based software environment for visualizing large macromolecular assemblies. , 2005, Structure.

[13]  David S. Goodsell,et al.  Augmented reality with tangible auto-fabricated models for molecular biology applications , 2004, IEEE Visualization 2004.

[14]  M F Sanner,et al.  Python: a programming language for software integration and development. , 1999, Journal of molecular graphics & modelling.

[15]  Ivan Poupyrev,et al.  A framework and testbed for studying manipulation techniques for immersive VR , 1997, VRST '97.

[16]  L. Pauling,et al.  Two hydrogen-bonded spiral configurations of the polypeptide chain , 1950 .

[17]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[18]  M. Sanner,et al.  Reduced surface: an efficient way to compute molecular surfaces. , 1996, Biopolymers.

[19]  Gudrun Klinker,et al.  Augmented Reality : Placing Artificial Objects in Real Scenes , 1999 .

[20]  Hiroshi Ishii,et al.  Triangles: tangible interface for manipulation and exploration of digital information topography , 1998, CHI.

[21]  Hiroshi Ishii,et al.  Emancipated pixels: real-world graphics in the luminous room , 1999, SIGGRAPH.

[22]  Frederick P. Brooks What's Real About Virtual Reality? , 1999, IEEE Computer Graphics and Applications.