A collaborative molecular graphics tool for knowledge dissemination with augmented reality and 3D printing

We propose in this article a concept called "augmented 3D printing with molecular modeling" as an application framework. Visualization is an essential means to represent complex biochemical and biological objects in order to understand their structures as functions. By pairing augmented reality systems and 3D printing, we propose to design a new collaborative molecular graphics tool (under implementation) for scientific visualization and visual analytics. The printed object is then used as a support for the visual augmentation by allowing the superimposition of different visualizations. Thus, still aware of his environment, the user can easily communicate with his collaborators while moving around the object. This user-friendly tool, dedicated to non-initiated scientists, will facilitate the dissemination of knowledge and collaboration between interdisciplinary researchers. Here, we present a first prototype and we focus on the main molecule tracking component. Initial feedback from our users suggests that our proposal is valid, and shows a real interest in this type of tool, with an intuitive interface. CCS Concepts • Computing methodologies → Modeling methodologies; Mixed / augmented reality; Scientific visualization; • Humancentered computing → Graphical user interfaces;

[1]  P. Urban,et al.  Pushing the Limits of 3D Color Printing , 2015, ACM Trans. Graph..

[2]  Marc Baaden,et al.  Using Computer Simulations and Virtual Reality to Understand, Design and Optimize Artificial Water Channels , 2019, Advances in Bionanomaterials II.

[3]  UrbanPhilipp,et al.  3D printing spatially varying color and translucency , 2018 .

[4]  M. Sanner,et al.  Reduced surface: an efficient way to compute molecular surfaces. , 1996, Biopolymers.

[5]  Alexandre Gillet,et al.  Tangible interfaces for structural molecular biology. , 2005, Structure.

[6]  Colin Berry,et al.  A Protein in the palm of your hand through augmented reality , 2014, Biochemistry and molecular biology education : a bimonthly publication of the International Union of Biochemistry and Molecular Biology.

[7]  Zhihan Lv,et al.  Game On, Science - How Video Game Technology May Help Biologists Tackle Visualization Challenges , 2013, PloS one.

[8]  Oussama Metatla,et al.  Sampling molecular conformations and dynamics in a multiuser virtual reality framework , 2018, Science Advances.

[9]  T. N. Bhat,et al.  The Protein Data Bank , 2000, Nucleic Acids Res..

[10]  David Engel,et al.  Visualizing biomolecular electrostatics in virtual reality with UnityMol‐APBS , 2019, Protein science : a publication of the Protein Society.

[11]  M. Chavent,et al.  Visualizing protein structures - tools and trends. , 2020, Biochemical Society transactions.

[12]  Chengxin Zhang,et al.  PyMod 2.0: improvements in protein sequence‐structure analysis and homology modeling within PyMOL , 2016, Bioinform..

[13]  Martin Weinmann,et al.  Evaluation of HoloLens Tracking and Depth Sensing for Indoor Mapping Applications , 2020, Sensors.

[14]  Nicolas Férey,et al.  3D reconstruction with a markerless tracking method of flexible and modular molecular physical models: towards tangible interfaces , 2017, J. Virtual Real. Broadcast..

[15]  Stephan Lukosch,et al.  Collaboration in Augmented Reality , 2015, Computer Supported Cooperative Work (CSCW).

[16]  K Schulten,et al.  VMD: visual molecular dynamics. , 1996, Journal of molecular graphics.

[17]  Thomas Ertl,et al.  Interactive Molecular Graphics for Augmented Reality Using HoloLens , 2018, J. Integr. Bioinform..

[18]  B. Rupp,et al.  Crystallization and preliminary X-ray analysis of two new crystal forms of calmodulin. , 1996, Acta crystallographica. Section D, Biological crystallography.