Interactive visual analytics of molecular data in immersive environments via a semantic definition of the content and the context

Bringing together, in a unique immersive environment, visualization and analysis of scientific and complex data requires a thorough approach in order to fulfill scientists' specific expectations. Such an approach needs to consider the highly heterogeneous nature of data, the dynamic interactions between experts and data, and the large amount of data involved in scientific studies. Whereas small and static scientific datasets can quickly be deciphered thanks to standard immersive tools such as 3D visualization software packages, bigger and dynamic datasets exceed the analytical capacity of these tools, requiring an efficient platform for their manipulation. Through the example of the structural biology field we discuss the need for an approach based on a high-level definition of the content (scientific data) and the context (immersive environments and interfaces). Our design is illustrated by a platform for dynamic and intelligent representation of data to the user. The data hierarchical classification will provide new ways to interact with the data via intelligent and direct relationships between them. This approach is based on the semantic definition of all the concepts manipulated in the virtual environment, either abstract or concrete, which allows for an adaptive and interactive experience of both visualization and analysis.

[1]  Zhihan Lv,et al.  Game On, Science - How Video Game Technology May Help Biologists Tackle Visualization Challenges , 2013, PloS one.

[2]  James A. Hendler,et al.  The Semantic Web" in Scientific American , 2001 .

[3]  M. Ashburner,et al.  Gene Ontology: tool for the unification of biology , 2000, Nature Genetics.

[4]  Dennis Wiebusch,et al.  Decoupling the entity-component-system pattern using semantic traits for reusable realtime interactive systems , 2015, 2015 IEEE 8th Workshop on Software Engineering and Architectures for Realtime Interactive Systems (SEARIS).

[5]  Valerie Daggett,et al.  DIVE: A Graph-Based Visual-Analytics Framework for Big Data , 2014, IEEE Computer Graphics and Applications.

[6]  Daniel Thalmann,et al.  Semantics-based representation of virtual environments , 2005, Int. J. Comput. Appl. Technol..

[7]  Marc Baaden,et al.  Molecular simulations and visualization: introduction and overview. , 2014, Faraday discussions.

[8]  Joseph J. LaViola,et al.  Immersive VR for Scientific Visualization: A Progress Report , 2000, IEEE Computer Graphics and Applications.

[9]  Mehdi Ammi,et al.  Multisensory VR interaction for protein-docking in the CoRSAIRe project , 2009, Virtual Reality.

[10]  Marcus D. Hanwell,et al.  Avogadro: an advanced semantic chemical editor, visualization, and analysis platform , 2012, Journal of Cheminformatics.

[11]  John Annett.  Hierarchical Task Analysis , 2003 .

[12]  K Schulten,et al.  VMD: visual molecular dynamics. , 1996, Journal of molecular graphics.

[13]  Dan Brickley,et al.  Rdf vocabulary description language 1.0 : Rdf schema , 2004 .

[14]  Heedong Ko,et al.  Semantic 3D object manipulation using object ontology in multimodal interaction framework , 2005, ICAT '05.

[15]  Klaus Schulten,et al.  Immersive Molecular Visualization and Interactive Modeling with Commodity Hardware , 2010, ISVC.

[16]  Steffen Schulze-Kremer,et al.  Ontologies for molecular biology and bioinformatics , 2002, Silico Biol..

[17]  D. Goodsell,et al.  Visualization of macromolecular structures , 2010, Nature Methods.

[18]  Nadine Schuurman,et al.  Ontologies for Bioinformatics , 2008, Bioinformatics and biology insights.

[19]  W. Delano.  The PyMOL Molecular Graphics System , 2002 .

[20]  Olga De Troyer,et al.  Designing Semantic Virtual Reality Applications , 2005 .