High Performance Molecular Visualization: In-Situ and Parallel Rendering with EGL

Large scale molecular dynamics simulations produce terabytes of data that is impractical to transfer to remote facilities. It is therefore necessary to perform visualization tasks in-situ as the data are generated, or by running interactive remote visualization sessions and batch analyses co-located with direct access to high performance storage systems. A significant challenge for deploying visualization software within clouds, clusters, and supercomputers involves the operating system software required to initialize and manage graphics acceleration hardware. Recently, it has become possible for applications to use the Embedded-system Graphics Library (EGL) to eliminate the requirement for windowing system software on compute nodes, thereby eliminating a significant obstacle to broader use of high performance visualization applications. We outline the potential benefits of this approach in the context of visualization applications used in the cloud, on commodity clusters, and supercomputers. We discuss the implementation of EGL support in VMD, a widely used molecular visualization application, and we outline benefits of the approach for molecular visualization tasks on petascale computers, clouds, and remote visualization servers. We then provide a brief evaluation of the use of EGL in VMD, with tests using developmental graphics drivers on conventional workstations and on Amazon EC2 G2 GPU-accelerated cloud instance types. We expect that the techniques described here will be of broad benefit to many other visualization applications.

[1]  Ravi Kothari,et al.  Identifying sources of Operating System Jitter through fine-grained kernel instrumentation , 2007, 2007 IEEE International Conference on Cluster Computing.

[2]  John E. Stone,et al.  Simulation of reaction diffusion processes over biologically relevant size and time scales using multi-GPU workstations , 2014, Parallel Comput..

[3]  C. C. Law,et al.  ParaView: An End-User Tool for Large-Data Visualization , 2005, The Visualization Handbook.

[4]  John E. Stone,et al.  Probing Biomolecular Machines with Graphics Processors , 2009, ACM Queue.

[5]  William J. Schroeder,et al.  The Visualization Toolkit , 2005, The Visualization Handbook.

[6]  Susan Coghlan,et al.  The Influence of Operating Systems on the Performance of Collective Operations at Extreme Scale , 2006, 2006 IEEE International Conference on Cluster Computing.

[7]  Utkarsh Ayachit,et al.  The ParaView Guide: A Parallel Visualization Application , 2015 .

[8]  Hank Childs,et al.  VisIt: An End-User Tool for Visualizing and Analyzing Very Large Data , 2011 .

[9]  Klaus Schulten,et al.  Immersive Molecular Visualization and Interactive Modeling with Commodity Hardware , 2010, ISVC.

[10]  David K. McAllister,et al.  OptiX: a general purpose ray tracing engine , 2010, ACM Trans. Graph..

[11]  John E. Stone,et al.  Unlocking the Full Potential of the Cray XK 7 Accelerator , 2014 .

[12]  Dhabaleswar K. Panda,et al.  Efficient Inter-node MPI Communication Using GPUDirect RDMA for InfiniBand Clusters with NVIDIA GPUs , 2013, 2013 42nd International Conference on Parallel Processing.

[13]  Klaus Schulten,et al.  Mature HIV-1 capsid structure by cryo-electron microscopy and all-atom molecular dynamics , 2013, Nature.

[14]  Klaus Schulten,et al.  Atomic detail visualization of photosynthetic membranes with GPU-accelerated ray tracing , 2016, Parallel Comput..

[15]  Klaus Schulten,et al.  Chemical Visualization of Human Pathogens : the Retroviral Capsids , 2015 .

[16]  Klaus Schulten,et al.  Molecular modeling of swine influenza A/H1N1, Spanish H1N1, and avian H5N1 flu N1 neuraminidases bound to Tamiflu and Relenza. , 2009, PLoS currents.

[17]  Jeffrey S. Vetter,et al.  Quantifying NUMA and contention effects in multi-GPU systems , 2011, GPGPU-4.

[18]  Klaus Schulten,et al.  A system for interactive molecular dynamics simulation , 2001, I3D '01.

[19]  John E. Stone,et al.  GPU clusters for high-performance computing , 2009, 2009 IEEE International Conference on Cluster Computing and Workshops.

[20]  Klaus Schulten,et al.  Molecular Basis of Drug Resistance in A/H1N1 Virus , 2012, J. Chem. Inf. Model..

[21]  Klaus Schulten,et al.  GPU-accelerated analysis and visualization of large structures solved by molecular dynamics flexible fitting. , 2014, Faraday discussions.

[22]  Klaus Schulten,et al.  Early experiences scaling VMD molecular visualization and analysis jobs on blue waters , 2013, 2013 Extreme Scaling Workshop (xsw 2013).

[23]  K Schulten,et al.  VMD: visual molecular dynamics. , 1996, Journal of molecular graphics.

[24]  Renato Pajarola,et al.  Parallel Rendering on Hybrid Multi-GPU Clusters , 2012, EGPGV@Eurographics.

[25]  Klaus Schulten,et al.  GPU-accelerated molecular visualization on petascale supercomputing platforms , 2013, UltraVis@SC.

[26]  Klaus Schulten,et al.  Immersive Molecular Visualization with Omnidirectional Stereoscopic Ray Tracing and Remote Rendering , 2016, 2016 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW).

[27]  Peter L. Freddolino,et al.  Ten-microsecond molecular dynamics simulation of a fast-folding WW domain. , 2008, Biophysical journal.

[28]  Peter L. Freddolino,et al.  Common structural transitions in explicit-solvent simulations of villin headpiece folding. , 2009, Biophysical journal.

[29]  Scott Pakin,et al.  The Case of the Missing Supercomputer Performance: Achieving Optimal Performance on the 8, 192 Processors of ASCI Q , 2003, SC.

[30]  Sikun Li,et al.  NUMA-aware image compositing on multi-GPU platform , 2013, The Visual Computer.

[31]  Klaus Schulten,et al.  Visualization of Energy Conversion Processes in a Light Harvesting Organelle at Atomic Detail , 2014 .

[32]  Jeffrey S. Vetter,et al.  Performance Implications of Nonuniform Device Topologies in Scalable Heterogeneous Architectures , 2011, IEEE Micro.

[33]  Pradipta De,et al.  Handling OS jitter on multicore multithreaded systems , 2009, 2009 IEEE International Symposium on Parallel & Distributed Processing.

[34]  Kwan-Liu Ma,et al.  Visualizing large 3D geodesic grid data with massively distributed GPUs , 2014, 2014 IEEE 4th Symposium on Large Data Analysis and Visualization (LDAV).

[35]  James M. Brandt,et al.  Large Scale System Monitoring and Analysis on Blue Waters using OVIS. , 2014 .

[36]  Klaus Schulten,et al.  Molecular Dynamics Simulations Suggest that Electrostatic Funnel Directs Binding of Tamiflu to Influenza N1 Neuraminidases , 2010, PLoS Comput. Biol..

[37]  Klaus Schulten,et al.  Immersive Out-of-Core Visualization of Large-Size and Long-Timescale Molecular Dynamics Trajectories , 2011, ISVC.

[38]  Klaus Schulten,et al.  Accelerating Molecular Modeling Applications with GPU Computing , 2009 .

[39]  Klaus Schulten,et al.  Multilevel summation of electrostatic potentials using graphics processing units , 2009, Parallel Comput..

[40]  Shudong Jin,et al.  Characterization of Input/Output Bandwidth Performance Models in NUMA Architecture for Data Intensive Applications , 2013, 2013 42nd International Conference on Parallel Processing.

[41]  John E. Stone,et al.  OpenCL: A Parallel Programming Standard for Heterogeneous Computing Systems , 2010, Computing in Science & Engineering.

[42]  Laxmikant V. Kale,et al.  MDScope - a visual computing environment for structural biology , 1995 .

[43]  John E. Stone,et al.  Runtime and Architecture Support for Efficient Data Exchange in Multi-Accelerator Applications , 2015, IEEE Transactions on Parallel and Distributed Systems.