Petascale lattice-Boltzmann studies of amphiphilic cubic liquid crystalline materials in a globally distributed high-performance computing and visualization environment

We present very large-scale rheological studies of self-assembled cubic gyroid liquid crystalline phases in ternary mixtures of oil, water and amphiphilic species performed on petascale supercomputers using the lattice-Boltzmann method. These nanomaterials have found diverse applications in materials science and biotechnology, for example, in photovoltaic devices and protein crystallization. They are increasingly gaining importance as delivery vehicles for active agents in pharmaceuticals, personal care products and food technology. In many of these applications, the self-assembled structures are subject to flows of varying strengths and we endeavour to understand their rheological response with the objective of eventually predicting it under given flow conditions. Computationally, our lattice-Boltzmann simulations of ternary fluids are inherently memory- and data-intensive. Furthermore, our interest in dynamical processes necessitates remote visualization and analysis as well as the associated transfer and storage of terabytes of time-dependent data. These simulations are distributed on a high-performance grid infrastructure using the application hosting environment; we employ a novel parallel in situ visualization approach which is particularly suited for such computations on petascale resources. We present computational and I/O performance benchmarks of our application on three different petascale systems.

[1]  Alan Heirich,et al.  Dynamic load balancing for parallel volume rendering , 2006 .

[2]  Peter V. Coveney,et al.  The application hosting environment: Lightweight middleware for grid-based computational science , 2007, Comput. Phys. Commun..

[3]  Kwan-Liu Ma,et al.  In-situ processing and visualization for ultrascale simulations , 2007 .

[4]  Peter V. Coveney,et al.  Real science at the petascale , 2009, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[5]  Tadao Nakamura,et al.  Load balancing strategies for a parallel ray-tracing system based on constant subdivision , 2005, The Visual Computer.

[6]  Peter V. Coveney,et al.  Virtualizing access to scientific applications with the Application Hosting Environment , 2009, Comput. Phys. Commun..

[7]  Shantenu Jha,et al.  Large scale computational science on federated international grids: The role of switched optical networks , 2010, Future Gener. Comput. Syst..

[8]  John D. Owens,et al.  Out‐of‐core Data Management for Path Tracing on Hybrid Resources , 2009, Comput. Graph. Forum.

[9]  Leonid Oliker,et al.  Investigation of leading HPC I/O performance using a scientific-application derived benchmark , 2007, Proceedings of the 2007 ACM/IEEE Conference on Supercomputing (SC '07).

[10]  Peter V. Coveney,et al.  In situ ray tracing and computational steering for interactive blood flow simulation , 2010, Comput. Phys. Commun..

[11]  Alejandro D. Rey,et al.  DYNAMICAL PHENOMENA IN LIQUID-CRYSTALLINE MATERIALS , 2002 .

[12]  Peter V. Coveney,et al.  Facilitating User Access to the Grid: A Lightweight Application Hosting Environment for Grid Enabled Computational Science , 2006, 2006 Second IEEE International Conference on e-Science and Grid Computing (e-Science'06).

[13]  Thomas Ertl,et al.  Large volume visualization of compressed time-dependent datasets on GPU clusters , 2005, Parallel Comput..

[14]  P. V. Coveney,et al.  Simulations of amphiphilic fluids using mesoscale lattice-Boltzmann and lattice-gas methods , 2003 .

[15]  Peter V. Coveney,et al.  Shear rheology of amphiphilic cubic liquid crystals from large-scale kinetic lattice–Boltzmann simulations , 2009 .

[16]  Xiaoyu Zhang,et al.  Scalable isosurface visualization of massive datasets on commodity off-the-shelf clusters , 2009, J. Parallel Distributed Comput..

[17]  R. S. Saksena,et al.  Self-assembly of ternary cubic, hexagonal, and lamellar mesophases using the lattice-Boltzmann kinetic method. , 2008, The journal of physical chemistry. B.

[18]  Philipp Slusallek,et al.  Interactive iso-surface ray tracing of massive volumetric data sets , 2007, EGPGV '07.

[19]  Sylvain Lefebvre,et al.  GigaVoxels: ray-guided streaming for efficient and detailed voxel rendering , 2009, I3D '09.