Visualization of time-dependent remote adaptive mesh refinement data

Analysis of phenomena that simultaneously occur on different spatial and temporal scales requires adaptive, hierarchical schemes to reduce computational and storage demands. Adaptive mesh refinement (AMR) schemes support both refinement in space that results in a time-dependent grid topology, as well as refinement in time that results in updates at higher rates for refined levels. Visualization of AMR data requires generating data for absent refinement levels at specific time steps. We describe a solution starting from a given set of "key frames" with potentially different grid topologies. The presented work was developed in a project involving several research institutes that collaborate in the field of cosmology and numerical relativity. AMR data results from simulations that are run on dedicated compute machines and is thus stored centrally, whereas the analysis of the data is performed on the local computers of the scientists. We built a distributed solution using remote procedure calls (RPC). To keep the application responsive, we split the bulk data transfer from the RPC response and deliver it asynchronously as a binary stream. The number of network round-trips is minimized by using high level operations. In summary, we provide an application for exploratory visualization of remotely stored AMR data.

[1]  John Shalf,et al.  Parallel cell projection rendering of adaptive mesh refinement data , 2003, IEEE Symposium on Parallel and Large-Data Visualization and Graphics, 2003. PVG 2003..

[2]  Steven L. Liebling.  The nonlinear sigma model with distributed adaptive mesh refinement , 2004 .

[3]  Hans-Christian Hege,et al.  Texture-based volume rendering of adaptive mesh refinement data , 2002, The Visual Computer.

[4]  Jianwei Li,et al.  Parallel netCDF: A High-Performance Scientific I/O Interface , 2003, ACM/IEEE SC 2003 Conference (SC'03).

[5]  Steffen Prohaska,et al.  Remote data access for interactive visualization , 2005 .

[6]  John Shalf,et al.  Cactus and Visapult: An ultra-high performance grid-distributed visualization architecture using connectionless protocols , 2002 .

[7]  Andy Hopper,et al.  Virtual Network Computing , 1998, IEEE Internet Comput..

[8]  C.E. Shannon,et al.  Communication in the Presence of Noise , 1949, Proceedings of the IRE.

[9]  A. Hohmann,et al.  Numerical Analysis in Modern Scientific Computing: An Introduction , 2003 .

[10]  John Shalf,et al.  Deploying Web-Based Visual Exploration Tools on the Grid , 2002, IEEE Computer Graphics and Applications.

[11]  Kyle A. Gallivan,et al.  The gSOAP Toolkit for Web Services and Peer-to-Peer Computing Networks , 2002, 2nd IEEE/ACM International Symposium on Cluster Computing and the Grid (CCGRID'02).

[12]  John Shalf,et al.  Ieee Computer Graphics and Applications Numerical Relativity Grid-distributed Visualizations Using Connectionless Protocols Graphics Applications for Grid Computing , 2022 .

[13]  Jason Lee,et al.  Using High-Speed WANs and Network Data Caches to Enable Remote and Distributed Visualization , 2000, ACM/IEEE SC 2000 Conference (SC'00).

[14]  H. Rentz-Reichert,et al.  UG – A flexible software toolbox for solving partial differential equations , 1997 .

[15]  Hans-Christian Hege,et al.  Interactive exploration of large remote micro-CT scans , 2004, IEEE Visualization 2004.

[16]  H. Hege,et al.  Fast Volume Rendering of Sparse Datasets Using Adaptive Mesh Refinement , 2001 .

[17]  John B. Bell,et al.  A Cartesian Grid Projection Method for the Incompressible Euler Equations in Complex Geometries , 1994, SIAM J. Sci. Comput..

[18]  John Shalf,et al.  Diving deep: data-management and visualization strategies for adaptive mesh refinement simulations , 1999, Comput. Sci. Eng..

[19]  Scott H. Hawley,et al.  Evolutions in 3D numerical relativity using fixed mesh refinement , 2003, gr-qc/0310042.

[20]  Hans-Christian Hege,et al.  Interactive Volume Rendering of Large Sparse Data Sets Using Adaptive Mesh Refinement Hierarchies , 2003, IEEE Trans. Vis. Comput. Graph..

[21]  Robert L. Grossman,et al.  Experiences in Design and Implementation of a High Performance Transport Protocol , 2004, Proceedings of the ACM/IEEE SC2004 Conference.

[22]  Isidore Rigoutsos,et al.  An algorithm for point clustering and grid generation , 1991, IEEE Trans. Syst. Man Cybern..

[23]  P. Colella,et al.  Local adaptive mesh refinement for shock hydrodynamics , 1989 .

[24]  Kwan-Liu Ma,et al.  Parallel rendering of 3D AMR data on the SGI/Cray T3E , 1999, Proceedings. Frontiers '99. Seventh Symposium on the Frontiers of Massively Parallel Computation.

[25]  Greg L. Bryan,et al.  Fluids in the universe: adaptive mesh refinement in cosmology , 1999, Comput. Sci. Eng..

[26]  Klaus Mueller,et al.  IBR-Assisted Volume Rendering , 1999 .

[27]  M. Rumpf,et al.  Visualizing Data from Time-Dependent AdaptiveSimulationsR , 1995 .

[28]  Jason Leigh,et al.  Quanta: a toolkit for high performance data delivery over photonic networks , 2003, Future Gener. Comput. Syst..

[29]  Joel H. Saltz,et al.  DataCutter: Middleware for Filtering Very Large Scientific Datasets on Archival Storage Systems , 2000, IEEE Symposium on Mass Storage Systems.

[30]  Xin Wang,et al.  Volume tracking , 1996, Proceedings of Seventh Annual IEEE Visualization '96.

[31]  M. Berger,et al.  Adaptive mesh refinement for hyperbolic partial differential equations , 1982 .

[32]  Ian T. Foster,et al.  Remote I/O: fast access to distant storage , 1997, IOPADS '97.

[33]  Donna J. Cox,et al.  Rendering the first star in the Universe - A case study , 2002, IEEE Visualization, 2002. VIS 2002..

[34]  Steven L. Liebling.  Singularity threshold of the nonlinear sigma model using 3D adaptive mesh refinement , 2002 .

[35]  Ken Brodlie,et al.  Controlled Interpolation for Scientific Visualization , 1994, Scientific Visualization.

[36]  John Shalf,et al.  High-quality Volume Rendering of Adaptive Mesh Refinement Data , 2001, VMV.

[37]  Konrad Polthier.  A Concept for Time-Dependent Processes , 1999 .

[38]  Chandrajit L. Bajaj,et al.  Case study: Interactive rendering of adaptive mesh refinement data , 2002, IEEE Visualization, 2002. VIS 2002..

[39]  Joel H. Saltz,et al.  Visualization of Large Data Sets with the Active Data Repository , 2001, IEEE Computer Graphics and Applications.

[40]  Robert Latham,et al.  Parallel netCDF: A Scientific High-Performance I/O Interface , 2003, ArXiv.

[41]  John Shalf,et al.  Extraction of Crack-free Isosurfaces from Adaptive Mesh Refinement Data , 2001, VisSym.

[42]  Roland Rühle,et al.  On-line Visualization of Arbitrary Unstructured, Adaptive Grids , 1995, Visualization in Scientific Computing.

[43]  Michael L. Norman,et al.  The Formation of the First Star in the Universe , 2001, Science.

[44]  Hans-Christian Hege,et al.  amira: A Highly Interactive System for Visual Data Analysis , 2005, The Visualization Handbook.

[45]  Ian T. Foster,et al.  Data management and transfer in high-performance computational grid environments , 2002, Parallel Comput..