Examples of in transit visualization

One of the most pressing issues with petascale analysis is the transport of simulation results data to a meaningful analysis. Traditional workflow prescribes storing the simulation results to disk and later retrieving them for analysis and visualization. However, at petascale this storage of the full results is prohibitive. A solution to this problem is to run the analysis and visualization concurrently with the simulation and bypass the storage of the full results. One mechanism for doing so is in transit visualization in which analysis and visualization is run on I/O nodes that receive the full simulation results but write information from analysis or provide run-time visualization. This paper describes the work in progress for three in transit visualization solutions, each using a different transport mechanism.

[1]  Marianne Winslett,et al.  Multidimensional array I/O in Panda 1.0 , 2004, The Journal of Supercomputing.

[2]  Olivier Coulaud,et al.  A Steering Environment for Online Parallel Visualization of Legacy Parallel Simulations , 2006, 2006 Tenth IEEE International Symposium on Distributed Simulation and Real-Time Applications.

[3]  Karsten Schwan,et al.  DataStager: scalable data staging services for petascale applications , 2009, HPDC '09.

[4]  Scott Klasky,et al.  Collaborative monitoring and analysis for simulation scientists , 2010, 2010 International Symposium on Collaborative Technologies and Systems.

[5]  Wei-keng Liao,et al.  Scaling parallel I/O performance through I/O delegate and caching system , 2008, HiPC 2008.

[6]  John Biddiscombe,et al.  Parallel computational steering and analysis for HPC applications using a paraview interface and the HDF5 DSM virtual file driver , 2011, EGPGV '11.

[7]  Karsten Schwan,et al.  ...and eat it too: high read performance in write-optimized HPC I/O middleware file formats , 2009, PDSW '09.

[8]  Alfred Inselberg.  Visualization and knowledge discovery for high dimensional data , 2001, Proceedings Second International Workshop on User Interfaces in Data Intensive Systems. UIDIS 2001.

[9]  Fan Zhang,et al.  Experiments with Memory-to-Memory Coupling for End-to-End Fusion Simulation Workflows , 2010, 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing.

[10]  Ray W. Grout,et al.  EDO: Improving Read Performance for Scientific Applications through Elastic Data Organization , 2011, 2011 IEEE International Conference on Cluster Computing.

[11]  Karsten Schwan,et al.  Managing Variability in the IO Performance of Petascale Storage Systems , 2010, 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis.

[12]  Hank Childs.  Architectural challenges and solutions for petascale postprocessing , 2007 .

[13]  Robert Thurlow,et al.  RPC: Remote Procedure Call Protocol Specification Version 2 , 2009, RFC.

[14]  Charles D. Hansen,et al.  Interactive Simulation and Visualization , 1999, Computer.

[15]  Fan Zhang,et al.  Enabling Multi-physics Coupled Simulations within the PGAS Programming Framework , 2011, 2011 11th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing.

[16]  J. M. McGlaun,et al.  CTH: A software family for multi-dimensional shock physics analysis , 1995 .

[17]  Scott Klasky,et al.  DataSpaces: an interaction and coordination framework for coupled simulation workflows , 2012, HPDC '10.

[18]  Patrick M. Widener,et al.  Efficient Data-Movement for Lightweight I/O , 2006, 2006 IEEE International Conference on Cluster Computing.

[19]  Seetharami R. Seelam,et al.  Modeling the Impact of Checkpoints on Next-Generation Systems , 2007, 24th IEEE Conference on Mass Storage Systems and Technologies (MSST 2007).

[20]  Robert Latham,et al.  End-to-End Study of Parallel Volume Rendering on the IBM Blue Gene/P , 2009, 2009 International Conference on Parallel Processing.

[21]  David Edwards,et al.  Visualization in a parallel processing environment , 1997 .

[22]  Rolf Riesen,et al.  Lightweight I/O for Scientific Applications , 2006, 2006 IEEE International Conference on Cluster Computing.

[23]  David Kotz,et al.  Disk-directed I/O for MIMD multiprocessors , 1994, OSDI '94.

[24]  Ron A. Oldfield,et al.  Efficient Parallel I/o in sEismic Imaging , 1998, Int. J. High Perform. Comput. Appl..

[25]  Kenneth Moreland,et al.  Sandia National Laboratories , 2000 .

[26]  Kenneth E. Jansen,et al.  A stabilized finite element method for the incompressible Navier–Stokes equations using a hierarchical basis , 2001 .

[27]  Robert B. Ross,et al.  End-to-End Study of Parallel Volume Rendering on the IBM Blue Gene/P , 2008, 2009 International Conference on Parallel Processing.

[28]  Amy Henderson,et al.  The ParaView Guide: A Parallel Visualization Application , 2004 .

[29]  Michael E. Papka,et al.  Topology-aware data movement and staging for I/O acceleration on Blue Gene/P supercomputing systems , 2011, 2011 International Conference for High Performance Computing, Networking, Storage and Analysis (SC).

[30]  Karsten Schwan,et al.  Adaptable, metadata rich IO methods for portable high performance IO , 2009, 2009 IEEE International Symposium on Parallel & Distributed Processing.

[31]  Raj Srinivasan,et al.  RPC: Remote Procedure Call Protocol Specification Version 2 , 1995, RFC.

[32]  Robert Ross,et al.  Visualization and parallel I/O at extreme scale , 2008, Journal of Physics: Conference Series.

[33]  Kesheng Wu,et al.  Scientific Discovery at the Exascale , 2011 .

[34]  Ron A. Oldfield,et al.  Access to External Resources Using Service-Node Proxies , 2009 .