Scalable In Situ Lagrangian Flow Map Extraction: Demonstrating the Viability of a Communication-Free Model

We introduce and evaluate a new algorithm for the in situ extraction of Lagrangian flow maps, which we call Boundary Termination Optimization (BTO). Our approach is a communication-free model, requiring no message passing or synchronization between processes, improving scalability, thereby reducing overall execution time and alleviating the encumbrance placed on simulation codes from in situ processing. We terminate particle integration at node boundaries and store only a subset of the flow map that would have been extracted by communicating particles across nodes, thus introducing an accuracy-performance tradeoff. We run experiments with as many as 2048 GPUs and with multiple simulation data sets. For the experiment configurations we consider, our findings demonstrate that our communication-free technique saves as much as 2x to 4x in execution time in situ, while staying nearly as accurate quantitatively and qualitatively as previous work. Most significantly, this study establishes the viability of approaching in situ Lagrangian flow map extraction using communication-free models in the future.

[1]  Robert Haimes,et al.  Integration of particle paths and streamlines in a spatially-decomposed computation , 1996 .

[2]  G. Haller.  Finding finite-time invariant manifolds in two-dimensional velocity fields. , 2000, Chaos.

[3]  Anthony Skjellum,et al.  A High-Performance, Portable Implementation of the MPI Message Passing Interface Standard , 1996, Parallel Comput..

[4]  Kenneth I. Joy,et al.  Error Estimates for Lagrangian Flow Field Representations , 2016, EuroVis.

[5]  J. Monaghan,et al.  Smoothed particle hydrodynamics: Theory and application to non-spherical stars , 1977 .

[6]  Stephen A. Jarvis,et al.  CloverLeaf: Preparing Hydrodynamics Codes for Exascale , 2013 .

[7]  Daniel Weiskopf,et al.  Hierarchical Line Integration , 2011, IEEE Transactions on Visualization and Computer Graphics.

[8]  Pierre Alliez,et al.  CGAL - The Computational Geometry Algorithms Library , 2011 .

[9]  Robert B. Ross,et al.  A Study of Parallel Particle Tracing for Steady-State and Time-Varying Flow Fields , 2011, 2011 IEEE International Parallel & Distributed Processing Symposium.

[10]  Jian Huang,et al.  Advection-Based Sparse Data Management for Visualizing Unsteady Flow , 2014, IEEE Transactions on Visualization and Computer Graphics.

[11]  Sriram Krishnamoorthy,et al.  Scalable work stealing , 2009, Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis.

[12]  Hans Hagen,et al.  Efficient Computation and Visualization of Coherent Structures in Fluid Flow Applications , 2007, IEEE Transactions on Visualization and Computer Graphics.

[13]  Kenneth I. Joy,et al.  Lagrangian representations of flow fields with parameter curves , 2015, 2015 IEEE 5th Symposium on Large Data Analysis and Visualization (LDAV).

[14]  Kenneth I. Joy,et al.  Extracting Flow Structures Using Sparse Particles , 2011, VMV.

[15]  Kenneth I. Joy,et al.  Evaluating the benefits of an extended memory hierarchy for parallel streamline algorithms , 2011, 2011 IEEE Symposium on Large Data Analysis and Visualization.

[16]  William Schroeder,et al.  The Visualization Toolkit: An Object-Oriented Approach to 3-D Graphics , 1997 .

[17]  Desmond J. Higham,et al.  Numerical Methods for Ordinary Differential Equations - Initial Value Problems , 2010, Springer undergraduate mathematics series.

[18]  Xiaoru Yuan,et al.  A survey of parallel particle tracing algorithms in flow visualization , 2018, J. Vis..

[19]  Hank Childs,et al.  Accelerating advection via approximate block exterior flow maps , 2017, Visualization and Data Analysis.

[20]  S. Popinet.  Gerris: a tree-based adaptive solver for the incompressible Euler equations in complex geometries , 2003 .

[21]  G. Haller,et al.  Lagrangian coherent structures and mixing in two-dimensional turbulence , 2000 .

[22]  Jian Huang,et al.  Simplified parallel domain traversal , 2011, 2011 International Conference for High Performance Computing, Networking, Storage and Analysis (SC).

[23]  Kenneth I. Joy,et al.  Improved post hoc flow analysis via Lagrangian representations , 2014, 2014 IEEE 4th Symposium on Large Data Analysis and Visualization (LDAV).

[24]  Hans Hagen,et al.  Visualization of Coherent Structures in Transient 2D Flows , 2009, Topology-Based Methods in Visualization II.

[25]  Kenneth I. Joy,et al.  Interpolation-Based Pathline Tracing in Particle-Based Flow Visualization , 2015, IEEE Transactions on Visualization and Computer Graphics.

[26]  G. Haller.  Distinguished material surfaces and coherent structures in three-dimensional fluid flows , 2001 .

[27]  Filip Sadlo,et al.  Time-Dependent Visualization of Lagrangian Coherent Structures by Grid Advection , 2011, Topological Methods in Data Analysis and Visualization.

[28]  David Pugmire,et al.  Performance-Portable Particle Advection with VTK-m , 2018, EGPGV@EuroVis.

[29]  Louise H. Kellogg,et al.  Scalable Parallel Flow Visualization Using 3D Line Integral Convolution for Large Scale Unstructured Simulation Data , 2019, EGPGV@EuroVis.

[30]  Roxana Bujack,et al.  An Interpolation Scheme for VDVP Lagrangian Basis Flows , 2019, EGPGV@EuroVis.

[31]  Li Chen,et al.  Optimizing Parallel Performance of Streamline Visualization for Large Distributed Flow Datasets , 2008, 2008 IEEE Pacific Visualization Symposium.

[32]  Hank Childs,et al.  In Situ Visualization for Computational Science (Dagstuhl Seminar 18271) , 2018, Dagstuhl Reports.

[33]  James P. Ahrens,et al.  The ALPINE In Situ Infrastructure: Ascending from the Ashes of Strawman , 2017, ISAV@SC.

[34]  Scott Klasky,et al.  In Situ Methods, Infrastructures, and Applications on High Performance Computing Platforms , 2016, Comput. Graph. Forum.

[35]  Filip Sadlo,et al.  Efficient Visualization of Lagrangian Coherent Structures by Filtered AMR Ridge Extraction , 2007, IEEE Transactions on Visualization and Computer Graphics.

[36]  Jean M. Sexton,et al.  Nyx: A MASSIVELY PARALLEL AMR CODE FOR COMPUTATIONAL COSMOLOGY , 2013, J. Open Source Softw..

[37]  Han-Wei Shen,et al.  Load-Balanced Parallel Streamline Generation on Large Scale Vector Fields , 2011, IEEE Transactions on Visualization and Computer Graphics.

[38]  Nicholas H. Brummell,et al.  Linear and nonlinear dynamo properties of time-dependent ABC flows , 2001 .

[39]  Christoph Garth,et al.  Distributed parallel particle advection using work requesting , 2013, 2013 IEEE Symposium on Large-Scale Data Analysis and Visualization (LDAV).

[40]  Gunther H. Weber,et al.  Scalable computation of streamlines on very large datasets , 2009, Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis.

[41]  Kwan-Liu Ma,et al.  VTK-m: Accelerating the Visualization Toolkit for Massively Threaded Architectures , 2016, IEEE Computer Graphics and Applications.

[42]  Tom Peterka,et al.  Scalable Computation of Stream Surfaces on Large Scale Vector Fields , 2014, SC14: International Conference for High Performance Computing, Networking, Storage and Analysis.

[43]  P. Fischer,et al.  On multi-scale dispersion under the influence of surface mixed layer instabilities and deep flows , 2012 .

[44]  Roxana Bujack,et al.  Revisiting the Evaluation of In Situ Lagrangian Analysis , 2018, EGPGV@EuroVis.

[45]  Kresimir Matkovic,et al.  Lagrangian Coherent Structures for Design Analysis of Revolving Doors , 2012, IEEE Transactions on Visualization and Computer Graphics.

[46]  N. G. Parke,et al.  Ordinary Differential Equations. , 1958 .

[47]  Kwan-Liu Ma,et al.  Parallel hierarchical visualization of large time-varying 3D vector fields , 2007, Proceedings of the 2007 ACM/IEEE Conference on Supercomputing (SC '07).