MRAG-I2D: Multi-resolution adapted grids for remeshed vortex methods on multicore architectures

We present MRAG-I2D,1 an open source software framework, for multiresolution simulations of two-dimensional, incompressible, viscous flows on multicore architectures. The spatiotemporal scales of the flow field are captured by remeshed vortex methods enhanced by high order average-interpolating wavelets and local time-stepping. The multiresolution solver of the Poisson equation relies on the development of a novel, tree-based multipole method. MRAG-I2D implements a number of HPC strategies to map efficiently the irregular computational workload of wavelet-adapted grids on multicore nodes. The capabilities of the present software are compared to the current state-of-the-art in terms of accuracy, compression rates and time-to-solution. Benchmarks include the inviscid evolution of an elliptical vortex, flow past an impulsively started cylinder at Re=40–40000 and simulations of self-propelled anguilliform swimmers. The results indicate that the present software has the same or better accuracy than state-of-the-art solvers while it exhibits unprecedented performance in terms of time-to-solution.

[1]  Mathieu Coquerelle,et al.  ARTICLE IN PRESS Available online at www.sciencedirect.com Journal of Computational Physics xxx (2008) xxx–xxx , 2022 .

[2]  Petros Koumoutsakos,et al.  Inviscid Axisymmetrization of an Elliptical Vortex , 1997 .

[3]  Babak Hejazialhosseini,et al.  Reinforcement Learning and Wavelet Adapted Vortex Methods for Simulations of Self-propelled Swimmers , 2014, SIAM J. Sci. Comput..

[4]  Daniel F. Martin,et al.  A Cell-Centered Adaptive Projection Method for the Incompressible Euler Equations , 2000 .

[5]  Gianluca Iaccarino,et al.  IMMERSED BOUNDARY METHODS , 2005 .

[6]  Bradley C. Kuszmaul,et al.  Cilk: an efficient multithreaded runtime system , 1995, PPOPP '95.

[7]  J. Monaghan,et al.  Extrapolating B splines for interpolation , 1985 .

[8]  Valérie Perrier,et al.  Divergence-free and curl-free wavelets in two dimensions and three dimensions: application to turbulent flows , 2006 .

[9]  Diego Rossinelli Multiresolution flow simulations on multi/many-core architectures , 2011 .

[10]  Diego Rossinelli,et al.  High performance CPU/GPU multiresolution Poisson solver , 2013, PARCO.

[11]  Petros Koumoutsakos,et al.  Flow mediated interactions between two cylinders at finite Re numbers , 2012 .

[12]  A.,et al.  FAST FOURIER TRANSFORMS FOR NONEQUISPACED DATA * , .

[13]  P. Koumoutsakos,et al.  Simulations of optimized anguilliform swimming , 2006, Journal of Experimental Biology.

[14]  William E. Lorensen,et al.  The visualization toolkit (2nd ed.): an object-oriented approach to 3D graphics , 1998 .

[15]  Diego Rossinelli,et al.  GPU accelerated simulations of bluff body flows using vortex particle methods , 2010, J. Comput. Phys..

[16]  Oleg V. Vasilyev,et al.  Simultaneous space-time adaptive wavelet solution of nonlinear parabolic differential equations , 2006, J. Comput. Phys..

[17]  Kai Schneider,et al.  Space--time adaptive multiresolution methods for hyperbolic conservation laws: Applications to compressible Euler equations , 2009 .

[18]  O. Vasilyev,et al.  Hybrid wavelet collocation–Brinkman penalization method for complex geometry flows , 2002 .

[19]  David L. Donoho,et al.  Interpolating Wavelet Transforms , 1992 .

[20]  Diego Rossinelli,et al.  High order finite volume methods on wavelet-adapted grids with local time-stepping on multicore architectures for the simulation of shock-bubble interactions , 2010, J. Comput. Phys..

[21]  Diego Rossinelli,et al.  Multicore/Multi-GPU Accelerated Simulations of Multiphase Compressible Flows Using Wavelet Adapted Grids , 2011, SIAM J. Sci. Comput..

[22]  Michael Bergdorf,et al.  Multilevel Adaptive Particle Methods for Convection-Diffusion Equations , 2005, Multiscale Model. Simul..

[23]  Michael Voss,et al.  Optimization via Reflection on Work Stealing in TBB , 2008, 2008 IEEE International Symposium on Parallel and Distributed Processing.

[24]  Albert Cohen Adaptive Methods for PDE's Wavelets or Mesh Refinement? , 2002 .

[25]  P. Colella,et al.  A Conservative Adaptive Projection Method for the Variable Density Incompressible Navier-Stokes Equations , 1998 .

[26]  O. Vasilyev,et al.  Wavelet Methods in Computational Fluid Dynamics , 2010 .

[27]  Kai Schneider,et al.  Adaptive Wavelet Simulation of a Flow around an Impulsively Started Cylinder Using Penalisation , 2002 .

[28]  Petros Koumoutsakos,et al.  Vortex Methods with Spatially Varying Cores , 2000 .

[29]  Gilles Carbou,et al.  Boundary layer for a penalization method for viscous incompressible flow , 2003, Advances in Differential Equations.

[30]  Samuel Williams,et al.  Roofline: an insightful visual performance model for multicore architectures , 2009, CACM.

[31]  Margaret Martonosi,et al.  Characterizing and improving the performance of Intel Threading Building Blocks , 2008, 2008 IEEE International Symposium on Workload Characterization.

[32]  Michael Bergdorf,et al.  A Lagrangian Particle-Wavelet Method , 2006, Multiscale Model. Simul..

[33]  Diego Rossinelli,et al.  High throughput software for direct numerical simulations of compressible two-phase flows , 2012, 2012 International Conference for High Performance Computing, Networking, Storage and Analysis.

[34]  Diego Rossinelli,et al.  Wavelet‐adaptive solvers on multi‐core architectures for the simulation of complex systems , 2011, Concurr. Comput. Pract. Exp..

[35]  I. Daubechies,et al.  Biorthogonal bases of compactly supported wavelets , 1992 .

[36]  Petros Koumoutsakos,et al.  C-start: optimal start of larval fish , 2012, Journal of Fluid Mechanics.

[37]  P. Koumoutsakos,et al.  High-resolution simulations of the flow around an impulsively started cylinder using vortex methods , 1995, Journal of Fluid Mechanics.

[38]  Diego Rossinelli,et al.  Wavelet-Based Adaptive Solvers on Multi-core Architectures for the Simulation of Complex Systems , 2009, Euro-Par.

[39]  Kai Schneider,et al.  An adaptive multiresolution scheme with local time stepping for evolutionary PDEs , 2008, J. Comput. Phys..

[40]  Neelesh A. Patankar,et al.  A fast projection scheme for the direct numerical simulation of rigid particulate flows , 2005 .

[41]  Petros Koumoutsakos,et al.  Simulations of single and multiple swimmers with non-divergence free deforming geometries , 2011, J. Comput. Phys..

[42]  M. Berger,et al.  An Adaptive Version of the Immersed Boundary Method , 1999 .

[43]  S. Mallat,et al.  A wavelet based space-time adaptive numerical method for partial differential equations , 1990 .

[44]  Oleg V. Vasilyev,et al.  An Adaptive Wavelet Collocation Method for Fluid-Structure Interaction at High Reynolds Numbers , 2005, SIAM J. Sci. Comput..

[45]  Wolfgang Hackbusch,et al.  Multi-grid methods and applications , 1985, Springer series in computational mathematics.

[46]  G. Winckelmans,et al.  Vortex methods for high-resolution simulations of viscous flow past bluff bodies of general geometry , 2000 .

[47]  P. Koumoutsakos,et al.  Optimal shapes for anguilliform swimmers at intermediate Reynolds numbers , 2013, Journal of Fluid Mechanics.

[48]  Petros Koumoutsakos,et al.  Vortex Methods: Theory and Practice , 2000 .

[49]  Philippe Angot,et al.  A penalization method to take into account obstacles in incompressible viscous flows , 1999, Numerische Mathematik.

[50]  Christopher R. Anderson,et al.  On Vortex Methods , 1985 .

[51]  Olivier Roussel,et al.  A conservative fully adaptive multiresolution algorithm for parabolic PDEs , 2003 .

[52]  Piet Hut,et al.  A hierarchical O(N log N) force-calculation algorithm , 1986, Nature.

[53]  Georges-Henri Cottet,et al.  Advances in direct numerical simulations of 3D wall-bounded flows by Vortex-in-Cell methods , 2004 .