ALYA: MULTIPHYSICS ENGINEERING SIMULATION TOWARDS EXASCALE

Alya is a multi-physics simulation code developed at Barcelona Supercomputing Center (BSC). From its inception Alya code is designed using advanced High Performance Computing programming techniques to solve coupled problems on supercomputers efficiently. The target domain is engineering, with all its particular features: complex geometries and unstructured meshes, coupled multi-physics with exotic coupling schemes and physical models, ill-posed problems, flexibility needs for rapidly including new models, etc. Since its beginnings in 2004, Alya has scaled well in an increasing number of processors when solving single-physics problems such as fluid mechanics, solid mechanics, acoustics, etc. Over time, we have made a concerted effort to maintain and even improve scalability for multi-physics problems. This poses challenges on multiple fronts, including: numerical models, parallel implementation, physical coupling models, algorithms and solution schemes, meshing process, etc. In this paper, we introduce Alya's main features and focus particularly on its solvers. We present Alya's performance up to 100.000 processors in Blue Waters, the NCSA supercomputer with selected multi-physics tests that are representative of the engineering world. The tests are incompressible flow in a human respiratory system, low Mach combustion problem in a kiln furnace, and coupled electro-mechanical contraction of the heart. We show scalability plots for all cases and discuss all aspects of such simulations, including solver convergence.

[1]  Guillaume Houzeaux,et al.  Extension of fractional step techniques for incompressible flows: The preconditioned Orthomin(1) for the pressure Schur complement , 2011 .

[2]  Emil M. Constantinescu,et al.  Multiphysics simulations , 2013, HiPC 2013.

[3]  Gerhard A Holzapfel,et al.  Constitutive modelling of passive myocardium: a structurally based framework for material characterization , 2009, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[4]  Georg Stadler,et al.  Large-scale adaptive mantle convection simulation , 2013 .

[5]  J. C. Cajas,et al.  Alya Red CCM: HPC-Based Cardiac Computational Modelling , 2015 .

[6]  Guillaume Houzeaux,et al.  A massively parallel fractional step solver for incompressible flows , 2009, J. Comput. Phys..

[7]  Peter M. Kasson,et al.  GROMACS 4.5: a high-throughput and highly parallel open source molecular simulation toolkit , 2013, Bioinform..

[8]  Yousef Saad,et al.  Iterative methods for sparse linear systems , 2003 .

[9]  Frédéric Guyomarc'h,et al.  A Deflated Version of the Conjugate Gradient Algorithm , 1999, SIAM J. Sci. Comput..

[10]  Guillaume Houzeaux,et al.  Deflated preconditioned conjugate gradient solvers for the pressure‐Poisson equation: Extensions and improvements , 2011 .

[11]  Guillaume Houzeaux,et al.  Coupled electromechanical model of the heart: Parallel finite element formulation , 2012, International journal for numerical methods in biomedical engineering.

[12]  Guillaume Houzeaux,et al.  A massively parallel computational electrophysiology model of the heart , 2011 .

[13]  T. Okamoto,et al.  Accelerating large-scale simulation of seismic wave propagation by multi-GPUs and three-dimensional domain decomposition , 2010 .

[14]  Takashi Shimokawabe,et al.  Large-Scale Numerical Weather Prediction on GPU Supercomputer , 2013 .

[15]  Guillaume Houzeaux,et al.  A parallel coupling strategy for the Chimera and domain decomposition methods in computational mechanics , 2013 .

[16]  Guillaume Houzeaux,et al.  Alya Multiphysics Simulations on Intel's Xeon Phi Accelerators , 2014, CARLA.

[17]  Seid Koric,et al.  Sparse linear solvers on massively parallel machines , 2009 .

[18]  Rainald Löhner,et al.  A linelet preconditioner for incompressible flow solvers , 2003 .

[19]  G. Houzeaux,et al.  A variational subgrid scale model for transient incompressible flows , 2008 .

[20]  Niclas Jansson,et al.  Unicorn Parallel adaptive finite element simulation of turbulent flow and fluid-structure interaction for deforming domains and complex geometry , 2013 .

[21]  D. Atkin OR scheduling algorithms. , 2000, Anesthesiology.

[22]  Guillaume Houzeaux,et al.  Parallel uniform mesh multiplication applied to a Navier–Stokes solver , 2013 .

[23]  Biosequence AnalysisRichard HugheyComputer A Massively Parallel , 1993 .

[24]  Rolf Krause,et al.  A massively parallel, multi-disciplinary Barnes-Hut tree code for extreme-scale N-body simulations , 2012, Comput. Phys. Commun..

[25]  Rio Yokota,et al.  Petascale turbulence simulation using a highly parallel fast multipole method on GPUs , 2011, Comput. Phys. Commun..

[26]  NICLAS JANSSON,et al.  Framework for Massively Parallel Adaptive Finite Element Computational Fluid Dynamics on Tetrahedral Meshes , 2012, SIAM J. Sci. Comput..

[27]  Natalia A. Trayanova,et al.  Cardiac Electromechanical Models: From Cell to Organ , 2011, Front. Physio..

[28]  Vivek V. Ranade,et al.  Simulation of rotary cement kilns using a one-dimensional model , 2006 .

[29]  P. Hunter,et al.  A quantitative analysis of cardiac myocyte relaxation: a simulation study. , 2006, Biophysical journal.

[30]  Guillaume Houzeaux,et al.  A variational multiscale stabilized finite element method for the solution of the Euler equations of nonhydrostatic stratified flows , 2013, J. Comput. Phys..

[31]  I. Legrice,et al.  The architecture of the heart: a data–based model , 2001, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.