Parallelizing a finite element solver in computational hemodynamics

In the last 20 years, a new approach has emerged to investigate the physiopathology of circulation. By merging medical images with validated numerical models, it is possible to support doctors’ decision-making process. The iCardioCloud project aims at establishing a computational framework to perform a complete patient-specific numerical analysis, specially oriented to aortic diseases (like dissections or aneurysms) and to deliver a compelling synthesis. The project can be considered a pioneering example of a Computer Aided Clinical Trial: i.e., a comprehensive analysis of patients where the level of knowledge extracted by traditional measures and statistics is enhanced through the massive use of numerical modeling. From a computer engineering point of view, iCardioCloud faces multiple challenges. First, the number of problems to solve for each patient is significantly huge – this is typical of computational fluid dynamics (CFD) – and it requires parallel methods. In addition, working in a clinical environment demands efficiency as the timeline requires rapid quantitative answers (as may happen in an emergency scenario). It is therefore mandatory to employ high-end parallel systems, such as large clusters or supercomputers. Here we discuss a parallel implementation of an application within the iCardioCloud project, built with a black-box approach – i.e., by assembling and configuring existing packages and libraries and in particular LifeV, a finite element library developed to solve CFD problems. The goal of this paper is to describe the software architecture underlying LifeV and to assess its performance and the most appropriate parallel paradigm. This paper is an extension of a previous work presented at the PBio 2015 Conference. This revision extends the description of the software architecture and discusses several new serial and parallel optimizations to the application. We discuss the introduction of hybrid parallelism in order to mitigate some performance problems previously experienced.

[1]  A. Veneziani Block factorized preconditioners for high‐order accurate in time approximation of the Navier‐Stokes equations , 2003 .

[2]  Charles A. Taylor,et al.  On Coupling a Lumped Parameter Heart Model and a Three-Dimensional Finite Element Aorta Model , 2009, Annals of Biomedical Engineering.

[3]  Vaidy S. Sunderam,et al.  Experiences with Cost and Utility Trade-offs on IaaS Clouds, Grids, and On-Premise Resources , 2014, 2014 IEEE International Conference on Cloud Engineering.

[4]  Barry Lee,et al.  Finite elements and fast iterative solvers: with applications in incompressible fluid dynamics , 2006, Math. Comput..

[5]  Daniele Antonio Di Pietro,et al.  Expression templates implementation of continuous and discontinuous Galerkin methods , 2009 .

[6]  Annalisa Quaini,et al.  Deconvolution‐based nonlinear filtering for incompressible flows at moderately large Reynolds numbers , 2016 .

[7]  Alessandro Reali,et al.  Assessment of a Black-Box Approach for a Parallel Finite Elements Solver in Computational Hemodynamics , 2015, 2015 IEEE Trustcom/BigDataSE/ISPA.

[8]  Alessandro Veneziani,et al.  The LifeV library: engineering mathematics beyond the proof of concept , 2017, 1710.06596.

[9]  Alessandro Reali,et al.  Aortic Hemodynamics after Thoracic Endovascular Aortic Repair, with Particular Attention to the Bird-Beak Configuration , 2014, Journal of endovascular therapy : an official journal of the International Society of Endovascular Specialists.

[10]  Alessandro Reali,et al.  Patient-specific aortic endografting simulation: From diagnosis to prediction , 2013, Comput. Biol. Medicine.

[11]  Simona Perotto,et al.  HIGAMod: A Hierarchical IsoGeometric Approach for MODel reduction in curved pipes , 2017 .

[12]  Steven Deutsch,et al.  Assessment of CFD Performance in Simulations of an Idealized Medical Device: Results of FDA’s First Computational Interlaboratory Study , 2012 .

[13]  Steven Deutsch,et al.  Multilaboratory particle image velocimetry analysis of the FDA benchmark nozzle model to support validation of computational fluid dynamics simulations. , 2011, Journal of biomechanical engineering.

[14]  T. N. Stevenson,et al.  Fluid Mechanics , 2021, Nature.

[15]  A Veneziani,et al.  Validation of an open source framework for the simulation of blood flow in rigid and deformable vessels , 2013, International journal for numerical methods in biomedical engineering.

[16]  Vaidy S. Sunderam,et al.  Experiences with Target-Platform Heterogeneity in Clouds, Grids, and On-Premises Resources , 2012, 2012 IEEE 26th International Parallel and Distributed Processing Symposium Workshops & PhD Forum.

[17]  Michele Conti,et al.  Patient-specific analysis of post-operative aortic hemodynamics: a focus on thoracic endovascular repair (TEVAR) , 2014 .