Accelerating Detailed Tissue-Scale 3D Cardiac Simulations Using Heterogeneous CPU-Xeon Phi Computing

We investigate heterogeneous computing, which involves both multicore CPUs and manycore Xeon Phi coprocessors, as a new strategy for computational cardiology. In particular, 3D tissues of the human cardiac ventricle are studied with a physiologically realistic model that has 10,000 calcium release units per cell and 100 ryanodine receptors per release unit, together with tissue-scale simulations of the electrical activity and calcium handling. In order to attain resource-efficient use of heterogeneous computing systems that consist of both CPUs and Xeon Phis, we first direct the coding effort at ensuring good performance on the two types of compute devices individually. Although SIMD code vectorization is the main theme of performance programming, the actual implementation details differ considerably between CPU and Xeon Phi. Moreover, in addition to combined OpenMP+MPI programming, a suitable division of the cells between the CPUs and Xeon Phis is important for resource-efficient usage of an entire heterogeneous system. Numerical experiments show that good resource utilization is indeed achieved and that such a heterogeneous simulator paves the way for ultimately understanding the mechanisms of arrhythmia. The uncovered good programming practices can be used by computational scientists who want to adopt similar heterogeneous hardware platforms for a wide variety of applications.

[1]  Yoram Rudy,et al.  Multiscale modeling of calcium cycling in cardiac ventricular myocyte: macroscopic consequences of microscopic dyadic function. , 2011, Biophysical journal.

[2]  Zhilin Qu,et al.  Calcium alternans in a couplon network model of ventricular myocytes: role of sarcoplasmic reticulum load. , 2012, American journal of physiology. Heart and circulatory physiology.

[3]  Juan G Restrepo,et al.  Calsequestrin-Mediated Mechanism for Cellular Calcium Transient Alternans. , 2018, Biophysical journal.

[4]  D. Durrer,et al.  Total Excitation of the Isolated Human Heart , 1970, Circulation.

[5]  Zhilin Qu,et al.  Computational Modeling and Numerical Methods for Spatiotemporal Calcium Cycling in Ventricular Myocytes , 2012, Front. Physio..

[6]  Nan Wu,et al.  Simulating Cardiac Electrophysiology in the Era of GPU-Cluster Computing , 2013, IEICE Trans. Inf. Syst..

[7]  W. Lederer,et al.  Calcium sparks: elementary events underlying excitation-contraction coupling in heart muscle. , 1993, Science.

[8]  Raffaele Tripiccione,et al.  Early Experience on Porting and Running a Lattice Boltzmann Code on the Xeon-Phi Co-Processor , 2013, ICCS.

[9]  Nan Wu,et al.  Towards simulation of subcellular calcium dynamics at nanometre resolution , 2015, Int. J. High Perform. Comput. Appl..

[10]  Yoram Rudy,et al.  Simulation of the Undiseased Human Cardiac Ventricular Action Potential: Model Formulation and Experimental Validation , 2011, PLoS Comput. Biol..

[11]  Avinash Sodani,et al.  Knights landing (KNL): 2nd Generation Intel® Xeon Phi processor , 2015, 2015 IEEE Hot Chips 27 Symposium (HCS).

[12]  Jianbin Fang,et al.  Test-driving Intel Xeon Phi , 2014, ICPE.

[13]  Xing Cai,et al.  Communication‐hiding programming for clusters with multi‐coprocessor nodes , 2015, Concurr. Comput. Pract. Exp..

[14]  Zhilin Qu,et al.  Calcium-voltage coupling in the genesis of early and delayed afterdepolarizations in cardiac myocytes. , 2015, Biophysical journal.

[15]  U. Costabel,et al.  Cell number in human heart in atrophy, hypertrophy, and under the influence of cytostatics. , 1975, Recent advances in studies on cardiac structure and metabolism.

[16]  Thomas O'Hara,et al.  Quantitative comparison of cardiac ventricular myocyte electrophysiology and response to drugs in human and nonhuman species. , 2012, American journal of physiology. Heart and circulatory physiology.

[17]  A. Garfinkel,et al.  An advanced algorithm for solving partial differential equation in cardiac conduction , 1999, IEEE Transactions on Biomedical Engineering.

[18]  Xing Cai,et al.  Towards Detailed Tissue-Scale 3D Simulations of Electrical Activity and Calcium Handling in the Human Cardiac Ventricle , 2015, ICA3PP.

[19]  Zhilin Qu,et al.  T-tubule disruption promotes calcium alternans in failing ventricular myocytes: mechanistic insights from computational modeling. , 2015, Journal of molecular and cellular cardiology.

[20]  Ioannis E. Venetis,et al.  Porting FEASTFLOW to the Intel Xeon Phi: Lessons Learned , 2014 .

[21]  Samuel Williams,et al.  Stencil computation optimization and auto-tuning on state-of-the-art multicore architectures , 2008, 2008 SC - International Conference for High Performance Computing, Networking, Storage and Analysis.

[22]  Eric A. Sobie,et al.  Dynamics of calcium sparks and calcium leak in the heart. , 2011, Biophysical journal.

[23]  James Reinders,et al.  Intel Xeon Phi Coprocessor High Performance Programming , 2013 .