TAMM: Tensor Algebra for Many-body Methods

Tensor algebra operations such as contractions in computational chemistry consume a significant fraction of the computing time on large-scale computing platforms. The widespread use of tensor contractions between large multi-dimensional tensors in describing electronic structure theory has motivated the development of multiple tensor algebra frameworks targeting heterogeneous computing platforms. In this paper, we present Tensor Algebra for Many-body Methods (TAMM), a framework for productive and performance-portable development of scalable computational chemistry methods. TAMM decouples the specification of the computation from the execution of these operations on available high-performance computing systems. With this design choice, the scientific application developers (domain scientists) can focus on the algorithmic requirements using the tensor algebra interface provided by TAMM, whereas high-performance computing developers can direct their attention to various optimizations on the underlying constructs, such as efficient data distribution, optimized scheduling algorithms, and efficient use of intra-node resources (e.g., graphics processing units). The modular structure of TAMM allows it to support different hardware architectures and incorporate new algorithmic advances. We describe the TAMM framework and our approach to the sustainable development of scalable ground- and excited-state electronic structure methods. We present case studies highlighting the ease of use, including the performance and productivity gains compared to other frameworks.

[1]  F. Neese,et al.  Unveiling the complex pattern of intermolecular interactions responsible for the stability of the DNA duplex , 2021, Chemical science.

[2]  S. Krishnamoorthy,et al.  Scalable Heterogeneous Execution of a Coupled-Cluster Model with Perturbative Triples , 2020, SC20: International Conference for High Performance Computing, Networking, Storage and Analysis.

[3]  S. Krishnamoorthy,et al.  GFCCLib: Scalable and efficient coupled-cluster Green's function library for accurately tackling many-body electronic structure problems , 2020, Comput. Phys. Commun..

[4]  Frank Neese,et al.  The ORCA quantum chemistry program package. , 2020, The Journal of chemical physics.

[5]  Sriram Krishnamoorthy,et al.  Toward generalized tensor algebra for ab initio quantum chemistry methods , 2019, ARRAY@PLDI.

[6]  Sriram Krishnamoorthy,et al.  A Code Generator for High-Performance Tensor Contractions on GPUs , 2019, 2019 IEEE/ACM International Symposium on Code Generation and Optimization (CGO).

[7]  B. Peng,et al.  Properties of advanced coupled-cluster Green's function , 2018 .

[8]  Hans-Joachim Werner,et al.  Scalable Electron Correlation Methods. 3. Efficient and Accurate Parallel Local Coupled Cluster with Pair Natural Orbitals (PNO-LCCSD). , 2017, Journal of chemical theory and computation.

[9]  Paolo Bientinesi,et al.  HPTT: a high-performance tensor transposition C++ library , 2017, ARRAY@PLDI.

[10]  Evgeny Epifanovsky,et al.  A General Sparse Tensor Framework for Electronic Structure Theory. , 2017, Journal of chemical theory and computation.

[11]  Martin D. Schatz,et al.  Parallel Matrix Multiplication: A Systematic Journey , 2016, SIAM J. Sci. Comput..

[12]  Justus A. Calvin,et al.  Massively Parallel Implementation of Explicitly Correlated Coupled-Cluster Singles and Doubles Using TiledArray Framework. , 2016, The journal of physical chemistry. A.

[13]  K. Kowalski,et al.  Coupled cluster Green function: Model involving single and double excitations. , 2016, The Journal of chemical physics.

[14]  Frank Neese,et al.  SparseMaps--A systematic infrastructure for reduced-scaling electronic structure methods. III. Linear-scaling multireference domain-based pair natural orbital N-electron valence perturbation theory. , 2016, The Journal of chemical physics.

[15]  Frank Neese,et al.  Sparse maps--A systematic infrastructure for reduced-scaling electronic structure methods. II. Linear scaling domain based pair natural orbital coupled cluster theory. , 2016, The Journal of chemical physics.

[16]  Torsten Hoefler,et al.  Sparse Tensor Algebra as a Parallel Programming Model , 2015, ArXiv.

[17]  Frank Neese,et al.  Sparse maps—A systematic infrastructure for reduced-scaling electronic structure methods. I. An efficient and simple linear scaling local MP2 method that uses an intermediate basis of pair natural orbitals. , 2015, The Journal of chemical physics.

[18]  Robert J. Harrison,et al.  MADNESS: A Multiresolution, Adaptive Numerical Environment for Scientific Simulation , 2015, SIAM J. Sci. Comput..

[19]  John F. Stanton,et al.  A massively parallel tensor contraction framework for coupled-cluster computations , 2014, J. Parallel Distributed Comput..

[20]  K. Kowalski,et al.  Toward enabling large-scale open-shell equation-of-motion coupled cluster calculations: triplet states of β-carotene. , 2014, The journal of physical chemistry. A.

[21]  Evgeny Epifanovsky,et al.  New implementation of high‐level correlated methods using a general block tensor library for high‐performance electronic structure calculations , 2013, J. Comput. Chem..

[22]  Frank Neese,et al.  Natural triple excitations in local coupled cluster calculations with pair natural orbitals. , 2013, The Journal of chemical physics.

[23]  Robert A. van de Geijn,et al.  Elemental: A New Framework for Distributed Memory Dense Matrix Computations , 2013, TOMS.

[24]  Tze Meng Low,et al.  Exploiting Symmetry in Tensors for High Performance: Multiplication with Symmetric Tensors , 2013, SIAM J. Sci. Comput..

[25]  M. Tauber,et al.  Characterization of carotenoid aggregates by steady-state optical spectroscopy. , 2012, The journal of physical chemistry. B.

[26]  Simen Kvaal,et al.  Ab initio quantum dynamics using coupled-cluster. , 2012, The Journal of chemical physics.

[27]  Diana E Schlamadinger,et al.  Triplet excitons of carotenoids formed by singlet fission in a membrane. , 2011, Chemphyschem : a European journal of chemical physics and physical chemistry.

[28]  Sriram Krishnamoorthy,et al.  Scalable implementations of accurate excited-state coupled cluster theories: Application of high-level methods to porphyrin-based systems , 2011, 2011 International Conference for High Performance Computing, Networking, Storage and Analysis (SC).

[29]  Arvi Freiberg,et al.  Demonstration and interpretation of significant asymmetry in the low-resolution and high-resolution Q(y) fluorescence and absorption spectra of bacteriochlorophyll a. , 2011, The Journal of chemical physics.

[30]  Tjerk P. Straatsma,et al.  NWChem: A comprehensive and scalable open-source solution for large scale molecular simulations , 2010, Comput. Phys. Commun..

[31]  H. Monkhorst,et al.  Calculation of properties with the coupled-cluster method , 2009 .

[32]  Josef Paldus,et al.  A Critical Assessment of Coupled Cluster Method in Quantum Chemistry , 2007 .

[33]  R. Bartlett,et al.  Coupled-cluster theory in quantum chemistry , 2007 .

[34]  Jarek Nieplocha,et al.  Advances, Applications and Performance of the Global Arrays Shared Memory Programming Toolkit , 2006, Int. J. High Perform. Comput. Appl..

[35]  Christa Critchley,et al.  Artificial photosynthesis : from basic biology to industrial application , 2005 .

[36]  David E. Bernholdt,et al.  Synthesis of High-Performance Parallel Programs for a Class of ab Initio Quantum Chemistry Models , 2005, Proceedings of the IEEE.

[37]  S. Hirata.  Tensor Contraction Engine: Abstraction and Automated Parallel Implementation of Configuration-Interaction, Coupled-Cluster, and Many-Body Perturbation Theories , 2003 .

[38]  Martin Schütz,et al.  A new, fast, semi-direct implementation of linear scaling local coupled cluster theory , 2002 .

[39]  Robert A. van de Geijn,et al.  FLAME: Formal Linear Algebra Methods Environment , 2001, TOMS.

[40]  Karol Kowalski,et al.  The active-space equation-of-motion coupled-cluster methods for excited electronic states: Full EOMCCSDt , 2001 .

[41]  Hans-Joachim Werner,et al.  Low-order scaling local electron correlation methods. IV. Linear scaling local coupled-cluster (LCCSD) , 2001 .

[42]  J. Stanton.  Why CCSD(T) works: a different perspective , 1997 .

[43]  Trygve Helgaker,et al.  The CC3 model: An iterative coupled cluster approach including connected triples , 1997 .

[44]  Hans-Joachim Werner,et al.  Local treatment of electron correlation in coupled cluster theory , 1996 .

[45]  Marcel Nooijen,et al.  Second order many-body perturbation approximations to the Coupled Cluster Green's Function. , 1995 .

[46]  J. G. Snijders,et al.  Coupled cluster Green's function method: Working equations and applications , 1993 .

[47]  Donald C. Comeau,et al.  The equation-of-motion coupled-cluster method. Applications to open- and closed-shell reference states , 1993 .

[48]  John F. Stanton,et al.  The equation of motion coupled‐cluster method. A systematic biorthogonal approach to molecular excitation energies, transition probabilities, and excited state properties , 1993 .

[49]  R. Bartlett,et al.  Electron propagator theory with the ground state correlated by the coupled‐cluster method , 1993 .

[50]  Marcel Nooijen,et al.  Coupled cluster approach to the single-particle Green's function , 1992 .

[51]  Henrik Koch,et al.  Coupled cluster response functions , 1990 .

[52]  Rodney J. Bartlett,et al.  The equation-of-motion coupled-cluster method: Excitation energies of Be and CO , 1989 .

[53]  M. Head‐Gordon,et al.  A fifth-order perturbation comparison of electron correlation theories , 1989 .

[54]  Paul G. Mezey,et al.  A fast intrinsic localization procedure applicable for ab initio and semiempirical linear combination of atomic orbital wave functions , 1989 .

[55]  J. Arponen,et al.  Variational principles and linked-cluster exp S expansions for static and dynamic many-body problems , 1983 .

[56]  R. Bartlett,et al.  A full coupled‐cluster singles and doubles model: The inclusion of disconnected triples , 1982 .

[57]  Debashis Mukherjee,et al.  A response-function approach to the direct calculation of the transition-energy in a multiple-cluster expansion formalism , 1979 .

[58]  J. Cizek.  On the Correlation Problem in Atomic and Molecular Systems. Calculation of Wavefunction Components in Ursell-Type Expansion Using Quantum-Field Theoretical Methods , 1966 .

[59]  M. Krauss,et al.  Configuration‐Interaction Calculation of H3 and H2 , 1965 .

[60]  F. Coester,et al.  Short-range correlations in nuclear wave functions , 1960 .

[61]  F. Coester,et al.  Bound states of a many-particle system , 1958 .

[62]  Samuel Williams,et al.  Analysis and tuning of libtensor framework on multicore architectures , 2014, 2014 21st International Conference on High Performance Computing (HiPC).

[63]  Josef Michl,et al.  Singlet fission. , 2010, Chemical reviews.

[64]  R. Bartlett,et al.  EOMXCC: A New Coupled-Cluster Method for Electronic Excited States , 1999 .

[65]  Josef Paldus,et al.  Correlation Problems in Atomic and Molecular Systems. IV. Extended Coupled-Pair Many-Electron Theory and Its Application to the B H 3 Molecule , 1972 .

[66]  R. Ahlrichs,et al.  Ab initio calculations on small hydrides including electron correlation , 1970 .