Highly Efficient and Scalable Compound Decomposition of Two-Electron Integral Tensor and Its Application in Coupled Cluster Calculations.

The representation and storage of two-electron integral tensors are vital in large-scale applications of accurate electronic structure methods. Low-rank representation and efficient storage strategy of integral tensors can significantly reduce the numerical overhead and consequently time-to-solution of these methods. In this work, by combining pivoted incomplete Cholesky decomposition (CD) with a follow-up truncated singular vector decomposition (SVD), we develop a decomposition strategy to approximately represent the two-electron integral tensor in terms of low-rank vectors. A systematic benchmark test on a series of 1-D, 2-D, and 3-D carbon-hydrogen systems demonstrates high efficiency and scalability of the compound two-step decomposition of the two-electron integral tensor in our implementation. For the size of the atomic basis set, Nb, ranging from ∼100 up to ∼2,000, the observed numerical scaling of our implementation shows [Formula: see text] versus [Formula: see text] cost of performing single CD on the two-electron integral tensor in most of the other implementations. More importantly, this decomposition strategy can significantly reduce the storage requirement of the atomic orbital (AO) two-electron integral tensor from [Formula: see text] to [Formula: see text] with moderate decomposition thresholds. The accuracy tests have been performed using ground- and excited-state formulations of coupled cluster formalism employing single and double excitations (CCSD) on several benchmark systems including the C60 molecule described by nearly 1,400 basis functions. The results show that the decomposition thresholds can be generally set to 10-4 to 10-3 to give acceptable compromise between efficiency and accuracy.

[1]  F. Coester,et al.  Bound states of a many-particle system , 1958 .

[2]  F. Coester,et al.  Short-range correlations in nuclear wave functions , 1960 .

[3]  J. Cizek.  On the Correlation Problem in Atomic and Molecular Systems. Calculation of Wavefunction Components in Ursell-Type Expansion Using Quantum-Field Theoretical Methods , 1966 .

[4]  Josef Paldus,et al.  Correlation Problems in Atomic and Molecular Systems. IV. Extended Coupled-Pair Many-Electron Theory and Its Application to the B H 3 Molecule , 1972 .

[5]  J. L. Whitten,et al.  Coulombic potential energy integrals and approximations , 1973 .

[6]  N. H. Beebe,et al.  Simplifications in the generation and transformation of two‐electron integrals in molecular calculations , 1977 .

[7]  John R. Sabin,et al.  On some approximations in applications of Xα theory , 1979 .

[8]  R. Bartlett,et al.  A full coupled‐cluster singles and doubles model: The inclusion of disconnected triples , 1982 .

[9]  D. Arnold.  An Interior Penalty Finite Element Method with Discontinuous Elements , 1982 .

[10]  I. Røeggen,et al.  On the Beebe-Linderberg two-electron integral approximation , 1986 .

[11]  Leslie Greengard,et al.  A fast algorithm for particle simulations , 1987 .

[12]  Curtis L. Janssen,et al.  An efficient reformulation of the closed‐shell coupled cluster single and double excitation (CCSD) equations , 1988 .

[13]  Rodney J. Bartlett,et al.  The equation-of-motion coupled-cluster method: Excitation energies of Be and CO , 1989 .

[14]  Henrik Koch,et al.  Coupled cluster response functions , 1990 .

[15]  W. Krätschmer,et al.  The infrared and ultraviolet absorption spectra of laboratory-produced carbon dust: evidence for the presence of the C60 molecule , 1990 .

[16]  Roger Taylor,et al.  Preparation and UV / visible spectra of fullerenes C60 and C70 , 1991 .

[17]  Lucas,et al.  Elementary excitations of C60 from the far infrared to the far vacuum ultraviolet studied by high-resolution electron-energy-loss spectroscopy. , 1992, Physical review. B, Condensed matter.

[18]  Sydney Leach,et al.  Electronic spectra and transitions of the fullerene C60 , 1992 .

[19]  Martin W. Feyereisen,et al.  Use of approximate integrals in ab initio theory. An application in MP2 energy calculations , 1993 .

[20]  John F. Stanton,et al.  The equation of motion coupled‐cluster method. A systematic biorthogonal approach to molecular excitation energies, transition probabilities, and excited state properties , 1993 .

[21]  Donald C. Comeau,et al.  The equation-of-motion coupled-cluster method. Applications to open- and closed-shell reference states , 1993 .

[22]  J. Almlöf,et al.  Integral approximations for LCAO-SCF calculations , 1993 .

[23]  Alistair P. Rendell,et al.  COUPLED-CLUSTER THEORY EMPLOYING APPROXIMATE INTEGRALS : AN APPROACH TO AVOID THE INPUT/OUTPUT AND STORAGE BOTTLENECKS , 1994 .

[24]  Benny G. Johnson,et al.  Linear scaling density functional calculations via the continuous fast multipole method , 1996 .

[25]  Michael J. Frisch,et al.  Achieving linear scaling in exchange-correlation density functional quadratures , 1996 .

[26]  Hans-Joachim Werner,et al.  Local treatment of electron correlation in coupled cluster theory , 1996 .

[27]  Michael J. Frisch,et al.  Achieving Linear Scaling for the Electronic Quantum Coulomb Problem , 1996, Science.

[28]  Robert J. Harrison,et al.  Parallel direct four-index transformations , 1996 .

[29]  D. Bernholdt,et al.  Large-scale correlated electronic structure calculations: the RI-MP2 method on parallel computers , 1996 .

[30]  Gustavo E. Scuseria,et al.  Linear scaling conjugate gradient density matrix search as an alternative to diagonalization for first principles electronic structure calculations , 1997 .

[31]  Rick A. Kendall,et al.  The impact of the resolution of the identity approximate integral method on modern ab initio algorithm development , 1997 .

[32]  Josef Paldus,et al.  A Critical Assessment of Coupled Cluster Method in Quantum Chemistry , 2007 .

[33]  P. Dugourd,et al.  Direct measurement of the electric polarizability of isolated C60 molecules , 1999 .

[34]  Christof Hättig,et al.  CC2 excitation energy calculations on large molecules using the resolution of the identity approximation , 2000 .

[35]  J. Louderback,et al.  Absolute measurement of the optical polarizability of C60 , 2000 .

[36]  Mihály Kállay,et al.  Higher excitations in coupled-cluster theory , 2001 .

[37]  Hans-Joachim Werner,et al.  Low-order scaling local electron correlation methods. IV. Linear scaling local coupled-cluster (LCCSD) , 2001 .

[38]  K. Ruud,et al.  The dispersion of the polarizability of C60: A confirmation of recent experimental results through theoretical calculations , 2001 .

[39]  Martin Schütz,et al.  Low-order scaling local electron correlation methods. V. Connected triples beyond (T): Linear scaling local CCSDT-1b , 2002 .

[40]  Florian Weigend,et al.  A fully direct RI-HF algorithm: Implementation, optimised auxiliary basis sets, demonstration of accuracy and efficiency , 2002 .

[41]  M. Head‐Gordon,et al.  Highly correlated calculations with a polynomial cost algorithm: A study of the density matrix renormalization group , 2002 .

[42]  Fabrizia Negri,et al.  Electronic states and transitions in C_60 and C_70 fullerenes , 2002, Photochemical & photobiological sciences : Official journal of the European Photochemistry Association and the European Society for Photobiology.

[43]  R. Bartlett,et al.  Singular value decomposition approach for the approximate coupled-cluster method , 2003 .

[44]  Frederick R. Manby,et al.  Density fitting in second-order linear-r12 Møller–Plesset perturbation theory , 2003 .

[45]  Frederick R. Manby,et al.  Fast linear scaling second-order Møller-Plesset perturbation theory (MP2) using local and density fitting approximations , 2003 .

[46]  Christof Hättig,et al.  Analytic gradients for excited states in the coupled-cluster model CC2 employing the resolution-of-the-identity approximation , 2003 .

[47]  Christof Hättig,et al.  Geometry optimizations with the coupled-cluster model CC2 using the resolution-of-the-identity approximation , 2003 .

[48]  Thomas Bondo Pedersen,et al.  Reduced scaling in electronic structure calculations using Cholesky decompositions , 2003 .

[49]  Frank Neese,et al.  An improvement of the resolution of the identity approximation for the formation of the Coulomb matrix , 2003, J. Comput. Chem..

[50]  S. Hirata.  Tensor Contraction Engine: Abstraction and Automated Parallel Implementation of Configuration-Interaction, Coupled-Cluster, and Many-Body Perturbation Theories , 2003 .

[51]  Robert J. Harrison,et al.  Global arrays: A nonuniform memory access programming model for high-performance computers , 1996, The Journal of Supercomputing.

[52]  Rodney J Bartlett,et al.  A natural linear scaling coupled-cluster method. , 2004, The Journal of chemical physics.

[53]  Thomas Bondo Pedersen,et al.  Polarizability and optical rotation calculated from the approximate coupled cluster singles and doubles CC2 linear response theory using Cholesky decompositions. , 2004, The Journal of chemical physics.

[54]  Markus Reiher,et al.  Convergence behavior of the density-matrix renormalization group algorithm for optimized orbital orderings. , 2005, The Journal of chemical physics.

[55]  Steven E. J. Bell,et al.  Reduced‐size polarized basis sets for calculations of molecular electric properties. I. The basis set generation , 2005, J. Comput. Chem..

[56]  Steven E. J. Bell,et al.  Reduced–size polarized basis sets for calculations of molecular electric properties. III. Second–row atoms , 2005 .

[57]  David E. Bernholdt,et al.  Synthesis of High-Performance Parallel Programs for a Class of ab Initio Quantum Chemistry Models , 2005, Proceedings of the IEEE.

[58]  Manuela Merchán,et al.  Quantum chemistry of the excited state: 2005 overview , 2005 .

[59]  Kazuo Kitaura,et al.  Coupled-cluster theory based upon the fragment molecular-orbital method. , 2005, The Journal of chemical physics.

[60]  T. Daniel Crawford,et al.  Ab initio calculation of molecular chiroptical properties , 2006 .

[61]  Joseph E. Subotnik,et al.  Linear scaling density fitting. , 2006, The Journal of chemical physics.

[62]  Kimihiko Hirao,et al.  An approximate second-order Møller–Plesset perturbation approach for large molecular calculations , 2006 .

[63]  F. Manby,et al.  Explicitly correlated second-order perturbation theory using density fitting and local approximations. , 2006, The Journal of chemical physics.

[64]  T Daniel Crawford,et al.  The current state of ab initio calculations of optical rotation and electronic circular dichroism spectra. , 2007, The journal of physical chemistry. A.

[65]  R. Lindh,et al.  Low-cost evaluation of the exchange Fock matrix from Cholesky and density fitting representations of the electron repulsion integrals. , 2007, The Journal of chemical physics.

[66]  Jörg Kussmann,et al.  Linear-scaling method for calculating nuclear magnetic resonance chemical shifts using gauge-including atomic orbitals within Hartree-Fock and density-functional theory. , 2007, The Journal of chemical physics.

[67]  Francesco Aquilante,et al.  Quartic scaling evaluation of canonical scaled opposite spin second-order Møller Plesset correlation energy using Cholesky decompositions , 2007 .

[68]  Frederick R. Manby,et al.  Fast local-MP2 method with density-fitting for crystals. I. Theory and algorithms , 2007 .

[69]  A. J. Sadlej,et al.  Reduced-size polarized basis sets for calculations of molecular electric properties. IV. First-row transition metals , 2007 .

[70]  R. Bartlett,et al.  Coupled-cluster theory in quantum chemistry , 2007 .

[71]  Marat Valiev,et al.  Large-scale parallel calculations with combined coupled cluster and molecular mechanics formalism: Excitation energies of zinc–porphyrin in aqueous solution , 2008 .

[72]  I Røeggen,et al.  Cholesky decomposition of the two-electron integral matrix in electronic structure calculations. , 2008, The Journal of chemical physics.

[73]  Francesco Aquilante,et al.  Cholesky Decomposition-Based Multiconfiguration Second-Order Perturbation Theory (CD-CASPT2): Application to the Spin-State Energetics of Co(III)(diiminato)(NPh). , 2008, Journal of chemical theory and computation.

[74]  Karol Kowalski,et al.  Coupled cluster calculations for static and dynamic polarizabilities of C60. , 2008, The Journal of chemical physics.

[75]  Walter Thiel,et al.  Benchmarks for electronically excited states: CASPT2, CC2, CCSD, and CC3. , 2008, The Journal of chemical physics.

[76]  Anna I Krylov,et al.  Equation-of-motion coupled-cluster methods for open-shell and electronically excited species: the Hitchhiker's guide to Fock space. , 2008, Annual review of physical chemistry.

[77]  Roland Lindh,et al.  Accurate ab initio density fitting for multiconfigurational self-consistent field methods. , 2008, The Journal of chemical physics.

[78]  R. Bartlett,et al.  Natural linear-scaled coupled-cluster theory with local transferable triple excitations: applications to peptides. , 2008, The journal of physical chemistry. A.

[79]  H. Monkhorst,et al.  Calculation of properties with the coupled-cluster method , 2009 .

[80]  Michio Katouda,et al.  Efficient parallel algorithm of second‐order Møller–Plesset perturbation theory with resolution‐of‐identity approximation (RI‐MP2) , 2009 .

[81]  Roland Lindh,et al.  Density fitting with auxiliary basis sets from Cholesky decompositions , 2009 .

[82]  Jonas Boström,et al.  Ab Initio Density Fitting: Accuracy Assessment of Auxiliary Basis Sets from Cholesky Decompositions. , 2009, Journal of chemical theory and computation.

[83]  Wei Li,et al.  Local correlation calculations using standard and renormalized coupled-cluster approaches. , 2009, The Journal of chemical physics.

[84]  Florian Weigend,et al.  Approximated electron repulsion integrals: Cholesky decomposition versus resolution of the identity methods. , 2009, The Journal of chemical physics.

[85]  Walter Thiel,et al.  Benchmarks for Electronically Excited States: A Comparison of Noniterative and Iterative Triples Corrections in Linear Response Coupled Cluster Methods: CCSDR(3) versus CC3. , 2009, Journal of chemical theory and computation.

[86]  Dimitrios G Liakos,et al.  Efficient and accurate approximations to the local coupled cluster singles doubles method using a truncated pair natural orbital basis. , 2009, The Journal of chemical physics.

[87]  F. Neese,et al.  Efficient and accurate local approximations to coupled-electron pair approaches: An attempt to revive the pair natural orbital method. , 2009, The Journal of chemical physics.

[88]  Martin Head-Gordon,et al.  A sparse framework for the derivation and implementation of fermion algebra , 2010 .

[89]  E. Carter,et al.  Density fitting of two-electron integrals in local multireference single and double excitation configuration interaction calculations , 2010 .

[90]  Yuji Mochizuki,et al.  Acceleration of fragment molecular orbital calculations with Cholesky decomposition approach , 2010 .

[91]  P. Piecuch,et al.  Multilevel extension of the cluster-in-molecule local correlation methodology: merging coupled-cluster and Møller-Plesset perturbation theories. , 2010, The journal of physical chemistry. A.

[92]  Jonas Boström,et al.  Calibration of Cholesky Auxiliary Basis Sets for Multiconfigurational Perturbation Theory Calculations of Excitation Energies. , 2010, Journal of chemical theory and computation.

[93]  Wei Li,et al.  Improved design of orbital domains within the cluster-in-molecule local correlation framework: single-environment cluster-in-molecule ansatz and its application to local coupled-cluster approach with singles and doubles. , 2010, The journal of physical chemistry. A.

[94]  Emily A Carter,et al.  Cholesky decomposition within local multireference singles and doubles configuration interaction. , 2010, The Journal of chemical physics.

[95]  Tjerk P. Straatsma,et al.  NWChem: A comprehensive and scalable open-source solution for large scale molecular simulations , 2010, Comput. Phys. Commun..

[96]  Sriram Krishnamoorthy,et al.  Active-space completely-renormalized equation-of-motion coupled-cluster formalism: Excited-state studies of green fluorescent protein, free-base porphyrin, and oligoporphyrin dimer. , 2010, The Journal of chemical physics.

[97]  Josef Paldus,et al.  Recent Progress in Coupled Cluster Methods , 2010 .

[98]  Michael Hanrath,et al.  An efficient matrix-matrix multiplication based antisymmetric tensor contraction engine for general order coupled cluster. , 2010, The Journal of chemical physics.

[99]  Martin Head-Gordon,et al.  Fast Sparse Cholesky Decomposition and Inversion using Nested Dissection Matrix Reordering. , 2011, Journal of chemical theory and computation.

[100]  Sriram Krishnamoorthy,et al.  GPU-Based Implementations of the Noniterative Regularized-CCSD(T) Corrections: Applications to Strongly Correlated Systems. , 2011, Journal of chemical theory and computation.

[101]  Beverly A. Sanders,et al.  Software design of ACES III with the super instruction architecture , 2011 .

[102]  Roland Lindh,et al.  Cholesky Decomposition Techniques in Electronic Structure Theory , 2011 .

[103]  Dieter Cremer,et al.  Møller–Plesset perturbation theory: from small molecule methods to methods for thousands of atoms , 2011 .

[104]  A Eugene DePrince,et al.  Coupled Cluster Theory on Graphics Processing Units I. The Coupled Cluster Doubles Method. , 2011, Journal of chemical theory and computation.

[105]  Lorenzo Maschio,et al.  Local MP2 with Density Fitting for Periodic Systems: A Parallel Implementation. , 2011, Journal of chemical theory and computation.

[106]  E Weinan,et al.  Adaptive local basis set for Kohn-Sham density functional theory in a discontinuous Galerkin framework I: Total energy calculation , 2011, J. Comput. Phys..

[107]  Frederick R Manby,et al.  The orbital-specific-virtual local coupled cluster singles and doubles method. , 2012, The Journal of chemical physics.

[108]  H. Harbrecht,et al.  On the low-rank approximation by the pivoted Cholesky decomposition , 2012 .

[109]  Dimitrios G Liakos,et al.  Improved correlation energy extrapolation schemes based on local pair natural orbital methods. , 2012, The journal of physical chemistry. A.

[110]  Hans-Joachim Werner,et al.  Comparison of explicitly correlated local coupled-cluster methods with various choices of virtual orbitals. , 2012, Physical chemistry chemical physics : PCCP.

[111]  Dmitry I. Lyakh,et al.  Multireference nature of chemistry: the coupled-cluster view. , 2012, Chemical reviews.

[112]  Frank Neese,et al.  An efficient and near linear scaling pair natural orbital based local coupled cluster method. , 2013, The Journal of chemical physics.

[113]  Reinhold Schneider,et al.  Tensor-Structured Factorized Calculation of Two-Electron Integrals in a General Basis , 2013, SIAM J. Sci. Comput..

[114]  Evgeny Epifanovsky,et al.  New implementation of high‐level correlated methods using a general block tensor library for high‐performance electronic structure calculations , 2013, J. Comput. Chem..

[115]  Oreste Villa,et al.  Noniterative Multireference Coupled Cluster Methods on Heterogeneous CPU-GPU Systems. , 2013, Journal of chemical theory and computation.

[116]  Daniel Kats,et al.  Sparse tensor framework for implementation of general local correlation methods. , 2013, The Journal of chemical physics.

[117]  Evgeny Epifanovsky,et al.  General implementation of the resolution-of-the-identity and Cholesky representations of electron repulsion integrals within coupled-cluster and equation-of-motion methods: theory and benchmarks. , 2013, The Journal of chemical physics.

[118]  Frank Neese,et al.  Natural triple excitations in local coupled cluster calculations with pair natural orbitals. , 2013, The Journal of chemical physics.

[119]  R. Bartlett,et al.  Benchmarking for perturbative triple-excitations in EE-EOM-CC methods. , 2013, The journal of physical chemistry. A.

[120]  Daniel Kressner,et al.  A literature survey of low‐rank tensor approximation techniques , 2013, 1302.7121.

[121]  Takahito Nakajima,et al.  MPI/OpenMP Hybrid Parallel Algorithm of Resolution of Identity Second-Order Møller-Plesset Perturbation Calculation for Massively Parallel Multicore Supercomputers. , 2013, Journal of chemical theory and computation.

[122]  P. Szalay,et al.  Benchmarking Coupled Cluster Methods on Valence Singlet Excited States. , 2014, Journal of chemical theory and computation.

[123]  Beverly A. Sanders,et al.  Exploiting GPUs with the Super Instruction Architecture , 2014, International Journal of Parallel Programming.

[124]  C. Ochsenfeld,et al.  Cholesky-decomposed density MP2 with density fitting: accurate MP2 and double-hybrid DFT energies for large systems. , 2014, The Journal of chemical physics.

[125]  Emily A Carter,et al.  Density Fitting and Cholesky Decomposition of the Two-Electron Integrals in Local Multireference Configuration Interaction Theory. , 2015, Journal of chemical theory and computation.

[126]  Chao Yang,et al.  DGDFT: A massively parallel method for large scale density functional theory calculations. , 2015, The Journal of chemical physics.

[127]  T. Crawford,et al.  Incremental evaluation of coupled cluster dipole polarizabilities. , 2015, Physical chemistry chemical physics : PCCP.

[128]  Justus A. Calvin,et al.  Massively Parallel Implementation of Explicitly Correlated Coupled-Cluster Singles and Doubles Using TiledArray Framework. , 2016, The journal of physical chemistry. A.

[129]  Chao Yang,et al.  Chebyshev polynomial filtered subspace iteration in the discontinuous Galerkin method for large-scale electronic structure calculations. , 2016, The Journal of chemical physics.

[130]  T. Crawford,et al.  A Comparison of Three Approaches to the Reduced-Scaling Coupled Cluster Treatment of Non-Resonant Molecular Response Properties. , 2016, Journal of chemical theory and computation.

[131]  Frank Neese,et al.  Sparse maps--A systematic infrastructure for reduced-scaling electronic structure methods. II. Linear scaling domain based pair natural orbital coupled cluster theory. , 2016, The Journal of chemical physics.

[132]  E. Aprà,et al.  Implementation of High-Order Multireference Coupled-Cluster Methods on Intel Many Integrated Core Architecture. , 2016, Journal of chemical theory and computation.

[133]  P. Szalay,et al.  Accuracy of Coupled Cluster Excitation Energies in Diffuse Basis Sets. , 2017, Journal of chemical theory and computation.

[134]  Anna I Krylov,et al.  Extending Quantum Chemistry of Bound States to Electronic Resonances. , 2017, Annual review of physical chemistry.

[135]  Evgeny Epifanovsky,et al.  Coupled-Cluster Valence-Bond Singles and Doubles for Strongly Correlated Systems: Block-Tensor Based Implementation and Application to Oligoacenes. , 2017, Journal of chemical theory and computation.

[136]  J. Hammond,et al.  Coupled Cluster Studies of Ionization Potentials and Electron Affinities of Single-Walled Carbon Nanotubes. , 2017, The journal of physical chemistry. A.

[137]  Johannes T. Margraf,et al.  Accurate Intermolecular Potential for the C60 Dimer: The Performance of Different Levels of Quantum Theory. , 2017, Journal of chemical theory and computation.

[138]  T. Crawford,et al.  Frozen Virtual Natural Orbitals for Coupled-Cluster Linear-Response Theory. , 2017, The journal of physical chemistry. A.

[139]  Thomas Kjærgaard,et al.  The divide–expand–consolidate coupled cluster scheme , 2017 .

[140]  B. Peng,et al.  Low-rank factorization of electron integral tensors and its application in electronic structure theory , 2017 .

[141]  Anna I. Krylov,et al.  New algorithm for tensor contractions on multi‐core CPUs, GPUs, and accelerators enables CCSD and EOM‐CCSD calculations with over 1000 basis functions on a single compute node , 2017, J. Comput. Chem..

[142]  Samuel Williams,et al.  Cross-scale efficient tensor contractions for coupled cluster computations through multiple programming model backends , 2017, J. Parallel Distributed Comput..

[143]  Frank Neese,et al.  SparseMaps-A systematic infrastructure for reduced scaling electronic structure methods. V. Linear scaling explicitly correlated coupled-cluster method with pair natural orbitals. , 2017, The Journal of chemical physics.