Optimization of the Coupled Cluster Implementation in NWChem on Petascale Parallel Architectures.

The coupled cluster singles and doubles (CCSD) algorithm in the NWChem software package has been optimized to alleviate the communication bottleneck. This optimization provided a 2-fold to 5-fold speedup in the CCSD iteration time depending on the problem size and available memory, and improved the CCSD scaling to 20 000 nodes of the NCSA Blue Waters supercomputer. On 20 000 XE6 nodes of Blue Waters, a complete conventional CCSD(T) calculation of a system encountering 1042 basis functions and 103 occupied correlated orbitals obtained a performance of 0.32 petaflop/s and took 5 h and 24 min to complete. The reported time and performance included all stages of the calculation from initialization to termination for iterative single and double excitations as well as perturbative triples correction. In perturbative triples alone, the computation sustained a rate of 1.18 petaflop/s. The CCSD and (T) phases took approximately (3)/4 and (1)/4 of the total time to solution, respectively, showing that CCSD is the most time-consuming part at the large scale. The MP2, CCSD, and CCSD(T) computations in 6-311++G** basis set performed on guanine-cytosine deoxydinucleotide monophosphate probed the conformational energy difference between the A- and B-conformations of single stranded DNA. Good agreement between MP2 and coupled cluster methods has been obtained, suggesting the utility of MP2 for conformational analysis in these systems. The study revealed a significant discrepancy between the quantum mechanical and classical force field predictions, suggesting a need to improve the dihedral parameters.

[1]  Martin Schütz,et al.  Molpro: a general‐purpose quantum chemistry program package , 2012 .

[2]  Gregory J O Beran,et al.  Prediction of organic molecular crystal geometries from MP2-level fragment quantum mechanical/molecular mechanical calculations. , 2012, The Journal of chemical physics.

[3]  Jing Ma,et al.  Linear scaling local correlation approach for solving the coupled cluster equations of large systems , 2002, J. Comput. Chem..

[4]  Curtis L. Janssen,et al.  An efficient reformulation of the closed‐shell coupled cluster single and double excitation (CCSD) equations , 1988 .

[5]  Timothy Clark,et al.  Efficient diffuse function‐augmented basis sets for anion calculations. III. The 3‐21+G basis set for first‐row elements, Li–F , 1983 .

[6]  Branislav Jansík,et al.  Linear scaling coupled cluster method with correlation energy based error control. , 2010, The Journal of chemical physics.

[7]  Maarten G. Wolf,et al.  Evaluating nonpolarizable nucleic acid force fields: A systematic comparison of the nucleobases hydration free energies and chloroform‐to‐water partition coefficients , 2012, J. Comput. Chem..

[8]  R J Bartlett,et al.  Parallel implementation of electronic structure energy, gradient, and Hessian calculations. , 2008, The Journal of chemical physics.

[9]  V. Bloomfield,et al.  DNA condensation by cobalt hexaammine(III) in alcohol–water mixtures: Dielectric constant and other solvent effects , 1995, Biopolymers.

[10]  F. J. Luque,et al.  Frontiers in molecular dynamics simulations of DNA. , 2012, Accounts of chemical research.

[11]  Victor M Anisimov,et al.  The role of molecular structure of sugar-phosphate backbone and nucleic acid bases in the formation of single-stranded and double-stranded DNA structures. , 2014, Biopolymers.

[12]  Philippe Y. Ayala,et al.  Linear scaling coupled cluster and perturbation theories in the atomic orbital basis , 1999 .

[13]  Victor M. Anisimov,et al.  DFT study of minimal fragments of nucleic acid single chain for explication of sequence dependence of DNA duplex conformation , 2009 .

[14]  K Schulten,et al.  VMD: visual molecular dynamics. , 1996, Journal of molecular graphics.

[15]  Sotiris S. Xantheas,et al.  Low‐lying energy isomers and global minima of aqueous nanoclusters: Structures and spectroscopic features of the pentagonal dodecahedron (H2O)20 and (H3O)+(H2O)20 , 2012 .

[16]  Marcel Nooijen,et al.  Combining coupled cluster and perturbation theory , 1999 .

[17]  K. Brueckner,et al.  TWO-BODY FORCES AND NUCLEAR SATURATION. III. DETAILS OF THE STRUCTURE OF THE NUCLEUS , 1955 .

[18]  Andrzej Leś,et al.  DFT Study of B-like Conformations of Deoxydinucleoside Monophosphates Containing Gua and/or Cyt and their Complexes with Na+ Cation , 2008, Journal of biomolecular structure & dynamics.

[19]  M. Plesset,et al.  Note on an Approximation Treatment for Many-Electron Systems , 1934 .

[20]  Wei Li,et al.  Local correlation calculations using standard and renormalized coupled-cluster approaches. , 2009, The Journal of chemical physics.

[21]  Victor M. Anisimov,et al.  DFT study of polymorphism of the DNA double helix at the level of dinucleoside monophosphates , 2010 .

[22]  V. I. Poltev,et al.  DFT study of DNA sequence dependence at the level of dinucleoside monophosphates , 2011 .

[23]  Trygve Helgaker,et al.  Implementation of the incremental scheme for one-electron first-order properties in coupled-cluster theory. , 2009, The Journal of chemical physics.

[24]  P. Kollman,et al.  A modified version of the Cornell et al. force field with improved sugar pucker phases and helical repeat. , 1999, Journal of biomolecular structure & dynamics.

[25]  So Hirata,et al.  Coupled-cluster and many-body perturbation study of energies, structures, and phonon dispersions of solid hydrogen fluoride† , 2009 .

[26]  Laxmikant V. Kalé,et al.  Scalable molecular dynamics with NAMD , 2005, J. Comput. Chem..

[27]  R. Bartlett,et al.  Coupled-cluster theory in quantum chemistry , 2007 .

[28]  T. Majima,et al.  Conformational changes of non-B DNA. , 2011, Chemical Society reviews.

[29]  Jeffrey Goldstone,et al.  Derivation of the Brueckner many-body theory , 1957, Proceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences.

[30]  Thomas E Cheatham,et al.  Simulation and modeling of nucleic acid structure, dynamics and interactions. , 2004, Current opinion in structural biology.

[31]  P. Kollman,et al.  How well does a restrained electrostatic potential (RESP) model perform in calculating conformational energies of organic and biological molecules? , 2000 .

[32]  F. Coester,et al.  Short-range correlations in nuclear wave functions , 1960 .

[33]  Donald G Truhlar,et al.  Evaluation of the Electrostatically Embedded Many-Body Expansion and the Electrostatically Embedded Many-Body Expansion of the Correlation Energy by Application to Low-Lying Water Hexamers. , 2008, Journal of chemical theory and computation.

[34]  J. Pople,et al.  Self‐consistent molecular orbital methods. XX. A basis set for correlated wave functions , 1980 .

[35]  Jarek Nieplocha,et al.  Advances, Applications and Performance of the Global Arrays Shared Memory Programming Toolkit , 2006, Int. J. High Perform. Comput. Appl..

[36]  Mark S. Gordon,et al.  General atomic and molecular electronic structure system , 1993, J. Comput. Chem..

[37]  P. Pulay,et al.  The accuracy of quantum chemical methods for large noncovalent complexes. , 2013, Journal of chemical theory and computation.

[38]  Alistair P. Rendell,et al.  A direct coupled cluster algorithm for massively parallel computers , 1997 .

[39]  Rodney J Bartlett,et al.  A natural linear scaling coupled-cluster method. , 2004, The Journal of chemical physics.

[40]  Denis Usvyat,et al.  Efficient and accurate treatment of weak pairs in local CCSD(T) calculations. , 2013, The Journal of chemical physics.

[41]  Frank Neese,et al.  Natural triple excitations in local coupled cluster calculations with pair natural orbitals. , 2013, The Journal of chemical physics.

[42]  A. Deriabina,et al.  Computational study of the molecular mechanisms of caffeine action: Caffeine complexes with adenosine receptors , 2010 .

[43]  K. Brueckner,et al.  Many-Body Problem for Strongly Interacting Particles. II. Linked Cluster Expansion , 1955 .

[44]  Martin Karplus,et al.  DNA polymorphism: a comparison of force fields for nucleic acids. , 2003, Biophysical journal.

[45]  Werner Kutzelnigg,et al.  How many‐body perturbation theory (MBPT) has changed quantum chemistry , 2009 .

[46]  Tjerk P. Straatsma,et al.  NWChem: A comprehensive and scalable open-source solution for large scale molecular simulations , 2010, Comput. Phys. Commun..

[47]  R. Bartlett,et al.  A full coupled‐cluster singles and doubles model: The inclusion of disconnected triples , 1982 .

[48]  Mark S. Gordon,et al.  A Novel Approach to Parallel Coupled Cluster Calculations: Combining Distributed and Shared Memory Techniques for Modern Cluster Based Systems , 2007 .

[49]  Karol Kowalski,et al.  Coupled Cluster Theories for Strongly Correlated Molecular Systems , 2013 .

[50]  C. David Sherrill,et al.  Highly Accurate Coupled Cluster Potential Energy Curves for the Benzene Dimer: Sandwich, T-Shaped, and Parallel-Displaced Configurations , 2004 .

[51]  Alexander D. MacKerell,et al.  All‐atom empirical force field for nucleic acids: I. Parameter optimization based on small molecule and condensed phase macromolecular target data , 2000 .

[52]  C David Sherrill,et al.  Hybrid correlation models based on active-space partitioning: correcting second-order Moller-Plesset perturbation theory for bond-breaking reactions. , 2005, The Journal of chemical physics.

[53]  M. Luo,et al.  X-ray crystal structures of half the human papilloma virus E2 binding site: d(GACCGCGGTC). , 1998, Nucleic acids research.

[54]  Masato Kobayashi,et al.  Divide-and-conquer-based linear-scaling approach for traditional and renormalized coupled cluster methods with single, double, and noniterative triple excitations. , 2009, The Journal of chemical physics.

[55]  Peter E. Nielsen.  Peptide Nucleic Acids (PNA) in Chemical Biology and Drug Discovery , 2010, Chemistry & biodiversity.

[56]  J. Cizek.  On the Correlation Problem in Atomic and Molecular Systems. Calculation of Wavefunction Components in Ursell-Type Expansion Using Quantum-Field Theoretical Methods , 1966 .

[57]  F. Coester,et al.  Bound states of a many-particle system , 1958 .

[58]  Alexander D. MacKerell,et al.  Update of the CHARMM all-atom additive force field for lipids: validation on six lipid types. , 2010, The journal of physical chemistry. B.

[59]  U Heinemann,et al.  Double helix conformation, groove dimensions and ligand binding potential of a G/C stretch in B-DNA. , 1992, The EMBO journal.

[60]  M. Head‐Gordon,et al.  A fifth-order perturbation comparison of electron correlation theories , 1989 .