Iterative Configuration Interaction with Selection.

Even when starting with a very poor initial guess, the iterative configuration interaction (iCI) approach [J. Chem. Theory Comput. 12, 1169 (2016)] for strongly correlated electrons can converge from above to full CI (FCI) very quickly by constructing and diagonalizing a very small Hamiltonian matrix at each macro/micro-iteration. However, as a direct solver of the FCI problem, iCI is computationally very expensive. The problem can be mitigated by observing that a vast number of configurations have little weights in the wave function and hence do not contribute discernibly to the correlation energy. The real questions are then (a) how to identify those important configurations as early as possible in the calculation and (b) how to account for the residual contributions of those unimportant configurations. It is generally true that if a high-quality yet compact variational space can be determined for describing the static correlation, a low-order treatment of the residual dynamic correlation would then be sufficient. While this is common to all selected CI schemes, the `iCI with selection' scheme presented here has the following distinctive features: (1) Full spin symmetry is always maintained by taking configuration state functions (CSF) as the many-electron basis. (2) Although the selection is performed on individual CSFs, it is orbital configurations (oCFG) that are used as the organizing units. (3) Given a coefficient pruning-threshold $C_{\mathrm{min}}$ (which determines the size of the variational space for static correlation), the selection of important oCFGs/CSFs is performed iteratively until convergence. (4) At each iteration for the growth of the wave function, the first-order interacting space is decomposed into disjoint subspaces, so as to reduce memory requirement on one hand and facilitate parallelization on the other. (5) Upper bounds (which involve only two-electron integrals) for the interactions between doubly connected oCFG pairs are used to screen each first-order interacting subspace before the first-order coefficients of individual CSFs are evaluated. (6) Upon convergence of the static correlation for a given $C_{\mathrm{min}}$, dynamic correlation is estimated by using the state-specific Epstein-Nesbet second-order perturbation theory (PT2). The efficacy of the iCIPT2 scheme is demonstrated numerically by benchmark examples, including \ce{C2}, \ce{O2}, \ce{Cr2} and \ce{C6H6}.

[1]  P. S. Epstein,et al.  The Stark effect from the point of view of Schroedinger's quantum theory , 1926 .

[2]  R. Nesbet Configuration interaction in orbital theories , 1955, Proceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences.

[3]  Ernest R. Davidson,et al.  Studies in Configuration Interaction: The First-Row Diatomic Hydrides , 1969 .

[4]  J. L. Whitten,et al.  Configuration Interaction Studies of Ground and Excited States of Polyatomic Molecules. I. The CI Formulation and Studies of Formaldehyde , 1969 .

[5]  J. P. Malrieu,et al.  Iterative perturbation calculations of ground and excited state energies from multiconfigurational zeroth‐order wavefunctions , 1973 .

[6]  Robert J. Buenker,et al.  Individualized configuration selection in CI calculations with subsequent energy extrapolation , 1974 .

[7]  M. J. Boyle,et al.  Unitary Group Approach to the Many-Electron Correlation Problem via Graphical Methods of Spin Algebras , 1980 .

[8]  P. Payne Matrix element factorization in the unitary group approach for configuration interaction calculations , 1982 .

[9]  Stefano Evangelisti,et al.  Convergence of an improved CIPSI algorithm , 1983 .

[10]  R. Cimiraglia Second order perturbation correction to CI energies by use of diagrammatic techniques: An improvement to the CIPSI algorithm , 1985 .

[11]  D. Mukherjee Aspects of linked cluster expansion in general model space many-body perturbation and coupled-cluster theory , 1986 .

[12]  R. Buenker Combining perturbation theory techniques with variational CI calculations to study molecular excited states , 1986 .

[13]  D. Mukherjee The linked-cluster theorem in the open-shell coupled-cluster theory for incomplete model spaces , 1986 .

[14]  W. Goddard,et al.  New predictions for singlet-triplet gaps of substituted carbenes , 1987 .

[15]  W. Goddard,et al.  Correlation‐consistent configuration interaction: Accurate bond dissociation energies from simple wave functions , 1988 .

[16]  D. Mukherjee,et al.  Size-extensive effective Hamiltonian formalisms using quasi-Hilbert and quasi-Fock space strategies with incomplete model spaces , 1989 .

[17]  T. H. Dunning Gaussian basis sets for use in correlated molecular calculations. I. The atoms boron through neon and hydrogen , 1989 .

[18]  Hiroshi Nakatsuji,et al.  Exponentially generated configuration interaction theory. Descriptions of excited, ionized, and electron attached states , 1991 .

[19]  Robert J. Harrison,et al.  Approximating full configuration interaction with selected configuration interaction and perturbation theory , 1991 .

[20]  G. Herzberg,et al.  Molecular Spectra and Molecular Structure , 1992 .

[21]  Margarita Martín,et al.  C2 spectroscopy and kinetics , 1992 .

[22]  Hans W. Horn,et al.  Fully optimized contracted Gaussian basis sets for atoms Li to Kr , 1992 .

[23]  Jean-Paul Malrieu,et al.  Specific CI calculation of energy differences: Transition energies and bond energies , 1993 .

[24]  Robert J. Buenker,et al.  A new table-direct configuration interaction method for the evaluation of Hamiltonian matrix elements in a basis of linear combinations of spin-adapted functions , 1995 .

[25]  J. Malrieu,et al.  An iterative difference-dedicated configuration interaction. Proposal and test studies , 1995 .

[26]  Henry F. Schaefer,et al.  Compact Variational Wave Functions Incorporating Limited Triple and Quadruple Substitutions , 1996 .

[27]  Michael Hanrath,et al.  New algorithms for an individually selecting MR-CI program , 1997 .

[28]  J. Greer Monte Carlo Configuration Interaction , 1998 .

[29]  Richard L. Martin,et al.  Ab initio quantum chemistry using the density matrix renormalization group , 1998 .

[30]  M. Ratner Molecular electronic-structure theory , 2000 .

[31]  Klaus Ruedenberg,et al.  Identification of deadwood in configuration spaces through general direct configuration interaction , 2001 .

[32]  Frank Neese,et al.  A spectroscopy oriented configuration interaction procedure , 2003 .

[33]  K. Ruedenberg,et al.  Correlation energy extrapolation by intrinsic scaling. I. Method and application to the neon atom. , 2004, The Journal of chemical physics.

[34]  P. Surján,et al.  Comparison of low-order multireference many-body perturbation theories. , 2005, The Journal of chemical physics.

[35]  H. Nakatsuji,et al.  Iterative Cl general singles and doubles (ICIGSD) method for calculating the exact wave functions of the ground and excited states of molecules. , 2005, The Journal of chemical physics.

[36]  C. F. Bunge Selected configuration interaction with truncation energy error and application to the Ne atom. , 2006, The Journal of chemical physics.

[37]  Shigeru Nagase,et al.  Projector Monte Carlo method based on configuration state functions. Test applications to the H4 system and dissociation of LiH , 2008 .

[38]  Laura Gagliardi,et al.  The restricted active space followed by second-order perturbation theory method: theory and application to the study of CuO2 and Cu2O2 systems. , 2008, The Journal of chemical physics.

[39]  Zoltán Rolik,et al.  A sparse matrix based full-configuration interaction algorithm. , 2008, The Journal of chemical physics.

[40]  K. Ruedenberg,et al.  A priori Identification of Configurational Deadwood , 2009 .

[41]  I. Shavitt Graph theoretical concepts for the unitary group approach to the many-electron correlation problem , 2009 .

[42]  P. Surján,et al.  Comparative study of multireference perturbative theories for ground and excited states. , 2009, The Journal of chemical physics.

[43]  Ali Alavi,et al.  Fermion Monte Carlo without fixed nodes: a game of life, death, and annihilation in Slater determinant space. , 2009, The Journal of chemical physics.

[44]  Robert Roth,et al.  Importance truncation for large-scale configuration interaction approaches , 2009, 0903.4605.

[45]  Dmitry I. Lyakh,et al.  An adaptive coupled-cluster theory: @CC approach. , 2010, The Journal of chemical physics.

[46]  Ali Alavi,et al.  Communications: Survival of the fittest: accelerating convergence in full configuration-interaction quantum Monte Carlo. , 2010, The Journal of chemical physics.

[47]  L. Gagliardi,et al.  Strong correlation treated via effective hamiltonians and perturbation theory. , 2011, The Journal of chemical physics.

[48]  Sandeep Sharma,et al.  The density matrix renormalization group in quantum chemistry. , 2011, Annual review of physical chemistry.

[49]  Laimutis Bytautas,et al.  Seniority and orbital symmetry as tools for establishing a full configuration interaction hierarchy. , 2011, The Journal of chemical physics.

[50]  J P Coe,et al.  Development of Monte Carlo configuration interaction: natural orbitals and second-order perturbation theory. , 2012, The Journal of chemical physics.

[51]  C J Umrigar,et al.  Semistochastic projector Monte Carlo method. , 2012, Physical review letters.

[52]  Michel Caffarel,et al.  Using perturbatively selected configuration interaction in quantum Monte Carlo calculations , 2013 .

[53]  Seiichiro Ten-no,et al.  Stochastic determination of effective Hamiltonian for the full configuration interaction solution of quasi-degenerate electronic states. , 2013, The Journal of chemical physics.

[54]  N. S. Blunt,et al.  Density-matrix quantum Monte Carlo method , 2013, 1303.5007.

[55]  Francesco A Evangelista,et al.  Adaptive multiconfigurational wave functions. , 2014, The Journal of chemical physics.

[56]  Mark R. Hoffmann,et al.  SDS: the ‘static–dynamic–static’ framework for strongly correlated electrons , 2014, Theoretical Chemistry Accounts.

[57]  Ali Alavi,et al.  Linear-scaling and parallelisable algorithms for stochastic quantum chemistry , 2013, 1305.6981.

[58]  N. Blunt,et al.  Interaction picture density matrix quantum Monte Carlo. , 2015, The Journal of chemical physics.

[59]  Ali Alavi,et al.  Multireference linearized coupled cluster theory for strongly correlated systems using matrix product states. , 2015, The Journal of chemical physics.

[60]  Garnet Kin-Lic Chan,et al.  The ab-initio density matrix renormalization group in practice. , 2015, The Journal of chemical physics.

[61]  P. Knowles Compressive sampling in configuration interaction wavefunctions , 2015 .

[62]  Martin Head-Gordon,et al.  A deterministic alternative to the full configuration interaction quantum Monte Carlo method. , 2016, The Journal of chemical physics.

[63]  E. Giner,et al.  Quantum Monte Carlo with reoptimised perturbatively selected configuration-interaction wave functions , 2016, 1601.05915.

[64]  Francesco A Evangelista,et al.  A Deterministic Projector Configuration Interaction Approach for the Ground State of Quantum Many-Body Systems. , 2016, Journal of chemical theory and computation.

[65]  Mike Espig,et al.  Tensor representation techniques for full configuration interaction: A Fock space approach using the canonical product format. , 2016, The Journal of chemical physics.

[66]  Wenjian Liu,et al.  iCI: Iterative CI toward full CI. , 2016, Journal of chemical theory and computation.

[67]  C J Umrigar,et al.  Heat-Bath Configuration Interaction: An Efficient Selected Configuration Interaction Algorithm Inspired by Heat-Bath Sampling. , 2016, Journal of chemical theory and computation.

[68]  C J Umrigar,et al.  Efficient Heat-Bath Sampling in Fock Space. , 2015, Journal of chemical theory and computation.

[69]  Jeffrey B Schriber,et al.  Communication: An adaptive configuration interaction approach for strongly correlated electrons with tunable accuracy. , 2016, The Journal of chemical physics.

[70]  Francesco A. Evangelista,et al.  Adaptive Configuration Interaction for Computing Challenging Electronic Excited States with Tunable Accuracy. , 2017, Journal of chemical theory and computation.

[71]  Sandeep Sharma,et al.  Excited states using semistochastic heat-bath configuration interaction. , 2017, The Journal of chemical physics.

[72]  P. Zimmerman Strong correlation in incremental full configuration interaction. , 2017, The Journal of chemical physics.

[73]  J. Hasegawa,et al.  Selected configuration interaction method using sampled first-order corrections to wave functions. , 2017, The Journal of chemical physics.

[74]  Adam A Holmes,et al.  Cheap and Near Exact CASSCF with Large Active Spaces. , 2017, Journal of chemical theory and computation.

[75]  P. Zimmerman Incremental full configuration interaction. , 2017, The Journal of chemical physics.

[76]  J. J. Eriksen,et al.  Virtual Orbital Many-Body Expansions: A Possible Route towards the Full Configuration Interaction Limit. , 2017, The journal of physical chemistry letters.

[77]  Chao Huang,et al.  iVI: An iterative vector interaction method for large eigenvalue problems , 2017, J. Comput. Chem..

[78]  Mark R. Hoffmann,et al.  Further development of SDSPT2 for strongly correlated electrons , 2017 .

[79]  Ali Alavi,et al.  Semistochastic Heat-Bath Configuration Interaction Method: Selected Configuration Interaction with Semistochastic Perturbation Theory. , 2016, Journal of chemical theory and computation.

[80]  K. B. Whaley,et al.  Cluster decomposition of full configuration interaction wave functions: A tool for chemical interpretation of systems with strong correlation. , 2017, The Journal of chemical physics.

[81]  Yann Garniron,et al.  Hybrid stochastic-deterministic calculation of the second-order perturbative contribution of multireference perturbation theory. , 2017, The Journal of chemical physics.

[82]  Enhua Xu,et al.  Full Coupled-Cluster Reduction for Accurate Description of Strong Electron Correlation. , 2018, Physical review letters.

[83]  Daniel S. Levine,et al.  An efficient deterministic perturbation theory for selected configuration interaction methods , 2018, 1808.02049.

[84]  Piotr Piecuch,et al.  Communication: Approaching exact quantum chemistry by cluster analysis of full configuration interaction quantum Monte Carlo wave functions. , 2018, The Journal of chemical physics.

[85]  Benjamin G. Levine,et al.  Large-Scale Electron Correlation Calculations: Rank-Reduced Full Configuration Interaction. , 2018, Journal of chemical theory and computation.

[86]  J P Coe,et al.  Machine Learning Configuration Interaction. , 2018, Journal of chemical theory and computation.

[87]  Yann Garniron,et al.  Selected configuration interaction dressed by perturbation. , 2018, The Journal of chemical physics.

[88]  Jeffrey B Schriber,et al.  A Combined Selected Configuration Interaction and Many-Body Treatment of Static and Dynamical Correlation in Oligoacenes. , 2018, Journal of chemical theory and computation.

[89]  N. S. Blunt,et al.  Communication: An efficient and accurate perturbative correction to initiator full configuration interaction quantum Monte Carlo. , 2018, The Journal of chemical physics.

[90]  J. J. Eriksen,et al.  Many-Body Expanded Full Configuration Interaction. I. Weakly Correlated Regime. , 2018, Journal of chemical theory and computation.

[91]  A. Scemama,et al.  Excitation energies from diffusion Monte Carlo using selected configuration interaction nodes. , 2018, The Journal of chemical physics.

[92]  Matthew Otten,et al.  Fast semistochastic heat-bath configuration interaction. , 2018, The Journal of chemical physics.

[93]  N. S. Blunt,et al.  Preconditioning and Perturbative Estimators in Full Configuration Interaction Quantum Monte Carlo. , 2019, Journal of chemical theory and computation.

[94]  Hai-bo Ma,et al.  Multi-reference Epstein–Nesbet perturbation theory with density matrix renormalization group reference wavefunction , 2019, Electronic Structure.

[95]  Generalized Many-Body Expanded Full Configuration Interaction Theory. , 2019, The journal of physical chemistry letters.

[96]  J. J. Eriksen,et al.  Many-Body Expanded Full Configuration Interaction. II. Strongly Correlated Regime. , 2018, Journal of chemical theory and computation.

[97]  Chao Huang,et al.  iVI‐TD‐DFT: An iterative vector interaction method for exterior/interior roots of TD‐DFT , 2018, J. Comput. Chem..

[98]  Yuan Yao,et al.  Accurate many-body electronic structure near the basis set limit: Application to the chromium dimer , 2019, Physical Review Research.