Nonlinear biases, stochastically sampled effective Hamiltonians, and spectral functions in quantum Monte Carlo methods

In this article we study examples of systematic biases that can occur in quantum Monte Carlo methods due to the accumulation of non-linear expectation values, and approaches by which these errors can be corrected. We begin with a study of the Krylov-projected FCIQMC (KP-FCIQMC) approach, which was recently introduced to allow efficient, stochastic calculation of dynamical properties. This requires the solution of a sampled effective Hamiltonian, resulting in a non-linear operation on these stochastic variables. We investigate the probability distribution of this eigenvalue problem to study both stochastic errors and systematic biases in the approach, and demonstrate that such errors can be significantly corrected by moving to a more appropriate basis. This is lastly expanded to include consideration of the correlation function QMC approach of Ceperley and Bernu, showing how such an approach can be taken in the FCIQMC framework.

[1]  Ali Alavi,et al.  Semi-stochastic full configuration interaction quantum Monte Carlo: Developments and application. , 2015, The Journal of chemical physics.

[2]  Jarrell,et al.  Quantum Monte Carlo simulations and maximum entropy: Dynamics from imaginary-time data. , 1991, Physical review. B, Condensed matter.

[3]  R. Bryan,et al.  Maximum entropy analysis of oversampled data problems , 1990, European Biophysics Journal.

[4]  Silver,et al.  Maximum-entropy method for analytic continuation of quantum Monte Carlo data. , 1990, Physical review. B, Condensed matter.

[5]  Stefano Baroni,et al.  Reptation Quantum Monte Carlo: A Method for Unbiased Ground-State Averages and Imaginary-Time Correlations , 1999 .

[6]  T. D. Kuehner,et al.  Dynamical correlation functions using the density matrix renormalization group , 1998, cond-mat/9812372.

[7]  M. Caffarel,et al.  Lanczós-Type Algorithm for Quantum Monte Carlo Data , 1991 .

[8]  J. M. Pitarke,et al.  Hellman-Feynman operator sampling in diffusion Monte Carlo calculations. , 2007, Physical review letters.

[9]  D. Vollhardt,et al.  Correlated Lattice Fermions in High Dimensions , 1989 .

[10]  E. Neuscamman,et al.  An Efficient Variational Principle for the Direct Optimization of Excited States. , 2015, Journal of chemical theory and computation.

[11]  N. S. Blunt,et al.  Density-matrix quantum Monte Carlo method , 2013, 1303.5007.

[12]  Ali Alavi,et al.  Communications: Survival of the fittest: accelerating convergence in full configuration-interaction quantum Monte Carlo. , 2010, The Journal of chemical physics.

[13]  C. Marianetti,et al.  Electronic structure calculations with dynamical mean-field theory , 2005, cond-mat/0511085.

[14]  I. McCulloch,et al.  Chebyshev matrix product state approach for spectral functions , 2011, 1101.5895.

[15]  Ali Alavi,et al.  An excited-state approach within full configuration interaction quantum Monte Carlo. , 2015, The Journal of chemical physics.

[16]  Ali Alavi,et al.  Unbiased reduced density matrices and electronic properties from full configuration interaction quantum Monte Carlo. , 2014, The Journal of chemical physics.

[17]  M. H. Kalos,et al.  Bilinear quantum Monte Carlo: Expectations and energy differences , 1992 .

[18]  N. S. Blunt,et al.  Accurate Exchange-Correlation Energies for the Warm Dense Electron Gas. , 2016, Physical review letters.

[19]  S. M. Rothstein,et al.  Ground-state properties of LiH by reptation quantum Monte Carlo methods. , 2011, Physical chemistry chemical physics : PCCP.

[20]  W. Lester,et al.  Quantum Monte Carlo for floppy molecules: Vibrational states of C3 , 1995 .

[21]  J. MacDonald,et al.  Successive Approximations by the Rayleigh-Ritz Variation Method , 1933 .

[22]  C J Umrigar,et al.  Optimization of quantum Monte Carlo wave functions by energy minimization. , 2007, The Journal of chemical physics.

[23]  Efficient calculation of unbiased expectation values in diffusion quantum Monte Carlo , 2012 .

[24]  Ali Alavi,et al.  An explicitly correlated approach to basis set incompleteness in full configuration interaction quantum Monte Carlo. , 2012, The Journal of chemical physics.

[25]  W. Krauth,et al.  Dynamical mean-field theory of strongly correlated fermion systems and the limit of infinite dimensions , 1996 .

[26]  Martin Ganahl,et al.  Chebyshev expansion for impurity models using matrix product states , 2014, 1403.1209.

[27]  D. Ceperley,et al.  The calculation of excited state properties with quantum Monte Carlo , 1988 .

[28]  Garnet Kin-Lic Chan,et al.  Optimizing large parameter sets in variational quantum Monte Carlo , 2011, 1108.0900.

[29]  Hitesh J. Changlani,et al.  Density-matrix based determination of low-energy model Hamiltonians from ab initio wavefunctions. , 2015, The Journal of chemical physics.

[30]  Verena A. Neufeld,et al.  A study of the dense uniform electron gas with high orders of coupled cluster. , 2017, The Journal of chemical physics.

[31]  Sebastian Boblest,et al.  Fixed-phase correlation-function quantum Monte Carlo calculations for ground and excited states of helium in neutron-star magnetic fields , 2013 .

[32]  E. Neuscamman,et al.  Size Consistent Excited States via Algorithmic Transformations between Variational Principles. , 2017, Journal of chemical theory and computation.

[33]  S. Ten-no,et al.  A study of potential energy curves from the model space quantum Monte Carlo method. , 2015, The Journal of chemical physics.

[34]  Kwon,et al.  Transient-estimate Monte Carlo in the two-dimensional electron gas. , 1996, Physical review. B, Condensed matter.

[35]  S. M. Rothstein,et al.  A pure-sampling quantum Monte Carlo algorithm. , 2015, The Journal of chemical physics.

[36]  R. Needs,et al.  Quantum Monte Carlo simulations of solids , 2001 .

[37]  Olga Chernomor,et al.  Molecular Electrical Properties from Quantum Monte Carlo Calculations: Application to Ethyne. , 2012, Journal of chemical theory and computation.

[38]  Ali Alavi,et al.  Fermion Monte Carlo without fixed nodes: a game of life, death, and annihilation in Slater determinant space. , 2009, The Journal of chemical physics.

[39]  Charles J. C. Scott,et al.  Stochastic coupled cluster theory: Efficient sampling of the coupled cluster expansion. , 2017, The Journal of chemical physics.

[40]  Ali Alavi,et al.  Combining the Complete Active Space Self-Consistent Field Method and the Full Configuration Interaction Quantum Monte Carlo within a Super-CI Framework, with Application to Challenging Metal-Porphyrins. , 2016, Journal of chemical theory and computation.

[41]  W. A. Lester,et al.  The calculation of excited states with quantum Monte Carlo. II. Vibrational excited states , 1990 .

[42]  N. S. Blunt,et al.  The sign problem and population dynamics in the full configuration interaction quantum Monte Carlo method. , 2011, The Journal of chemical physics.

[43]  Ali Alavi,et al.  Krylov-Projected Quantum Monte Carlo Method. , 2015, Physical review letters.

[44]  M. Motta,et al.  Computation of Ground-State Properties in Molecular Systems: Back-Propagation with Auxiliary-Field Quantum Monte Carlo. , 2017, Journal of chemical theory and computation.

[45]  Shuai,et al.  Symmetrized density-matrix renormalization-group method for excited states of Hubbard models. , 1996, Physical review. B, Condensed matter.

[46]  Ali Alavi,et al.  A study of electron affinities using the initiator approach to full configuration interaction quantum Monte Carlo. , 2011, The Journal of chemical physics.

[47]  S. Ten-no Multi-state effective Hamiltonian and size-consistency corrections in stochastic configuration interactions. , 2017, The Journal of chemical physics.

[48]  Alex J W Thom,et al.  Stochastic coupled cluster theory. , 2010, Physical review letters.

[49]  M. Caffarel,et al.  A Bayesian analysis of Green's function Monte Carlo correlation functions , 1992 .

[50]  Jarrell,et al.  Spectral densities of the symmetric Anderson model. , 1990, Physical review letters.

[51]  V. Savona,et al.  Driven-dissipative quantum Monte Carlo method for open quantum systems , 2018, Physical Review A.

[52]  Matthew B Hastings,et al.  Measuring Renyi entanglement entropy in quantum Monte Carlo simulations. , 2010, Physical review letters.

[53]  Richard G. Hennig,et al.  Alleviation of the Fermion-sign problem by optimization of many-body wave functions , 2007 .

[54]  Seiichiro Ten-no,et al.  Stochastic determination of effective Hamiltonian for the full configuration interaction solution of quasi-degenerate electronic states. , 2013, The Journal of chemical physics.

[55]  Qiming Sun,et al.  Stochastic Multiconfigurational Self-Consistent Field Theory. , 2015, Journal of chemical theory and computation.

[56]  P. E. Dargel,et al.  Lanczos algorithm with Matrix Product States for dynamical correlation functions , 2012, 1203.2523.

[57]  Mark Jarrell,et al.  Bayesian inference and the analytic continuation of imaginary-time quantum Monte Carlo data , 1996 .

[58]  E. Neuscamman Communication: Variation after response in quantum Monte Carlo. , 2016, The Journal of chemical physics.

[59]  Hallberg Density-matrix algorithm for the calculation of dynamical properties of low-dimensional systems. , 1995, Physical review. B, Condensed matter.