Deep reinforcement learning for complex evaluation of one-loop diagrams in quantum field theory

In this paper we present a technique based on deep reinforcement learning that allows for numerical analytic continuation of integrals that are often encountered in one-loop diagrams in quantum field theory. To extract certain quantities of two-point functions, such as spectral densities, mass poles or multiparticle thresholds, it is necessary to perform an analytic continuation of the correlator in question. At one-loop level in Euclidean space, this results in the necessity to deform the integration contour of the loop integral in the complex plane of the square of the loop momentum, to avoid nonanalyticities in the integration plane. Using a toy model for which an exact solution is known, we train a reinforcement learning agent to perform the required contour deformations. Our study shows great promise for an agent to be deployed in iterative numerical approaches used to compute nonperturbative two-point functions, such as the quark propagator Dyson-Schwinger equation, or more generally, Fredholm equations of the second kind, in the complex domain.

[1]  Ufuk Topcu,et al.  Safe Reinforcement Learning via Shielding , 2017, AAAI.

[2]  R. Alkofer,et al.  Analytic properties of the Landau gauge gluon and quark propagators , 2004 .

[3]  R. Alkofer,et al.  How to Determine the Branch Points of Correlation Functions in Euclidean Space II: Three-Point Functions , 2013, Symmetry.

[4]  Richard Williams,et al.  Hadronic Observables from Dyson–Schwinger and Bethe–Salpeter equations , 2015, 1503.05896.

[5]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[6]  Richard Williams Vector mesons as dynamical resonances in the Bethe–Salpeter framework , 2018, Physics Letters B.

[7]  Richard Williams,et al.  Electromagnetic decays of the neutral pion , 2017, 1704.06046.

[8]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[9]  Klaus Hepp,et al.  Proof of the Bogoliubov-Parasiuk theorem on renormalization , 1966 .

[10]  Yishay Mansour,et al.  Policy Gradient Methods for Reinforcement Learning with Function Approximation , 1999, NIPS.

[11]  H. Sanchis-Alepuz,et al.  On the effect of resonances in the quark-photon vertex , 2019, The European Physical Journal A.

[12]  Richard Williams,et al.  Baryons as relativistic three-quark bound states , 2016, 1606.09602.

[13]  Alexei A. Efros,et al.  Curiosity-Driven Exploration by Self-Supervised Prediction , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[14]  Christian S. Fischer Infrared properties of QCD from Dyson-Schwinger equations , 2006 .

[15]  A. Höll,et al.  Aspects of hadron physics , 2008, 0802.0217.

[16]  J. Pawlowski,et al.  Finite temperature spectral functions in the O(N) model , 2017, Physical Review D.

[17]  W. Zimmermann Convergence of Bogoliubov's method of renormalization in momentum space , 1969 .

[18]  Andreas Windisch Analytic properties of the quark propagator from an effective infrared interaction model , 2016, 1612.06002.

[19]  Thomas G. Dietterich,et al.  In Advances in Neural Information Processing Systems 12 , 1991, NIPS 1991.

[20]  D. Zwanziger,et al.  Gribov horizon and i-particles: About a toy model and the construction of physical operators , 2009, 0912.5153.

[21]  M. Peña,et al.  Scattering amplitudes and contour deformations , 2019, Physical Review D.

[22]  Sergey Levine,et al.  Trust Region Policy Optimization , 2015, ICML.

[23]  Analytical properties of the quark propagator from a truncated Dyson-Schwinger equation in complex Euclidean space , 2013, 1312.2721.

[24]  Accounting for the analytical properties of the quark propagator from the Dyson-Schwinger equation , 2014, 1412.3345.

[25]  Reinhard Alkofer,et al.  The infrared behaviour of QCD Green's functions ☆: Confinement, dynamical symmetry breaking, and hadrons as relativistic bound states , 2000 .

[26]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[27]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[28]  I. Cloet,et al.  Explanation and Prediction of Observables using Continuum Strong QCD , 2013, 1310.2651.

[29]  W. Marsden I and J , 2012 .

[30]  Manfred Liebmann,et al.  Examining the analytic structure of Green's functions: Massive parallel complex integration using GPUs , 2013, Comput. Phys. Commun..

[31]  Richard Williams,et al.  Recent developments in bound-state calculations using the Dyson-Schwinger and Bethe-Salpeter equations , 2017, Comput. Phys. Commun..

[32]  C. Fischer,et al.  Analytic structure of the Landau-gauge gluon propagator. , 2004, Physical Review Letters.

[33]  N. N. Bogoliubow,et al.  Über die Multiplikation der Kausalfunktionen in der Quantentheorie der Felder , 1957 .