Rejoinder for "Probabilistic Integration: A Role in Statistical Computation?"

This article is the rejoinder for the paper “Probabilistic Integration: A Role in Statistical Computation?” (Statist. Sci. 34 (2019) 1–22). We would first like to thank the reviewers and many of our colleagues who helped shape this paper, the Editor for selecting our paper for discussion, and of course all of the discussants for their thoughtful, insightful and constructive comments. In this rejoinder, we respond to some of the points raised by the discussants and comment further on the fundamental questions underlying the paper: (i) Should Bayesian ideas be used in numerical analysis? and (ii) If so, what role should such approaches have in statistical computation?

[1]  N. Kuiper.  Tests concerning random points on a circle , 1960 .

[2]  Richard D. Gill,et al.  Elementary Statistics on Trial—The Case of Lucia de Berk , 2010, CHANCE.

[3]  Dino Sejdinovic,et al.  Gaussian Processes and Kernel Methods: A Review on Connections and Equivalences , 2018, ArXiv.

[4]  Mark A. Girolami,et al.  Probabilistic Numerical Methods for PDE-constrained Bayesian Inverse Problems , 2017, ArXiv.

[5]  A. W. Vaart,et al.  Frequentist coverage of adaptive nonparametric Bayesian credible sets , 2013, 1310.4489.

[6]  Andrew M. Stuart,et al.  How Deep Are Deep Gaussian Processes? , 2017, J. Mach. Learn. Res..

[7]  Klaus Ritter,et al.  Bayesian numerical analysis , 2000 .

[8]  Mark A. Girolami,et al.  Bayesian Probabilistic Numerical Methods , 2017, SIAM Rev..

[9]  Piet Groeneboom,et al.  Rank tests for independence with best strong exact bahadur slope , 1976 .

[10]  D. Cox.  An Analysis of Bayesian Inference for Nonparametric Regression , 1993 .

[11]  Kenji Fukumizu,et al.  Convergence guarantees for kernel-based quadrature rules in misspecified settings , 2016, NIPS.

[12]  Fred J. Hickernell,et al.  Fast automatic Bayesian cubature using lattice sampling , 2018, Statistics and Computing.

[13]  P. Groeneboom.  Estimating a monotone density , 1984 .

[14]  Houman Owhadi,et al.  On the Brittleness of Bayesian Inference , 2013, SIAM Rev..

[15]  Geurt Jongbloed,et al.  A canonical process for estimation of convex functions: the "invelope" of integrated Brownian motion + t4. , 2001 .

[16]  Robert G. Aykroyd,et al.  Bayesian Probabilistic Numerical Methods in Time-Dependent State Estimation for Industrial Hydrocyclone Equipment , 2017, Journal of the American Statistical Association.

[17]  Mark A. Girolami,et al.  Bayesian Quadrature for Multiple Related Integrals , 2018, ICML.

[18]  Piet Groeneboom,et al.  Asymptotic Normality of Statistics Based on the Convex Minorants of Empirical Distribution Functions , 1983 .

[19]  G. Roberts,et al.  MCMC Methods for Functions: ModifyingOld Algorithms to Make Them Faster , 2012, 1202.0709.

[20]  Piet Groeneboom,et al.  Large Deviations of Goodness of Fit Statistics and Linear Combinations of Order Statistics , 1981 .

[21]  D. Freedman,et al.  On the consistency of Bayes estimates , 1986 .

[22]  Aad Van Der Vbart,et al.  ON DIFFERENTIABLE FUNCTIONALS , 1988 .

[23]  Klaus Ritter,et al.  Average-case analysis of numerical problems , 2000, Lecture notes in mathematics.

[24]  Michael A. Osborne,et al.  Probabilistic Integration: A Role in Statistical Computation? , 2015, Statistical Science.

[25]  M. Stein,et al.  Spatial sampling design for prediction with estimated parameters , 2006 .

[26]  A. W. van der Vaart,et al.  Adaptive Bayesian credible bands in regression with a Gaussian process prior , 2015, Sankhya A.

[27]  Simo Särkkä,et al.  Fully symmetric kernel quadrature , 2017, SIAM J. Sci. Comput..

[28]  W. J. Hall,et al.  Information and Asymptotic Efficiency in Parametric-Nonparametric Models , 1983 .

[29]  Piet Groeneboom,et al.  The Concave Majorant of Brownian Motion , 1983 .