An asymptotic approach to proving sufficiency of Stein characterisations

In extending Stein’s method to new target distributions, the first step is to find a Stein operator that suitably characterises the target distribution. In this paper, we introduce a widely applicable technique for proving sufficiency of these Stein characterisations, which can be applied when the Stein operators are linear differential operators with polynomial coefficients. The approach involves performing an asymptotic analysis to prove that only one characteristic function satisfies a certain differential equation associated to the Stein characterisation. We use this approach to prove that all Stein operators with linear coefficients characterise their target distribution, and verify on a case-by-case basis that all polynomial Stein operators in the literature with coefficients of degree at most two are characterising. For X denoting a standard Gaussian random variable and Hp the p-th Hermite polynomial, we also prove, amongst other examples, that the Stein operators for Hp(X), p = 3, 4, . . . , 8, with coefficients of minimal possible degree characterise their target distribution, and that the Stein operators for the products of p = 3, 4, . . . , 8 independent standard Gaussian random variables are characterising (in both settings the Stein operators for the cases p = 1, 2 are already known to be characterising). We leverage our Stein characterisations of H3(X) and H4(X) to derive characterisations of these target distributions in terms of iterated Gamma operators from Malliavin calculus, that are natural in the context of the Malliavin-Stein method.

[1]  Ronald F. Boisvert,et al.  NIST Handbook of Mathematical Functions , 2010 .

[2]  Christophe Ley,et al.  Characterizations of GIG laws: a survey complemented with two new results , 2013, 1312.7142.

[3]  A. Barbour Stein's method and poisson process convergence , 1988, Journal of Applied Probability.

[4]  R. Durrett Stochastic Calculus: A Practical Introduction , 1996 .

[5]  Louis H. Y. Chen Poisson Approximation for Dependent Trials , 1975 .

[6]  Nathan Ross,et al.  Degree asymptotics with rates for preferential attachment random graphs , 2011, 1108.5236.

[7]  A. Barbour Stein's method for diffusion approximations , 1990 .

[8]  J. Dai,et al.  Stein's method for steady-state diffusion approximations of $M/Ph/n+M$ systems , 2015 .

[9]  Adam J. Harper Two new proofs of the Erdös–Kac Theorem, with bound on the rate of convergence, by Stein's method for distributional approximations , 2009, Mathematical Proceedings of the Cambridge Philosophical Society.

[10]  S. Orszag,et al.  Advanced mathematical methods for scientists and engineers I: asymptotic methods and perturbation theory. , 1999 .

[11]  Stein characterizations for linear combinations of gamma random variables , 2017, 1709.01161.

[12]  Yvik Swan,et al.  Stein’s density approach and information inequalities , 2012, 1210.3921.

[13]  Gesine Reinert,et al.  Stein's Method for the Beta Distribution and the Pólya-Eggenberger Urn , 2013, J. Appl. Probab..

[14]  G. Peccati,et al.  Stein’s method on Wiener chaos , 2007, 0712.2940.

[15]  Robert E. Gaunt,et al.  Stein operators for product distributions , 2016 .

[16]  The Gamma Stein equation and noncentral de Jong theorems , 2016, Bernoulli.

[17]  C. Dobler Stein's method of exchangeable pairs for the Beta distribution and generalizations , 2014, 1411.4477.

[18]  Martin Raič,et al.  Normal Approximation by Stein ’ s Method , 2003 .

[19]  F. Götze On the Rate of Convergence in the Multivariate CLT , 1991 .

[20]  C. Stein A bound for the error in the normal approximation to the distribution of a sum of dependent random variables , 1972 .

[21]  Wim Schoutens,et al.  Orthogonal polynomials in Stein's method , 2001 .

[22]  G. Peccati,et al.  Normal Approximations with Malliavin Calculus: From Stein's Method to Universality , 2012 .

[23]  Robert E. Gaunt Stein operators for variables form the third and fourth Wiener chaoses , 2018, Statistics & Probability Letters.

[24]  P. Diaconis,et al.  Closed Form Summation for Classical Distributions: Variations on Theme of De Moivre , 1991 .

[25]  Robert E. Gaunt Variance-Gamma approximation via Stein's method , 2013, 1309.4422.

[26]  Jason Fulman,et al.  Exponential Approximation by Stein's Method and Spectral Graph Theory , 2006 .

[27]  John Pike,et al.  Stein's Method and the Laplace Distribution , 2012, 1210.5775.

[28]  Nathan Ross Fundamentals of Stein's method , 2011, 1109.1880.

[29]  Robert E. Gaunt Products of normal, beta and gamma random variables: Stein operators and distributional theory , 2015, 1507.07696.

[30]  Robert E. Gaunt,et al.  Some new Stein operators for product distributions , 2019, 1901.11460.

[31]  Jordan Stoyanov,et al.  Hamburger moment problem for powers and products of random variables , 2014 .

[32]  E. Peköz,et al.  New rates for exponential approximation and the theorems of Rényi and Yaglom , 2011, The Annals of Probability.

[33]  Robert E. Gaunt On Stein's method for products of normal random variables and zero bias couplings , 2013, 1309.4344.

[34]  Robert E. Gaunt,et al.  Chi-square approximation by Stein's method with application to Pearson's statistic , 2015, 1507.01707.

[35]  G. Peccati,et al.  Convergence Towards Linear Combinations of Chi-Squared Random Variables: A Malliavin-Based Approach , 2014, 1409.5551.

[36]  Eric V. Slud,et al.  The Moment Problem for Polynomial Forms in Normal Random Variables , 1993 .

[37]  P. Diaconis,et al.  Use of exchangeable pairs in the analysis of simulations , 2004 .

[38]  Gesine Reinert,et al.  Stein’s Method Meets Statistics: A Review of Some Recent Developments , 2021 .

[39]  Ron Goldman,et al.  Poisson approximation , 2000, Proceedings Geometric Modeling and Processing 2000. Theory and Applications.

[40]  G. Reinert,et al.  Stein's method for comparison of univariate distributions , 2014, 1408.2998.

[41]  G. Peccati QUANTITATIVE CLTS ON A GAUSSIAN SPACE: A SURVEY OF RECENT DEVELOPMENTS , 2014 .

[42]  Ivan Nourdin,et al.  Cumulants on the Wiener Space , 2009, 0910.1996.

[43]  Robert E. Gaunt New error bounds for Laplace approximation via Stein’s method , 2019, ESAIM: Probability and Statistics.