Asymptotic analysis in multivariate average case approximation with Gaussian kernels

We consider tensor product random fields Yd, d ∈ N, whose covariance funtions are Gaussian kernels. The average case approximation complexity nYd(ε) is defined as the minimal number of evaluations of arbitrary linear functionals needed to approximate Yd, with relative 2-average error not exceeding a given threshold ε ∈ (0, 1). We investigate the growth of nYd(ε) for arbitrary fixed ε ∈ (0, 1) and d → ∞. Namely, we find criteria of boundedness for nYd(ε) on d and of tending nYd(ε) → ∞, d → ∞, for any fixed ε ∈ (0, 1). In the latter case we obtain necessary and sufficient conditions for the following logarithmic asymptotics lnnd(ε) = ad + q(ε)bd + o(bd), d → ∞, with any ε ∈ (0, 1). Here q : (0, 1) → R is a non-decreasing function, (ad)d∈N is a sequence and (bd)d∈N is a positive sequence such that bd → ∞, d → ∞. We show that only special quantiles of self-decomposable distribution functions appear as functions q in a given asymptotics.

[1]  E. Novak,et al.  Tractability of Multivariate Problems , 2008 .

[2]  Heping Wang,et al.  Average case tractability of multivariate approximation with Gaussian kernels , 2018, J. Approx. Theory.

[3]  Thomas de Quincey [C] , 2000, The Works of Thomas De Quincey, Vol. 1: Writings, 1799–1820.

[4]  Anthony Widjaja,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2003, IEEE Transactions on Neural Networks.

[5]  E. Novak,et al.  Tractability of Multivariate Problems, Volume III: Standard Information for Operators. , 2012 .

[6]  Henryk Wozniakowski,et al.  Average case tractability of non-homogeneous tensor product problems , 2011, J. Complex..

[7]  F. J. Hickernell,et al.  Average Case Approximation: Convergence and Tractability of Gaussian Kernels , 2012 .

[8]  Fred J. Hickernell,et al.  On Dimension-independent Rates of Convergence for Function Approximation with Gaussian Kernels , 2012, SIAM J. Numer. Anal..

[9]  Eric R. Ziegel,et al.  The Elements of Statistical Learning , 2003, Technometrics.

[10]  P. Alam,et al.  H , 1887, High Explosives, Propellants, Pyrotechnics.

[11]  Henryk Wozniakowski,et al.  Multivariate approximation for analytic functions with Gaussian kernels , 2018, J. Complex..

[12]  A. A. Khartov A simplified criterion for quasi-polynomial tractability of approximation of random elements and its applications , 2016, J. Complex..

[13]  Grzegorz W. Wasilkowski,et al.  Average case optimal algorithms in Hilbert spaces , 1986 .

[14]  V. V. Petrov Limit Theorems of Probability Theory: Sequences of Independent Random Variables , 1995 .

[15]  Martin D. Buhmann,et al.  Radial Basis Functions: Theory and Implementations: Preface , 2003 .

[16]  Jr. J. L. Brown Mean Square Truncation Error in Series Expansions of Random Functions , 1960 .

[17]  B. Gnedenko,et al.  Limit Distributions for Sums of Independent Random Variables , 1955 .

[18]  Alexey A. Khartov,et al.  Asymptotic analysis of average case approximation complexity of Hilbert space valued random elements , 2014, J. Complex..

[19]  Christopher K. I. Williams,et al.  Gaussian regression and optimal finite dimensional linear models , 1997 .

[20]  Alexander I. Nazarov,et al.  Small ball probabilities for Gaussian random fields and tensor products of compact operators , 2008 .

[21]  D. Hensley,et al.  The convolution powers of the Dickman function , 1986 .

[22]  B. Makarov,et al.  Selected Problems in Real Analysis , 1992 .

[23]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[24]  M. Urner Scattered Data Approximation , 2016 .

[25]  Klaus Ritter,et al.  Average-case analysis of numerical problems , 2000, Lecture notes in mathematics.