Greedy regularized kernel interpolation.

Kernel based regularized interpolation is a well known technique to approximate a continuous multivariate function using a set of scattered data points and the corresponding function evaluations, or data values. This method has some advantage over exact interpolation: one can obtain the same approximation order while solving a better conditioned linear system. This method is well suited also for noisy data values, where exact interpolation is not meaningful. Moreover, it allows more flexibility in the kernel choice, since approximation problems can be solved also for non strictly positive definite kernels. We discuss in this paper a greedy algorithm to compute a sparse approximation of the kernel regularized interpolant. This sparsity is a desirable property when the approximant is used as a surrogate of an expensive function, since the resulting model is fast to evaluate. Moreover, we derive convergence results for the approximation scheme, and we prove that a certain greedy selection rule produces asymptotically quasi-optimal error rates.

[1]  B. Haasdonk,et al.  Interpolation with uncoupled separable matrix-valued kernels. , 2018, 1807.09111.

[2]  Bernard Haasdonk,et al.  Numerical modelling of a peripheral arterial stenosis using dimensionally reduced models and kernel methods , 2018, International journal for numerical methods in biomedical engineering.

[3]  Dirk Pflüger,et al.  Comparison of data-driven uncertainty quantification methods for a carbon dioxide storage benchmark scenario , 2018, Computational Geosciences.

[4]  Armin Iske,et al.  Improved estimates for condition numbers of radial basis function interpolation matrices , 2017, J. Approx. Theory.

[5]  Bernard Haasdonk,et al.  Convergence rate of the data-independent P-greedy algorithm in kernel-based approximation , 2016, 1612.02672.

[6]  Ronald DeVore,et al.  Greedy Algorithms for Reduced Bases in Banach Spaces , 2012, Constructive Approximation.

[7]  Robert Schaback,et al.  Bases for kernel-based spaces , 2011, J. Comput. Appl. Math..

[8]  Robert Schaback,et al.  Stability of kernel-based interpolation , 2010, Adv. Comput. Math..

[9]  Robert Schaback,et al.  A Newton basis for Kernel spaces , 2009, J. Approx. Theory.

[10]  Andreas Christmann,et al.  Support vector machines , 2008, Data Mining and Knowledge Discovery Handbook.

[11]  Holger Wendland,et al.  Near-optimal data-independent point locations for radial basis function interpolation , 2005, Adv. Comput. Math..

[12]  Holger Wendland,et al.  Approximate Interpolation with Applications to Selecting Smoothing Parameters , 2005, Numerische Mathematik.

[13]  Bernhard Schölkopf,et al.  A Generalized Representer Theorem , 2001, COLT/EuroCOLT.

[14]  Holger Wendland,et al.  Adaptive greedy techniques for approximate solution of large RBF systems , 2000, Numerical Algorithms.

[15]  G. Wahba Support vector machines, reproducing kernel Hilbert spaces, and randomized GACV , 1999 .

[16]  Holger Wendland,et al.  Piecewise polynomial, positive definite and compactly supported radial functions of minimal degree , 1995, Adv. Comput. Math..

[17]  Robert Schaback,et al.  Error estimates and condition numbers for radial basis function interpolation , 1995, Adv. Comput. Math..

[18]  N. Aronszajn Theory of Reproducing Kernels. , 1950 .

[19]  M. Urner Scattered Data Approximation , 2016 .

[20]  Bernard Haasdonk,et al.  Surrogate modeling of multiscale models using kernel methods , 2015 .

[21]  Piecewise Polynomial , 2014, Computer Vision, A Reference Guide.

[22]  Bernard Haasdonk,et al.  A Vectorial Kernel Orthogonal Greedy Algorithm , 2013 .

[23]  Christian Rieger,et al.  F ¨ Ur Mathematik in Den Naturwissenschaften Leipzig Sampling Inequalities for Infinitely Smooth Functions, with Applications to Interpolation and Machine Learning Sampling Inequalities for Infinitely Smooth Functions, with Applications to Interpolation and Machine Learning , 2022 .

[24]  Robert Schaback,et al.  Stability constants for kernel-based interpolation processes , 2008 .

[25]  Charles A. Micchelli,et al.  On Learning Vector-Valued Functions , 2005, Neural Computation.