Reproducing kernels of generalized Sobolev spaces via a Green function approach with distributional operators

In this paper we introduce a generalized Sobolev space by defining a semi-inner product formulated in terms of a vector distributional operator P consisting of finitely or countably many distributional operators Pn, which are defined on the dual space of the Schwartz space. The types of operators we consider include not only differential operators, but also more general distributional operators such as pseudo-differential operators. We deduce that a certain appropriate full-space Green function G with respect to L := P*TP now becomes a conditionally positive function. In order to support this claim we ensure that the distributional adjoint operator P* of P is well-defined in the distributional sense. Under sufficient conditions, the native space (reproducing-kernel Hilbert space) associated with the Green function G can be embedded into or even be equivalent to a generalized Sobolev space. As an application, we take linear combinations of translates of the Green function with possibly added polynomial terms and construct a multivariate minimum-norm interpolant sf,X to data values sampled from an unknown generalized Sobolev function f at data sites located in some set $${X \subset \mathbb{R}^d}$$. We provide several examples, such as Matérn kernels or Gaussian kernels, that illustrate how many reproducing-kernel Hilbert spaces of well-known reproducing kernels are equivalent to a generalized Sobolev space. These examples further illustrate how we can rescale the Sobolev spaces by the vector distributional operator P. Introducing the notion of scale as part of the definition of a generalized Sobolev space may help us to choose the “best” kernel function for kernel-based approximation methods.

[1]  Qi Ye Reproducing Kernels of Generalized Sobolev Spaces via a Green Function Approach with Differential Operators , 2011, 1109.0109.

[2]  Alan L. Yuille,et al.  The Motion Coherence Theory , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[3]  Grace Wahba,et al.  Spline Models for Observational Data , 1990 .

[4]  A. Bouhamidi Pseudo-differential operator associated to the radial basis functions under tension. , 2007 .

[5]  L. Hörmander The analysis of linear partial differential operators , 1990 .

[6]  Martin D. Buhmann,et al.  Radial Basis Functions: Theory and Implementations: Preface , 2003 .

[7]  Roger Woodard,et al.  Interpolation of Spatial Data: Some Theory for Kriging , 1999, Technometrics.

[8]  John K. Hunter,et al.  Applied Analysis , 2001 .

[9]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[10]  A. Bouhamidi,et al.  Radial basis functions under tension , 2004, J. Approx. Theory.

[11]  Will Light,et al.  Spaces of distributions, interpolation by translates of a basis function and error estimates , 1999, Numerische Mathematik.

[12]  E. Stein,et al.  Introduction to Fourier Analysis on Euclidean Spaces. , 1971 .

[13]  W. Marsden I and J , 2012 .

[14]  D. Schweikert An Interpolation Curve Using a Spline in Tension , 1966 .

[15]  Jean Duchon,et al.  Splines minimizing rotation-invariant semi-norms in Sobolev spaces , 1976, Constructive Theory of Functions of Several Variables.

[16]  Amos Ron,et al.  Approximation using scattered shifts of a multivariate function , 2008, 0802.2517.

[17]  M. Unser,et al.  Generalized Sampling: A Variational Approach , 2001 .

[18]  Thierry Blu,et al.  Generalized sampling: a variational approach .I. Theory , 2002, IEEE Trans. Signal Process..

[19]  Gregory E. Fasshauer,et al.  Meshfree Approximation Methods with Matlab , 2007, Interdisciplinary Mathematical Sciences.

[20]  Qi Ye,et al.  Reproducing kernels of Sobolev spaces via a green kernel approach with differential operators and boundary operators , 2011, Adv. Comput. Math..

[21]  Bernhard Schölkopf,et al.  The connection between regularization operators and support vector kernels , 1998, Neural Networks.

[22]  Robert J. Renka,et al.  Interpolatory tension splines with automatic selection of tension factors , 1987 .

[23]  W. Madych,et al.  Multivariate interpolation and condi-tionally positive definite functions , 1988 .

[24]  L. Hörmander Analysis of Linear Partial Differential Operators II , 2005 .

[25]  Holger Wendland,et al.  Scattered Data Approximation: Conditionally positive definite functions , 2004 .

[26]  A. Berlinet,et al.  Reproducing kernel Hilbert spaces in probability and statistics , 2004 .

[27]  Alexander J. Smola,et al.  Learning with Kernels: support vector machines, regularization, optimization, and beyond , 2001, Adaptive computation and machine learning series.

[28]  Holger Wendland,et al.  Kernel techniques: From machine learning to meshless methods , 2006, Acta Numerica.

[29]  Michael L. Stein,et al.  Interpolation of spatial data , 1999 .