Optimal adaptive sampling recovery

AbstractWe propose an approach to study optimal methods of adaptive sampling recovery of functions by sets of a finite capacity which is measured by their cardinality or pseudo-dimension. Let W ⊂ Lq , 0 < q ≤ ∞ , be a class of functions on ${{\mathbb I}}^d:= [0,1]^d$. For B a subset in Lq, we define a sampling recovery method with the free choice of sample points and recovering functions from B as follows. For each f ∈ W we choose n sample points. This choice defines n sampled values. Based on these sampled values, we choose a function from B for recovering f. The choice of n sample points and a recovering function from B for each f ∈ W defines a sampling recovery method $S_n^B$ by functions in B. An efficient sampling recovery method should be adaptive to f. Given a family ${\mathcal B}$ of subsets in Lq, we consider optimal methods of adaptive sampling recovery of functions in W by B from ${\mathcal B}$ in terms of the quantity $$ R_n(W, {\mathcal B})_q := \ \inf_{B \in {\mathcal B}}\, \sup_{f \in W} \, \inf_{S_n^B} \, \|f - S_n^B(f{\kern1pt})\|_q. $$Denote $R_n(W, {\mathcal B})_q$ by en(W)q if ${\mathcal B}$ is the family of all subsets B of Lq such that the cardinality of B does not exceed 2n, and by rn(W)q if ${\mathcal B}$ is the family of all subsets B in Lq of pseudo-dimension at most n. Let 0 < p,q , θ ≤ ∞ and α satisfy one of the following conditions: (i) α > d/p; (ii) α = d/p, θ ≤ min (1,q), p,q < ∞ . Then for the d-variable Besov class $U^\alpha_{p,\theta}$ (defined as the unit ball of the Besov space $B^\alpha_{p,\theta}$), there is the following asymptotic order $$ e_n\big(U^\alpha_{p,\theta}\big)_q \ \asymp \ r_n\big(U^\alpha_{p,\theta}\big)_q \ \asymp \ n^{- \alpha / d} . $$To construct asymptotically optimal adaptive sampling recovery methods for $e_n(U^\alpha_{p,\theta})_q$ and $r_n(U^\alpha_{p,\theta})_q$ we use a quasi-interpolant wavelet representation of functions in Besov spaces associated with some equivalent discrete quasi-norm.

[1]  M. Birman,et al.  PIECEWISE-POLYNOMIAL APPROXIMATIONS OF FUNCTIONS OF THE CLASSES $ W_{p}^{\alpha}$ , 1967 .

[2]  V. Vapnik,et al.  Necessary and Sufficient Conditions for the Uniform Convergence of Means to their Expectations , 1982 .

[3]  Vladimir N. Temlyakov,et al.  Nonlinear Methods of Approximation , 2003, Found. Comput. Math..

[4]  David Haussler,et al.  Sphere Packing Numbers for Subsets of the Boolean n-Cube with Bounded Vapnik-Chervonenkis Dimension , 1995, J. Comb. Theory, Ser. A.

[5]  Dinh Dung,et al.  Continuous Algorithms in n-Term Approximation and Non-Linear Widths , 2000 .

[6]  Joel Ratsaby,et al.  The Degree of Approximation of Sets in Euclidean Space Using Sets with Bounded Vapnik-Chervonenkis Dimension , 1998, Discret. Appl. Math..

[7]  S. Kudryavtsev The best accuracy of reconstruction of finitely smooth functions from their values at a given number of points , 1998 .

[8]  Charles K. Chui,et al.  An Introduction to Wavelets , 1992 .

[9]  Dinh Dung Asymptotic orders of optimal non-linear approximations , 2001 .

[10]  C. Chui,et al.  A natural formulation of quasi-interpolation by multivariate splines , 1987 .

[11]  Dinh Dung,et al.  Non-linear sampling recovery based on quasi-interpolant wavelet representations , 2009, Adv. Comput. Math..

[12]  R. DeVore,et al.  Interpolation of Besov-Spaces , 1988 .

[13]  D. Pollard Empirical Processes: Theory and Applications , 1990 .

[14]  Joel Ratsaby,et al.  On the Degree of Approximation by Manifolds of Finite Pseudo-Dimension , 1999 .

[15]  H. Triebel,et al.  Function Spaces in Lipschitz Domains and Optimal Rates of Convergence for Sampling , 2006 .

[16]  Dinh Dung,et al.  Non-linear Approximations Using Sets of Finite Cardinality or Finite Pseudo-dimension , 2001, J. Complex..

[17]  V. N. Temli︠a︡kov Approximation of periodic functions , 1993 .

[18]  E. Novak Deterministic and Stochastic Error Bounds in Numerical Analysis , 1988 .

[19]  David Haussler,et al.  Decision Theoretic Generalizations of the PAC Model for Neural Net and Other Learning Applications , 1992, Inf. Comput..

[20]  M. Nikolskii,et al.  Approximation of Functions of Several Variables and Embedding Theorems , 1971 .

[21]  C. D. Boor,et al.  Spline approximation by quasiinterpolants , 1973 .

[22]  A. Kolmogorov,et al.  Entropy and "-capacity of sets in func-tional spaces , 1961 .

[23]  O. V. Besov,et al.  Integral representations of functions and imbedding theorems , 1978 .