Some Extensions of an Inequality of Vapnik and Chervonenkis

The inequality of Vapnik and Chervonenkis controls the expectation of the function  by its sample average uniformly over a VC-major class of functions taking into account the size of the expectation. Using Talagrand's kernel method we prove a similar result for the classes of functions for which Dudley's uniform entropy integral or bracketing entropy integral is finite.

[1]  D. Panchenko.  A Note on Talagrand's Concentration Inequality , 2001 .

[2]  A. W. van der Vaart,et al.  Uniform Central Limit Theorems , 2001 .

[3]  E. Rio,et al.  Inégalités de concentration pour les processus empiriques de classes de parties , 2001 .

[4]  M. Kohler.  Inequalities for uniform deviations of averages from expectations with applications to nonparametric regression , 2000 .

[5]  S. Boucheron,et al.  A sharp concentration inequality with applications , 1999, Random Struct. Algorithms.

[6]  Inégalités exponentielles pour les processus empiriques , 2000 .

[7]  P. Massart,et al.  About the constants in Talagrand's concentration inequalities for empirical processes , 2000 .

[8]  Yi Li,et al.  Improved bounds on the sample complexity of learning , 2000, SODA '00.

[9]  S. Boucheron,et al.  A sharp concentration inequality with applications , 1999, Random Struct. Algorithms.

[10]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[11]  A. Dembo.  Information inequalities and concentration of measure , 1997 .

[12]  M. Ledoux.  On Talagrand's deviation inequalities for product measures , 1997 .

[13]  M. Talagrand.  New concentration inequalities in product spaces , 1996 .

[14]  Jon A. Wellner,et al.  Weak Convergence and Empirical Processes: With Applications to Statistics , 1996 .

[15]  David Haussler,et al.  Sphere Packing Numbers for Subsets of the Boolean n-Cube with Bounded Vapnik-Chervonenkis Dimension , 1995, J. Comb. Theory, Ser. A.

[16]  M. Talagrand.  Concentration of measure and isoperimetric inequalities in product spaces , 1994, math/9406212.

[17]  Vladimir Vapnik,et al.  Chervonenkis: On the uniform convergence of relative frequencies of events to their probabilities , 1971 .

[18]  Shun-ichi Amari,et al.  A Theory of Pattern Recognition , 1968 .