Consider the basic discrimination problem based on a sample of size n drawn from the distribution of (X, Y) on the Borel sets of Rdx {0, 1}. If 0 < R*. < ¿ is a given number, and ¿n ¿ 0 is an arbitrary positive sequence, then for any discrimination rule one can find a distribution for (X, Y), not depending upon n, with Bayes probability of error R* such that the probability of error (Rn) of the discrimination rule is larger than R* + ¿n for infinitely many n. We give a formal proof of this result, which is a generalization of a result by Cover [1]. Furthermore, sup all distributions of (X, Y) with R* = 0 Rn > ¿. Thus, any attempt to find a nontrivial distribution-free upper bound for Rn will fail, and any results on the rate of convergence of Rn to R* must use assumptions about the distribution of (X, Y).
[1]
C. J. Stone,et al.
Consistent Nonparametric Regression
,
1977
.
[2]
R. Olshen,et al.
Asymptotically Efficient Solutions to the Classification Problem
,
1978
.
[3]
L. Devroye,et al.
Distribution-Free Consistency Results in Nonparametric Discrimination and Regression Function Estimation
,
1980
.
[4]
C. Spiegelman,et al.
Consistent Window Estimation in Nonparametric Regression
,
1980
.
[5]
L. Devroye,et al.
Consistency of a recursive nearest neighbor regression function estimate
,
1980
.