Small sample size generalization

The generalization of linear classifiers is considered for training sample sizes smaller than the feature size. It is shown that there exists a good linear classifier, that is better than the Nearest Mean classifier for sample sizes for which Fisher’s linear discriminant cannot be used. The use and performance of this small sample size classifier is illustrated by some examples.