Generalization Error of Randomized Linear Zero Empirical Error Classifier: Simple Asymptotics for Centered Data Case

An estimation of the generalization performance of classifier is one of most important problems in pattern clasification and neural network training theory. In this paper we estimate the generalization error (mean expected probability of classification) for randomized linear zero empirical error (RLZEE) classifier which was considered by Raudys, Diciūnas and Basalykas. Instead of “non-explicit” asymptotics of a generalization error of RLZEE classifier for centered multivariate spherically Gaussian classes proposed by Basalykas et al. (1996) we obtain an “explicit” and more simple asymptotics. We also present the numerical simulations illustrating our theoretical results and comparing them with each other and previously obtained results.

[1]  S. John.  Errors in Discrimination , 1961 .

[2]  Sariinas Raudys,et al.  ON SHAPE OF PATTERN ERROR FUNCTION, INITIALIZATIONS AND INTRINSIC DIMENSIONALITY IN ANN CLASSIFIER DESIGN , 1993 .

[3]  Sarunas Raudys,et al.  Expected error of minimum empirical error and maximal margin classifiers , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[4]  M. Okamoto.  An Asymptotic Expansion for the Distribution of the Linear Discriminant Function , 1963 .

[5]  Ron Meir.  Empirical Risk Minimization versus Maximum-Likelihood Estimation: A Case Study , 1995, Neural Computation.

[6]  Shun-ichi Amari,et al.  Four Types of Learning Curves , 1992, Neural Computation.

[7]  Shun-ichi Amari,et al.  A universal theorem on learning curves , 1993, Neural Networks.

[8]  Sarunas Raudys,et al.  On Dimensionality, Sample Size, Classification Error, and Complexity of Classification Algorithm in Pattern Recognition , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Alfredas Basalykas,et al.  The expected probability of misclassification of linear zero empirical error classifier , 1996 .

[10]  F. J. Wyman,et al.  A comparison of asymptotic error rate expansions for the sample linear discriminant function , 1990, Pattern Recognit..

[11]  Sarunas Raudys,et al.  On Dimensionality, Sample Size, and Classification Error of Nonparametric Linear Classification Algorithms , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Valdas Diciunas.  Generalization Error of Randomized Linear Zero Empirical Error Classifier: Non-Centered Data Case , 2001, Informatica.