Discriminant analysis when the classes arise from a continuum

Abstract Sometimes two class linear discriminant analysis is applied to situations in which the classes are formed by partitioning an underlying continuum. In such cases, a reasonable assumption is that the underlying continuous “response” variable forms a joint multivariate normal distribution with the predictors. We compare the error rate of linear discriminant analysis with that of the optimal classification rule under these conditions, showing that linear discriminant analysis leads to a decision surface parallel to, but shifted from, the decision surface of the optimal rule and that the two rules can lead to very different error rates.

[1]  K. Subrahmaniam,et al.  Robustness of the linear discriminant function to nonnormality: Johnson's system , 1979 .

[2]  S. Chatterjee,et al.  Regression Analysis by Example , 1979 .

[3]  K. Kocherlakota,et al.  Errors of misclassification associated with the inverse gaussion distribution , 1986 .

[4]  Robert P. W. Duin The use of continuous variables for labeling objects , 1982, Pattern Recognit. Lett..

[5]  Robert P. W. Duin,et al.  Dealing with a priori knowledge by fuzzy labels , 1981, Pattern Recognit..

[6]  Narayanaswamy Balakrishnan,et al.  The Linear Discriminant Function: Sampling from the Truncated Normal Distribution , 1987 .

[7]  Robert R. Rawlings,et al.  A study on discriminant analysis techniques applied to multivariate lognormal data , 1986 .

[8]  Antonie Stam,et al.  FOUR APPROACHES TO THE CLASSIFICATION PROBLEM IN DISCRIMINANT ANALYSIS: AN EXPERIMENTAL STUDY* , 1988 .

[9]  Narayanaswamy Balakrishnan,et al.  Robustness to nonnormality of the linear discriminant function: mixtures of normal distributions , 1985 .

[10]  Karl Pearson,et al.  Mathematical contributions to the theory of evolution. VIII. On the correlation of characters not quantitatively measurable , 1900, Proceedings of the Royal Society of London.

[11]  Byron J. T. Morgan Analysis of Quantal Response Data , 1992 .

[12]  G. McLachlan Discriminant Analysis and Statistical Pattern Recognition , 1992 .

[13]  K. Subrahmaniam,et al.  Robustness of the linear discriminant function to nonnormality: Edgeworth series distribution , 1978 .

[14]  D. Bartholomew Latent Variable Models And Factor Analysis , 1987 .

[15]  P. C. Chang,et al.  Robustness of Fisher's Linear Discriminant Function under Two-Component Mixed Normal Models , 1981 .

[16]  Peter A. Lachenbruch,et al.  Robustness of the linear and quadratic discriminant function to certain types of non‐normality , 1973 .

[17]  D. Collett,et al.  Modelling Binary Data. , 1994 .

[18]  David J. Hand,et al.  Construction and Assessment of Classification Rules , 1997 .