On the Spectral Decomposition in Normal Discriminant Analysis

This article enlarges the covariance configurations, on which the classical linear discriminant analysis is based, by considering the four models arising from the spectral decomposition when eigenvalues and/or eigenvectors matrices are allowed to vary or not between groups. As in the classical approach, the assessment of these configurations is accomplished via a test on the training set. The discrimination rule is then built upon the configuration provided by the test, considering or not the unlabeled data. Numerical experiments, on simulated and real data, have been performed to evaluate the gain of our proposal with respect to the linear discriminant analysis.

[1]  B. Flury,et al.  Proportionality of k covariance matrices , 1986 .

[2]  G. Celeux,et al.  Regularized Gaussian Discriminant Analysis through Eigenvalue Decomposition , 1996 .

[3]  W. Gautschi,et al.  An algorithm for simultaneous orthogonal transformation of several positive definite symmetric matrices to nearly diagonal form , 1986 .

[4]  G. Constantine,et al.  The F‐G Diagonalization Algorithm , 1985 .

[5]  A. F. Smith,et al.  Statistical analysis of finite mixture distributions , 1986 .

[6]  Geoffrey J. McLachlan,et al.  Finite Mixture Models , 2019, Annual Review of Statistics and Its Application.

[7]  Geoffrey J. McLachlan,et al.  Mixture models : inference and applications to clustering , 1989 .

[8]  Gérard Govaert,et al.  Gaussian parsimonious clustering models , 1995, Pattern Recognit..

[9]  S. Dudoit,et al.  Multiple Testing Procedures with Applications to Genomics , 2007 .

[10]  Sean R Eddy,et al.  What is dynamic programming? , 2004, Nature Biotechnology.

[11]  G. McLachlan.  Discriminant Analysis and Statistical Pattern Recognition , 1992 .

[12]  J. Friedman.  Regularized Discriminant Analysis , 1989 .

[13]  Douglas M. Hawkins,et al.  A new test for multivariate normality and homoscedasticity , 1981 .

[14]  Brian D. Ripley,et al.  Pattern Recognition and Neural Networks , 1996 .

[15]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[16]  N. Campbell,et al.  A multivariate study of variation in two species of rock crab of the genus Leptograpsus , 1974 .

[17]  John C. W. Rayner,et al.  The comparison of sample covariance matrices using likelihood ratio tests , 1987 .

[18]  Fabio Gagliardi Cozman,et al.  Unlabeled Data Can Degrade Classification Performance of Generative Classifiers , 2002, FLAIRS.

[19]  Geoffrey J. McLachlan,et al.  Discriminant Analysis and Statistical Pattern Recognition: McLachlan/Discriminant Analysis & Pattern Recog , 2005 .

[20]  N. Dean,et al.  Using unlabelled data to update classification rules with applications in food authenticity studies , 2006 .

[21]  B. Flury.  Common Principal Components in k Groups , 1984 .

[22]  Salvatore Ingrassia,et al.  Assessing the pattern of covariance matrices via an augmentation multiple testing procedure , 2011, Stat. Methods Appl..

[23]  P. Deb.  Finite Mixture Models , 2008 .