A New Quadratic Classifier Applied to Biometric Recognition

In biometric recognition applications, the number of training examples per class is limited and consequently the conventional quadratic classifier either performs poorly or cannot be calculated. Other non-conventional quadratic classifiers have been used in limited sample and high dimensional classification problems. In this paper, a new quadratic classifier called Maximum Entropy Covariance Selection (MECS) is presented. This classifier combines the sample group covariance matrices and the pooled covariance matrix under the principle of maximum entropy. This approach is a direct method that not only deals with the singularity and instability of the maximum likelihood covariance estimator, but also does not require an optimisation procedure. In order to evaluate the MECS effectiveness, experiments on face and fingerprint recognition were carried out and compared with other similar classifiers, including the Reguralized Discriminant Analysis (RDA), the Leave-One-Out Covariance estimator (LOOC) and the Simplified Quadratic Discriminant Function (SQDF). In both applications, using the publicly released databases FERET and NIST-4, the MECS classifier achieved the lowest classification error.

[1]  Craig I. Watson,et al.  Massively Parallel Neural Network Fingerprint Classification System | NIST , 1992 .

[2]  David A. Landgrebe,et al.  Covariance Matrix Estimation and Classification With Limited Training Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Kohji Fukunaga,et al.  Introduction to Statistical Pattern Recognition-Second Edition , 1990 .

[4]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[5]  Duncan Fyfe Gillies,et al.  Small Sample Problem in Bayes Plug-in Classifier for Image Recognition , 2001 .

[6]  J. Friedman Regularized Discriminant Analysis , 1989 .

[7]  Shinichiro Omachi,et al.  A New Approximation Method of the Quadratic Discriminant Function , 2000, SSPR/SPR.

[8]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[9]  David A. Landgrebe,et al.  Covariance estimation with limited training samples , 1999, IEEE Trans. Geosci. Remote. Sens..

[10]  Keinosuke Fukunaga,et al.  Introduction to statistical pattern recognition (2nd ed.) , 1990 .

[11]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[12]  E. Jaynes On the rationale of maximum-entropy methods , 1982, Proceedings of the IEEE.

[13]  Anil K. Jain,et al.  39 Dimensionality and sample size considerations in pattern recognition practice , 1982, Classification, Pattern Recognition and Reduction of Dimensionality.

[14]  Harry Wechsler,et al.  The FERET database and evaluation procedure for face-recognition algorithms , 1998, Image Vis. Comput..