Parameterized discriminant analysis for image classification

Linear and nonlinear (i.e., kernel) discriminant analysis have been proposed to address the difficulties of the small sample problem, the curse of dimensionality, and the multi-modality of image data distribution in content-based image retrieval (CBIR). The existing discriminant analysis is implemented either in a regular way, such as MDA (multiple discriminant analysis), or in a biased way, such as biased discriminant analysis (BDA). A rich set of parameterized discriminant analysis is proposed as an alternative to the regular MDA and BDA when taking regularization into account to avoid the singularity of the scatter matrices. Extensive experiments are carried out for performance evaluation and the results show the superior performance of the parameterized discriminant analysis over regular MDA and BDA for both linear and nonlinear settings.

[1]  Lei Wang,et al.  Bootstrapping SVM active learning by incorporating unlabelled images for image retrieval , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[2]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Lior Wolf,et al.  Kernel principal angles for classification machines with applications to image sequence interpretation , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[4]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory, Second Edition , 2000, Statistics for Engineering and Information Science.

[5]  J. Friedman Regularized Discriminant Analysis , 1989 .

[6]  Qi Tian,et al.  Discriminant-EM algorithm with application to image retrieval , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[7]  David G. Stork,et al.  Pattern classification, 2nd Edition , 2000 .

[8]  Bernhard Schölkopf,et al.  Learning with kernels , 2001 .

[9]  Thomas S. Huang,et al.  Small sample learning during multimedia retrieval using BiasMap , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[10]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.