Structured Covariance Matrices for Statistical Image Object Recognition

In this paper we present different approaches to structuring covariance matrices within Statistical classifiers. This is motivated by the fact that the use of full covariance matrices is infeasible in many applications. On the one hand, this is due to the high number of model Parameters that have to be estimated, on the other hand the computational complexity of a classifier based on full covariance matrices is very high. We propose the use of diagonal and band-matrices to replace full covariance matrices and we also show that computation of tangent distance is equivalent to using a structured covariance matrix within a Statistical classifier.

[1]  David G. Stork,et al.  Pattern Classiication and Scene Analysis 2nd Ed. Part 1: Pattern Classiication , 1999 .

[2]  Robert M. Gray,et al.  An Algorithm for Vector Quantizer Design , 1980, IEEE Trans. Commun..

[3]  Stan Z. Li,et al.  Markov Random Field Modeling in Computer Vision , 1995, Computer Science Workbench.

[4]  Hermann Ney,et al.  A Probabilistic View on Tangent Distance , 2000, DAGM-Symposium.

[5]  Hermann Ney,et al.  Experiments with an extended tangent distance , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[6]  Yann LeCun,et al.  Efficient Pattern Recognition Using a New Transformation Distance , 1992, NIPS.

[7]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[8]  Hermann Ney,et al.  Discriminative Training of Gaussian Mixtures for Image Object Recognition , 1999, DAGM-Symposium.

[9]  Jörg Dahmen,et al.  Invariant image object recognition using Gaussian mixture densities , 2001 .

[10]  Hermann Ney,et al.  A Mixture Density Based Approach to Object Recognition for Image Retrieval , 2000, RIAO.

[11]  William H. Press,et al.  Numerical recipes in C , 2002 .

[12]  Bernhard Schölkopf,et al.  Support vector learning , 1997 .

[13]  Bernhard Schölkopf,et al.  Prior Knowledge in Support Vector Kernels , 1997, NIPS.

[14]  László Györfi,et al.  A Probabilistic Theory of Pattern Recognition , 1996, Stochastic Modelling and Applied Probability.

[15]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .