Incremental Eigenanalysis for Classification

Eigenspace models are a convenient way to represent sets of observations with widespread applications, including classification. In this paper we describe a new constructive method for incrementally adding observations to an eigenspace model. Our contribution is to explicitly account for a change in origin as well as a change in the number of eigenvectors needed in the basis set. No other method we have seen considers change of origin, yet both are needed if an eigenspace model is to be used for classification purposes. We empirically compare our incremental method with two alternatives from the literature and show our method is the more useful for classification because it computes the smaller eigenspace model representing the observations.

[1]  J. Bunch,et al.  Updating the singular value decomposition , 1978 .

[2]  J. Bunch,et al.  Rank-one modification of the symmetric eigenproblem , 1978 .

[3]  B. V. K. Vijaya Kumar,et al.  Efficient Calculation of Primary Images from a Set of Images , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  L Sirovich,et al.  Low-dimensional procedure for the characterization of human faces. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[5]  Ronald D. Degroat,et al.  Efficient, Numerically Stabilized Rank-One Eigenstructure Up.dating , 1990 .

[6]  R. D. DeGroat,et al.  Efficient, numerically stabilized rank-one eigenstructure updating [signal processing] , 1990, IEEE Trans. Acoust. Speech Signal Process..

[7]  David Casasent,et al.  Karhunen-Loeve techniques for optimal processing of time sequential imagery , 1991 .

[8]  Timothy F. Cootes,et al.  Training Models of Shape from Sets of Examples , 1992, BMVC.

[9]  Subhasis Chaudhuri,et al.  Recursive Estimation of Motion Parameters , 1996, Comput. Vis. Image Underst..

[10]  Alex Pentland,et al.  Probabilistic Visual Learning for Object Representation , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  B. S. Manjunath,et al.  An Eigenspace Update Algorithm for Image Analysis , 1997, CVGIP Graph. Model. Image Process..