Evolutionary Pursuit and Its Application to Face Recognition

Introduces evolutionary pursuit (EP) as an adaptive representation method for image encoding and classification. In analogy to projection pursuit, EP seeks to learn an optimal basis for the dual purpose of data compression and pattern classification. It should increase the generalization ability of the learning machine as a result of seeking the trade-off between minimizing the empirical risk encountered during training and narrowing the confidence interval for reducing the guaranteed risk during testing. It therefore implements strategies characteristic of GA for searching the space of possible solutions to determine the optimal basis. It projects the original data into a lower dimensional whitened principal component analysis (PCA) space. Directed random rotations of the basis vectors in this space are searched by GA where evolution is driven by a fitness function defined by performance accuracy (empirical risk) and class separation (confidence interval). Accuracy indicates the extent to which learning has been successful, while separation gives an indication of expected fitness. The method has been tested on face recognition using a greedy search algorithm. To assess both accuracy and generalization capability, the data includes for each subject images acquired at different times or under different illumination conditions. EP has better recognition performance than PCA (eigenfaces) and better generalization abilities than the Fisher linear discriminant (Fisherfaces).

[1]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[2]  Aapo Hyvärinen,et al.  A Fast Fixed-Point Algorithm for Independent Component Analysis , 1997, Neural Computation.

[3]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[4]  Juyang Weng,et al.  Using Discriminant Eigenfeatures for Image Retrieval , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[6]  Tony F. Chan,et al.  An Improved Algorithm for Computing the Singular Value Decomposition , 1982, TOMS.

[7]  D. Chakrabarti,et al.  A fast fixed - point algorithm for independent component analysis , 1997 .

[8]  Pierre Comon Independent component analysis - a new concept? signal processing , 1994 .

[9]  P. Jonathon Phillips Matching pursuit filters applied to face identification , 1998, IEEE Trans. Image Process..

[10]  A. N. Tikhonov,et al.  Solutions of ill-posed problems , 1977 .

[11]  Chengjun Liu,et al.  Face recognition using shape and texture , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[12]  R. Fisher THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[13]  Lawrence Sirovich,et al.  Application of the Karhunen-Loeve Procedure for the Characterization of Human Faces , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Timothy F. Cootes,et al.  Active Appearance Models , 1998, ECCV.

[15]  D. Donoho,et al.  Basis pursuit , 1994, Proceedings of 1994 28th Asilomar Conference on Signals, Systems and Computers.

[16]  Harry Wechsler,et al.  The FERET database and evaluation procedure for face-recognition algorithms , 1998, Image Vis. Comput..

[17]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[18]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[19]  H. B. Barlow,et al.  Unsupervised Learning , 1989, Neural Computation.

[20]  D. Stuss,et al.  Cognitive neuroscience. , 1993, Current opinion in neurobiology.

[21]  Ralph Linsker,et al.  Self-organization in a perceptual network , 1988, Computer.

[22]  Federico Girosi,et al.  An Equivalence Between Sparse Approximation and Support Vector Machines , 1998, Neural Computation.

[23]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[24]  Robin Sibson,et al.  What is projection pursuit , 1987 .

[25]  Roberto Brunelli,et al.  Face Recognition: Features Versus Templates , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Chengjun Liu,et al.  Probabilistic reasoning models for face recognition , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[27]  Tomaso A. Poggio,et al.  A Sparse Representation for Function Approximation , 1998, Neural Computation.

[28]  Chengjun Liu,et al.  Enhanced Fisher linear discriminant models for face recognition , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[29]  Chengjun Liu,et al.  Robust coding schemes for indexing and retrieval from large face databases , 2000, IEEE Trans. Image Process..

[30]  Erkki Oja,et al.  A class of neural networks for independent component analysis , 1997, IEEE Trans. Neural Networks.

[31]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[32]  J. Friedman,et al.  Projection Pursuit Regression , 1981 .

[33]  Rama Chellappa,et al.  Human and machine recognition of faces: a survey , 1995, Proc. IEEE.

[34]  Keinosuke Fukunaga,et al.  Introduction to statistical pattern recognition (2nd ed.) , 1990 .

[35]  K. Etemad,et al.  Discriminant analysis for recognition of human face images , 1997 .

[36]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[37]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[38]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[39]  E. Oja,et al.  Independent Component Analysis , 2013 .

[40]  H. Wechsler,et al.  Comparative Assessment of Independent Component Analysis (ICA) for Face Recognition , 1999 .

[41]  Ashok Samal,et al.  Automatic recognition and analysis of human faces and facial expressions: a survey , 1992, Pattern Recognit..

[42]  Tomaso Poggio,et al.  Computational vision and regularization theory , 1985, Nature.

[43]  D. Ruderman The statistics of natural images , 1994 .

[44]  M. V. Rossum,et al.  In Neural Computation , 2022 .

[45]  T. Poggio,et al.  I think I know that face... , 1996, Nature.

[46]  Chengjun Liu,et al.  Face Recognition Using Evolutionary Pursuit , 1998, ECCV.

[47]  Penio S. Penev,et al.  Local feature analysis: A general statistical theory for object representation , 1996 .

[48]  John Daugman,et al.  An information-theoretic view of analog representation in striate cortex , 1993 .