Enhancing the correntropy MACE filter with random projections

The minimum average correlation energy (MACE) filter is a well known correlation filter for object recognition. Recently, a nonlinear extension to the MACE filter using the correntropy function in feature space has been introduced. Correntropy is a positive definite function that generalizes the concept of correlation by utilizing higher order moment information of signal structure. Since the MACE is a spatial matched filter for an image class, the correntropy MACE (CMACE) can potentially improve its performance. Both the MACE and CMACE are basically memory-based algorithms and due to the high dimensionality of the image data, the computational cost of the CMACE filter is one of the critical issues in practical applications. We propose to use a dimensionality reduction method based on random projections (RP), which has emerged as a powerful method for dimensionality reduction in machine learning. We apply the CMACE filter with random projection (CMACE-RP) to face recognition and show that it indeed outperforms the traditional linear MACE in both generalization and rejection abilities with small degradation in performance, but great savings in storage and computational complexity.

[1]  P. P. Pokharel,et al.  Correntropy Based Matched Filtering , 2005, 2005 IEEE Workshop on Machine Learning for Signal Processing.

[2]  Jose C. Principe,et al.  Recent advances to nonlinear minimum average correlation energy filters , 1997 .

[3]  José Carlos Príncipe,et al.  The Fast Correntropy Mace Filter , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[4]  Dmitriy Fradkin,et al.  Experiments with random projections for machine learning , 2003, KDD '03.

[5]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[6]  Weifeng Liu,et al.  The correntropy MACE filter , 2009, Pattern Recognit..

[7]  J. Príncipe,et al.  The Correntropy Mace Filter for Image Recognition , 2006, 2006 16th IEEE Signal Processing Society Workshop on Machine Learning for Signal Processing.

[8]  Marios Savvides,et al.  Correlation Pattern Recognition for Face Recognition , 2006, Proceedings of the IEEE.

[9]  Heikki Mannila,et al.  Random projection in dimensionality reduction: applications to image and text data , 2001, KDD '01.

[10]  B. Silverman.  Density estimation for statistics and data analysis , 1986 .

[11]  Gene H. Golub,et al.  Matrix computations , 1983 .

[12]  José Carlos Príncipe,et al.  Kernel Based Synthetic Discriminant Function for Object Recognition , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[13]  Keinosuke Fukunaga,et al.  Introduction to statistical pattern recognition (2nd ed.) , 1990 .

[14]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[15]  G. Turin,et al.  An introduction to matched filters , 1960, IRE Trans. Inf. Theory.

[16]  Bernhard Schölkopf,et al.  Learning with kernels , 2001 .

[17]  Dimitris Achlioptas,et al.  Database-friendly random projections , 2001, PODS.

[18]  George Bebis,et al.  Face recognition experiments with random projection , 2005, SPIE Defense + Commercial Sensing.

[19]  Deniz Erdogmus,et al.  Recursive Principal Components Analysis Using Eigenvector Matrix Perturbation , 2004, Proceedings of the 2004 14th IEEE Signal Processing Society Workshop Machine Learning for Signal Processing, 2004..

[20]  Dimitris Achlioptas,et al.  Database-friendly random projections: Johnson-Lindenstrauss with binary coins , 2003, J. Comput. Syst. Sci..

[21]  Deniz Erdogmus,et al.  A Closed Form Solution for a Nonlinear Wiener Filter , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[22]  Sanjoy Dasgupta,et al.  Experiments with Random Projection , 2000, UAI.

[23]  D. Casasent,et al.  Minimum average correlation energy filters. , 1987, Applied optics.

[24]  David G. Stork,et al.  Pattern Classification , 1973 .

[25]  Weifeng Liu,et al.  Correntropy: A Localized Similarity Measure , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[26]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[27]  D Casasent,et al.  Multivariant technique for multiclass pattern recognition. , 1980, Applied optics.

[28]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[29]  Abhijit Mahalanobis,et al.  Biometric verification with correlation filters. , 2004, Applied optics.

[30]  B. V. K. Vijaya Kumar,et al.  Correlation Pattern Recognition , 2002 .

[31]  Henrik Boström,et al.  Reducing High-Dimensional Data by Principal Component Analysis vs. Random Projection for Nearest Neighbor Classification , 2006, 2006 5th International Conference on Machine Learning and Applications (ICMLA'06).

[32]  Paul Wintz,et al.  Digital image processing (2nd ed.) , 1987 .

[33]  B. V. Vijaya Kumar,et al.  Minimum-variance synthetic discriminant functions , 1986 .

[34]  José Carlos Príncipe,et al.  Generalized correlation function: definition, properties, and application to blind equalization , 2006, IEEE Transactions on Signal Processing.

[35]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[36]  Weifeng Liu,et al.  Correntropy: Properties and Applications in Non-Gaussian Signal Processing , 2007, IEEE Transactions on Signal Processing.

[37]  B V Kumar,et al.  Tutorial survey of composite filter designs for optical correlators. , 1992, Applied optics.

[38]  A. B. Vanderlugt.  SIGNAL DETECTION BY COMPLEX SPATIAL FILTERING , 1963 .