New perspectives in face correlation research: a tutorial

In recent years, correlation-filter (CF)-based face recognition algorithms have attracted increasing interest in the field of pattern recognition and have achieved impressive results in discrimination, efficiency, location accuracy, and robustness. In this tutorial paper, our goal is to help the reader get a broad overview of CFs in three respects: design, implementation, and application. We review typical face recognition algorithms with implications for the design of CFs. We discuss and compare the numerical and optical implementations of correlators. Some newly proposed implementation schemes and application examples are also presented to verify the feasibility and effectiveness of CFs as a powerful recognition tool.

[1]  A. Alfalou,et al.  Robust and discriminating method for face recognition based on correlation technique and independent component analysis model. , 2011, Optics letters.

[2]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[3]  P. Réfrégier.  Filter design for optical pattern recognition: multicriteria optimization approach. , 1990, Optics letters.

[4]  A Mahalanobis,et al.  Optimal trade-off synthetic discriminant function filters for arbitrary devices. , 1994, Optics letters.

[5]  Bhagavatula Vijaya Kumar,et al.  Analysis of signal-to-noise ratio of polynomial correlation filters , 1999, Defense, Security, and Sensing.

[6]  M S Alam,et al.  Decision optimization for face recognition based on an alternate correlation plane quantification metric. , 2012, Optics letters.

[7]  Mohammad S. Alam,et al.  Smart pattern recognition , 2013, Defense, Security, and Sensing.

[8]  D Casasent,et al.  Multivariant technique for multiclass pattern recognition. , 1980, Applied optics.

[9]  David J. Fleet,et al.  Robust Online Appearance Models for Visual Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  A. B. Vander Lugt,et al.  Signal detection by complex spatial filtering , 1964, IEEE Trans. Inf. Theory.

[11]  Martin D. Levine,et al.  Face recognition subject to variations in facial expression, illumination and pose using correlation filters , 2006, Comput. Vis. Image Underst..

[12]  B. Kumar,et al.  Performance measures for correlation filters. , 1990, Applied optics.

[13]  Bhagavatula Vijaya Kumar,et al.  Eigen-extended maximum average correlation height (EEMACH) filters for automatic target recognition , 2001 .

[14]  Di Wu,et al.  Fast frame scanning camera system for light-sheet microscopy. , 2015, Applied optics.

[15]  David Mendlovic,et al.  Shift and scale invariant pattern recognition using Mellin radial harmonics , 1988 .

[16]  Abhijit Mahalanobis,et al.  Comparative study of maximum average correlation height filter variants using ladar imagery , 2003 .

[17]  B. V. K. Vijaya Kumar,et al.  Kernel Correlation Filter Based Redundant Class-Dependence Feature Analysis (KCFA) on FRGC2.0 Data , 2005, AMFG.

[18]  Abhijit Mahalanobis,et al.  Biometric verification with correlation filters. , 2004, Applied optics.

[19]  Mohamed I. Alkanhal,et al.  Polynomial distance classifier correlation filter for pattern recognition. , 2003, Applied optics.

[20]  Mita Nasipuri,et al.  Automated thermal face recognition based on minutiae extraction , 2013, Int. J. Comput. Intell. Stud..

[21]  B. V. Vijaya Kumar,et al.  Minimum-variance synthetic discriminant functions , 1986 .

[22]  H H Arsenault,et al.  Optical pattern recognition using circular harmonic expansion. , 1982, Applied optics.

[23]  D. O. North,et al.  An Analysis of the factors which determine signal/noise discrimination in pulsed-carrier systems , 1963 .

[24]  Ming-Hsuan Yang,et al.  Incremental Learning for Robust Visual Tracking , 2008, International Journal of Computer Vision.

[25]  Danny Roberge,et al.  Optical composite wavelet-matched filters , 1994 .

[26]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[27]  Simone Calderara,et al.  Visual Tracking: An Experimental Survey , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  A. Alfalou,et al.  Optimized pre-processing input plane GPU implementation of an optical face recognition technique using a segmented phase only composite filter , 2013 .

[29]  Ayman Alfalou,et al.  Optimized swimmer tracking system by a dynamic fusion of correlation and color histogram techniques , 2015 .

[30]  Yu-Jin Zhang,et al.  Tensor correlation filter based class-dependence feature analysis for face recognition , 2008, Neurocomputing.

[31]  Demetri Psaltis,et al.  Optical-Image Correlation With A Binary Spatial Light-Modulator , 1984 .

[32]  L Sirovich,et al.  Low-dimensional procedure for the characterization of human faces. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[33]  Bingbing Ni,et al.  When Correlation Filters Meet Convolutional Neural Networks for Visual Tracking , 2016, IEEE Signal Processing Letters.

[34]  Olga Korotkova,et al.  Two spatial light modulator system for laboratory simulation of random beam propagation in random media. , 2016, Applied optics.

[35]  Ayman Alfalou,et al.  Fuzzy logic and optical correlation-based face recognition method for patient monitoring application in home video surveillance , 2011 .

[36]  Toyohiko Yatagai,et al.  Adaptive binary joint transform correlator for image recognition. , 2002, Applied optics.

[37]  Xin Li,et al.  Constrained quadratic correlation filters for target detection. , 2004, Applied optics.

[38]  Abhijit Mahalanobis,et al.  Distance classifier correlation filters for distortion tolerance, discrimination, and clutter rejection , 1993, Optics & Photonics.

[39]  J. Horner,et al.  Phase-only matched filtering. , 1984, Applied optics.

[40]  Kashiko Kodate,et al.  Implementation of a high-speed face recognition system that uses an optical parallel correlator. , 2005, Applied optics.

[41]  Heydi Mendez Vazquez,et al.  Illumination Invariant Face Recognition Using Quaternion-Based Correlation Filters , 2012, Journal of Mathematical Imaging and Vision.

[42]  Thomas Vetter,et al.  Face Recognition Based on Fitting a 3D Morphable Model , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[43]  Naveen K Nishchal,et al.  Wavelet-modified maximum average correlation height filter for rotation invariance that uses chirp encoding in a hybrid digital-optical correlator. , 2006, Applied optics.

[44]  Harold H. Szu,et al.  Local ICA for the Most Wanted face recognition , 2000, SPIE Defense + Commercial Sensing.

[45]  B. V. K. Vijaya Kumar,et al.  Improving the false alarm capabilities of the maximum average correlation height correlation filter , 2000 .

[46]  Rui Caseiro,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence High-speed Tracking with Kernelized Correlation Filters , 2022 .

[47]  A Katz,et al.  Joint transform correlator that uses wavelet transforms. , 1992, Optics letters.

[48]  B. V. K. Vijaya Kumar,et al.  Face authentication for multiple subjects using eigenflow , 2003, Pattern Recognit..

[49]  A. Mahalanobis,et al.  Design and application of quadratic correlation filters for target detection , 2004, IEEE Transactions on Aerospace and Electronic Systems.

[50]  Tien-Hsin Chao,et al.  Optimization of OT-MACH filter generation for target recognition , 2009, Defense + Commercial Sensing.

[51]  J. Goodman,et al.  A technique for optically convolving two functions. , 1966, Applied optics.

[52]  Saeed Mozaffari,et al.  Face verification using local binary pattern-unconstrained minimum average correlation energy correlation filters. , 2012, Journal of the Optical Society of America. A, Optics, image science, and vision.

[53]  Harry Wechsler,et al.  Reliable face recognition using adaptive and robust correlation filters , 2008, Comput. Vis. Image Underst..

[54]  B. V. K. Vijaya Kumar,et al.  Zero-Aliasing Correlation Filters for Object Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[55]  P. Sarda,et al.  Functional linear model , 1999 .

[56]  D. Casasent,et al.  Minimum average correlation energy filters. , 1987, Applied optics.

[57]  David Casasent,et al.  Illumination invariant face recognition and impostor rejection using different MINACE filter algorithms , 2005, SPIE Defense + Commercial Sensing.

[58]  Mohammad S. Alam,et al.  Adaptive nonlinear fringe-adjusted joint transform correlator , 2012 .

[59]  Qu Wang,et al.  Morphological fringe-adjusted joint transform correlation , 2006 .

[60]  M A Karim,et al.  Fringe-adjusted joint transform correlation. , 1993, Applied optics.

[61]  B. V. K. Vijaya Kumar,et al.  Illumination Normalization Using Logarithm Transforms for Face Authentication , 2003, AVBPA.

[62]  Patrick J. Flynn,et al.  A survey of approaches and challenges in 3D and multi-modal 3D + 2D face recognition , 2006, Comput. Vis. Image Underst..

[63]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[64]  B. V. Vijaya Kumar,et al.  Unconstrained correlation filters. , 1994, Applied optics.

[65]  Weifeng Liu,et al.  The correntropy MACE filter , 2009, Pattern Recognit..

[66]  Marios Savvides,et al.  Illumination-tolerant face verification of low-bit-rate JPEG2000 wavelet images with advanced correlation filters for handheld devices. , 2005, Applied optics.

[67]  P Refregier.  Optimal trade-off filters for noise robustness, sharpness of the correlation peak, and Horner efficiency. , 1991, Optics letters.

[68]  R. Juday.  Optimal realizable filters and the minimum Euclidean distance principle. , 1993, Applied optics.

[69]  J L de Bougrenet de la Tocnaye,et al.  Optical implementation of segmented composite filtering. , 1999, Applied optics.

[70]  Yousri Ouerhani,et al.  Road sign recognition using Viapix module and correlation , 2015, Defense + Security Symposium.

[71]  D. Casasent,et al.  Minimum noise and correlation energy optical correlation filter. , 1992, Applied optics.

[72]  B. V. Kumar,et al.  Minimum squared error synthetic discriminant functions , 1992 .

[73]  B V Kumar,et al.  Tutorial survey of composite filter designs for optical correlators. , 1992, Applied optics.

[74]  B. V. K. Vijaya Kumar,et al.  Maximum Margin Correlation Filter: A New Approach for Localization and Classification , 2013, IEEE Transactions on Image Processing.