A Memory Based Face Recognition Method

The human brain exhibits robustness against natural variability occurring in face images, yet the commonly attempted algorithms for face recognition are not modular and do not apply the principle of binary decisions made by the firing of neurons. This thesis presents a memory based face recognition method based on the concepts of local binary decisions and spatial change features. Local binary decisions are inspired from the binary conversions done by firing of neurons while spatial change features are inspired from the retinal processing of the human visual system. Applying these principles and by using the principle of modularity in a hierarchical manner, a class of memory based face recognition algorithms is formed. These algorithms when applied to difficult testing conditions show high recognition performance. This high recognition performance is enabled by (1) local binary decisions and (2) spatial change detection. The baseline algorithm formed by using these two concepts is called local binary decisions on similarity (LBDS) algorithm. An analysis is performed using the LBDS algorithm to optimize the parameters, and to study the relative effect of spatial change features, local binary decisions, normalization of features, normalization of similarity measure, use of color, localization error compensation and resolution on recognition performance. From the insights gained through the analysis, the LBDS algorithm is further improved by incorporating various preprocessing spatial filter operations to extract more spatial information. The inclusion of preprocessing step helps to achieve even higher recognition performance and robustness to difficult tasks. This improved algorithm is called enhanced local binary decisions on similarity (ELBDS) algorithm. The ELBDS algorithm is further used to incorporate the multiple training images per person in the gallery, and is called an exemplar based face recognition method. The following is the overall recognition performance when using single gallery image per person: 97% on AR, 100% on YALE, 97% on EYALE , 97% on CALTECH, 98% on FERET(FaFb), 94% on FERET(FaFc), 74% on FERET (FaDup1) and 76% on FERET(FaDup2). When using multiple training samples per person, following recognition accuracies are achieved, 99.0% on AR, 99.5% on FERET, 99.5% on ORL, 99.3% on EYALE, 100.0% on YALE and 100.0% on CALTECH face databases.

[1]  Ming-Hsuan Yang,et al.  Extended isomap for pattern classification , 2002, AAAI/IAAI.

[2]  Wen Gao,et al.  Local Gabor binary pattern histogram sequence (LGBPHS): a novel non-statistical model for face representation and recognition , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[3]  M. Haith,et al.  Eye contact and face scanning in early infancy. , 1978, Science.

[4]  Johan Stephen Simeon Ballot.  Face recognition using Hidden Markov Models , 2005 .

[5]  David J. Kriegman,et al.  From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Shimon Edelman,et al.  Receptive field spaces and class-based generalization from a single view in face recognition , 1995 .

[7]  Rudolf Hanka,et al.  An interpretation of Mahalanobis distance in the dual space , 1982, Pattern Recognit..

[8]  Shigeki Yokoi,et al.  On Generalized Distance Transformation of Digitized Pictures , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  David J. Kriegman,et al.  Acquiring linear subspaces for face recognition under variable lighting , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Jianxin Wu,et al.  Face recognition with one training image per person , 2002, Pattern Recognit. Lett..

[11]  Wen Gao,et al.  Efficient 3D reconstruction for face recognition , 2005, Pattern Recognit..

[12]  Gregory Ashby,et al.  Toward a Unified Theory of Similarity and Recognition , 1988 .

[13]  T. Poggio.  Vision by man and machine. , 1984, Scientific American.

[14]  I. Craw,et al.  Effects of high-pass and low-pass spatial filtering on face identification , 1996, Perception & psychophysics.

[15]  W. Torgerson.  Multidimensional scaling: I. Theory and method , 1952 .

[16]  P. S. Hiremath,et al.  Face Recognition Using Symbolic KPCA Plus Symbolic LDA in the Framework of Symbolic Data Analysis: Symbolic Kernel Fisher Discriminant Method , 2008, ACIVS.

[17]  Wei-Ying Ma,et al.  Learning similarity measure for natural image retrieval with relevance feedback , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[18]  RussLL L. Ds Vnlos,et al.  SPATIAL FREQUENCY SELECTIVITY OF CELLS IN MACAQUE VISUAL CORTEX , 2022 .

[19]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[20]  R E Hampson,et al.  Ensemble Activity and Behavior—What's the Code? , 1995, Science.

[21]  D. Ruderman.  The statistics of natural images , 1994 .

[22]  B. Draper,et al.  The CSU Face Identification Evaluation System User ’ s Guide : Version 4 . 0 , 2002 .

[23]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[24]  H. Ellis,et al.  Face recognition accuracy as a function of mode of representation. , 1978 .

[25]  Daoqiang Zhang,et al.  A new face recognition method based on SVD perturbation for single example image per person , 2005, Appl. Math. Comput..

[26]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[27]  Michael I. Jordan,et al.  Distance Metric Learning with Application to Clustering with Side-Information , 2002, NIPS.

[28]  I. Fraser,et al.  Reaction Time Measures of Feature Saliency in Schematic Faces , 1990, Perception.

[29]  Rama Chellappa,et al.  Face Verification Across Age Progression , 2006, IEEE Transactions on Image Processing.

[30]  Aapo Hyvärinen,et al.  Emergence of Phase- and Shift-Invariant Features by Decomposition of Natural Images into Independent Feature Subspaces , 2000, Neural Computation.

[31]  L. D. Harmon.  The recognition of faces. , 1973, Scientific American.

[32]  R. Chellappa,et al.  Subspace Linear Discriminant Analysis for Face Recognition , 1999 .

[33]  Stefano Soatto,et al.  A Study of Face Recognition as People Age , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[34]  Hongzhou Zhang,et al.  2D Gaborface representation method for face recognition with ensemble and multichannel model , 2008, Image Vis. Comput..

[35]  A. M. Burton,et al.  100% Accuracy in Automatic Face Recognition , 2008, Science.

[36]  C. G. Hilborn,et al.  The Condensed Nearest Neighbor Rule , 1967 .

[37]  Ronen Basri,et al.  Comparing images under variable illumination , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[38]  Aleix M. Martinez,et al.  The AR face database , 1998 .

[39]  Aleix M. Martínez,et al.  Recognizing Imprecisely Localized, Partially Occluded, and Expression Variant Faces from a Single Sample per Class , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[40]  P. Danielsson.  Euclidean distance mapping , 1980 .

[41]  Shimon Ullman,et al.  Face Recognition: The Problem of Compensating for Changes in Illumination Direction , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[42]  Hiroshi Murase,et al.  Visual learning and recognition of 3-d objects from appearance , 2005, International Journal of Computer Vision.

[43]  D. Hubel,et al.  Receptive fields of single neurones in the cat's striate cortex , 1959, The Journal of physiology.

[44]  Zhi-Hua Zhou,et al.  Making FLDA applicable to face recognition with one sample per person , 2004, Pattern Recognit..

[45]  Hsun K. Liu,et al.  Two and three dimensional boundary detection , 1977 .

[46]  H. Ellis,et al.  Cue Saliency in Faces as Assessed by the ‘Photofit’ Technique , 1977, Perception.

[47]  Rama Chellappa,et al.  Discriminant Analysis for Recognition of Human Face Images (Invited Paper) , 1997, AVBPA.

[48]  Norbert Krüger,et al.  Face recognition by elastic bunch graph matching , 1997, Proceedings of International Conference on Image Processing.

[49]  Atsushi Imiya,et al.  Detection of spatial points and lines by random sampling and voting procedure , 2001, Pattern Recognit. Lett..

[50]  Joachim M. Buhmann,et al.  Distortion Invariant Object Recognition in the Dynamic Link Architecture , 1993, IEEE Trans. Computers.

[51]  Harry Wechsler,et al.  The FERET database and evaluation procedure for face-recognition algorithms , 1998, Image Vis. Comput..

[52]  Hanan Samet,et al.  Distance Transform for Images Represented by Quadtrees , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[53]  O. Umino,et al.  Spatio‐temporal receptive fields in carp retinal horizontal cells , 1998, The Journal of physiology.

[54]  Zhi-Hua Zhou,et al.  Recognizing partially occluded, expression variant faces from single training image per person with SOM and soft k-NN ensemble , 2005, IEEE Transactions on Neural Networks.

[55]  J. Kruskal.  Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis , 1964 .

[56]  Yrjö Neuvo,et al.  Robust edge detector based on morphological filters , 1993, Pattern Recognit. Lett..

[57]  W. Geuen,et al.  A Fast Edge Detection Algorithm Matching Visual Contour Perception , 1983 .

[58]  David W. Jacobs,et al.  In search of illumination invariants , 2001, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[59]  David Beymer,et al.  Face recognition from one example view , 1995, Proceedings of IEEE International Conference on Computer Vision.

[60]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[61]  J. Chang,et al.  Analysis of individual differences in multidimensional scaling via an n-way generalization of “Eckart-Young” decomposition , 1970 .

[62]  Zhi-Hua Zhou,et al.  Single Image Subspace for Face Recognition , 2007, AMFG.

[63]  J. Robson,et al.  Application of fourier analysis to the visibility of gratings , 1968, The Journal of physiology.

[64]  M MartínezAleix.  Recognizing Imprecisely Localized, Partially Occluded, and Expression Variant Faces from a Single Sample per Class , 2002 .

[65]  V. Kshirsagar,et al.  Face recognition using Eigenfaces , 2011, 2011 3rd International Conference on Computer Research and Development.

[66]  R. Shepard,et al.  Toward a universal law of generalization for psychological science. , 1987, Science.

[67]  Zhi-Hua Zhou,et al.  Face recognition from a single image per person: A survey , 2006, Pattern Recognit..

[68]  Hyeonjoon Moon,et al.  The FERET evaluation methodology for face-recognition algorithms , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[69]  H. Ellis,et al.  Identification of Familiar and Unfamiliar Faces from Internal and External Features: Some Implications for Theories of Face Recognition , 1979, Perception.

[70]  Emilio L. Zapata,et al.  Planar Object Detection under Scaled Orthographic Projection , 2000, DGCI.

[71]  Adrian E. Raftery,et al.  Accurate and efficient curve detection in images: the importance sampling Hough transform , 2002, Pattern Recognit..

[72]  Rachel A Robbins,et al.  Can holistic processing be learned for inverted faces? , 2003, Cognition.

[73]  Terrence J. Sejnowski,et al.  The “independent components” of natural scenes are edge filters , 1997, Vision Research.

[74]  Mark A. Georgeson,et al.  Edge-finding in human vision: a multi-stage model based on the perceived structure of plaids , 1998, Image Vis. Comput..

[75]  Forrest W. Young,et al.  Nonmetric individual differences multidimensional scaling: An alternating least squares method with optimal scaling features , 1977 .

[76]  Bruce A. Draper,et al.  The CSU Face Identification Evaluation System: Its Purpose, Features, and Structure , 2003, ICVS.

[77]  Noël Bonnet,et al.  An unsupervised generalized Hough transform for natural shapes , 2002, Pattern Recognit..

[78]  Pawan Sinha,et al.  Face Recognition by Humans: Nineteen Results All Computer Vision Researchers Should Know About , 2006, Proceedings of the IEEE.

[79]  Roberto Brunelli,et al.  Face Recognition: Features Versus Templates , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[80]  H. K. Nishihara,et al.  CARTOON: A Biologically Motivated Edge Detection Algorithm , 1982 .

[81]  A. Yuille,et al.  Two- and Three-Dimensional Patterns of the Face , 2001 .

[82]  G. Gates.  The Reduced Nearest Neighbor Rule , 1998 .

[83]  D. J. Bartliff.  An automatic procedure for image segmentation , 1983, Pattern Recognit. Lett..

[84]  A. Young,et al.  Configural information in facial expression perception. , 2000, Journal of experimental psychology. Human perception and performance.

[85]  A. ROSENFELD,et al.  Distance functions on digital pictures , 1968, Pattern Recognit..

[86]  Vytautas Perlibakas,et al.  Distance measures for PCA-based face recognition , 2004, Pattern Recognit. Lett..

[87]  Yajie Tian,et al.  Handbook of face recognition , 2003 .

[88]  A. Tversky.  Features of Similarity , 1977 .

[89]  Marian Stewart Bartlett,et al.  Face recognition by independent component analysis , 2002, IEEE Trans. Neural Networks.

[90]  Aleix M. Martinez.  Matching expression variant faces , 2003, Vision Research.

[91]  Shimon Ullman,et al.  Limitations of Non Model-Based Recognition Schemes , 1992, ECCV.

[92]  M Abeles,et al.  Synchronization in neuronal transmission and its importance for information processing. , 1994, Progress in brain research.

[93]  Harry Wechsler,et al.  Reliable Face Recognition Methods , 2007 .

[94]  Margot J. Taylor,et al.  Face Recognition Memory and Configural Processing: A Developmental ERP Study using Upright, Inverted, and Contrast-Reversed Faces , 2004, Journal of Cognitive Neuroscience.

[95]  Doris Y. Tsao,et al.  Patches with Links: A Unified System for Processing Faces in the Macaque Temporal Lobe , 2008, Science.

[96]  V. Bruce,et al.  The importance of ‘mass’ in line drawings of faces , 1992 .

[97]  Paul Miller,et al.  Verification of face identities from images captured on video. , 1999 .

[98]  Refractor.  Vision , 2000, The Lancet.

[99]  Peter de Souza,et al.  Edge detection using sliding statistical tests , 1983, Comput. Vis. Graph. Image Process..

[100]  Ivan Kadar,et al.  A class of three-dimensional recursive parallelepiped masks , 1979 .

[101]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[102]  I Biederman,et al.  Neurocomputational bases of object and face recognition. , 1997, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[103]  Thomas M. Cover,et al.  Estimation by the nearest neighbor rule , 1968, IEEE Trans. Inf. Theory.

[104]  Rahul Sukthankar,et al.  Memory-based face recognition for visitor identification , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[105]  R. Shepard.  The analysis of proximities: Multidimensional scaling with an unknown distance function. I. , 1962 .

[106]  V. Bruce,et al.  Face Recognition in Poor-Quality Video: Evidence From Security Surveillance , 1999 .

[107]  Thomas Vetter,et al.  Face Recognition Based on Fitting a 3D Morphable Model , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[108]  Guido Bugmann,et al.  Summation and multiplication: two distinct operation domains of leaky integrate-and-fire neurons , 1991 .

[109]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[110]  Jun Liu,et al.  Discriminant common vectors versus neighbourhood components analysis and Laplacianfaces: A comparative study in small sample size problem , 2006, Image Vis. Comput..

[111]  Ah Chung Tsoi,et al.  Face recognition: a convolutional neural-network approach , 1997, IEEE Trans. Neural Networks.

[112]  Thomas Vetter,et al.  Synthesis of Novel Views from a Single Face Image , 1998, International Journal of Computer Vision.

[113]  Scott T. Acton,et al.  Watershed pyramids for edge detection , 1997, Proceedings of International Conference on Image Processing.

[114]  Rama Chellappa,et al.  Modeling Age Progression in Young Faces , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[115]  S L Macknik,et al.  The role of spatiotemporal edges in visibility and visual masking. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[116]  Y. Petrov,et al.  Local correlations, information redundancy, and sufficient pixel depth in natural images. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[117]  Rama Chellappa,et al.  Face Processing: Advanced Modeling and Methods , 2006, J. Electronic Imaging.

[118]  B. K. Julsing,et al.  Face Recognition with Local Binary Patterns , 2012 .

[119]  Timothy F. Cootes,et al.  Face Recognition Using Active Appearance Models , 1998, ECCV.