Incremental face recognition using rehearsal and recall processes

Most of the machine learning algorithms particularly suffer from the plasticity-stability dilemma. In this paper, we propose a model that adopts two types of memories i.e. short-term memory (STM) and long-term memory (LTM), which share their information through control processes called rehearsal and recall to alleviate the dilemma. In addition, the proposed model tries to integrate the advantages of generative and discriminative classifiers by employing them in STM and LTM respectively. Experimental results show the importance of rehearsal and recall process in improving the performance of the algorithm.

[1]  Miroslaw Bober,et al.  Implementation of Face Recognition Processing Using an Embedded Processor , 2005, J. Robotics Mechatronics.

[2]  Richard L. Lewis,et al.  The mind and brain of short-term memory. , 2008, Annual review of psychology.

[3]  Stephen Grossberg,et al.  Competitive Learning: From Interactive Activation to Adaptive Resonance , 1987, Cogn. Sci..

[4]  Stephen Grossberg,et al.  Nonlinear neural networks: Principles, mechanisms, and architectures , 1988, Neural Networks.

[5]  Larry L. Jacoby,et al.  Rehearsal and transfer to LTM , 1972 .

[6]  Robert M. French,et al.  Pseudo-recurrent Connectionist Networks: An Approach to the 'Sensitivity-Stability' Dilemma , 1997, Connect. Sci..

[7]  Brian C. Lovell,et al.  Combining Generative and Discriminative Learning for Face Recognition , 2005, Digital Image Computing: Techniques and Applications (DICTA'05).

[8]  Minho Lee,et al.  Incremental two-dimensional two-directional principal component analysis (I(2D)2PCA) for face recognition , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[9]  Rhee Man Kil,et al.  Uncertainty Measure for Selective Sampling Based on Class Probability Output Networks , 2011, ICONIP.

[10]  Daoqiang Zhang,et al.  (2D)2PCA: Two-directional two-dimensional PCA for efficient face representation and recognition , 2005, Neurocomputing.

[11]  Aleix M. Martinez,et al.  The AR face database , 1998 .

[12]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[13]  H. Akaike,et al.  Information Theory and an Extension of the Maximum Likelihood Principle , 1973 .

[14]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[15]  R. Kil,et al.  Model Selection for Regression with Continuous Kernel Functions Using the Modulus of Continuity , 2008 .

[16]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[17]  Anders P. Eriksson,et al.  Is face recognition really a Compressive Sensing problem? , 2011, CVPR 2011.

[18]  Kiyomi Nakamura,et al.  Face recognition evaluation of an association cortex - entorhinal cortex hippocampal formation model by successive learning , 2001, SICE 2001. Proceedings of the 40th SICE Annual Conference. International Session Papers (IEEE Cat. No.01TH8603).

[19]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  A. Martínez,et al.  The AR face databasae , 1998 .

[21]  Richard C. Atkinson,et al.  Human Memory: A Proposed System and its Control Processes , 1968, Psychology of Learning and Motivation.

[22]  A. Baddeley,et al.  Amnesia and the distinction between long- and short-term memory. , 1970 .

[23]  Alex Pentland,et al.  Face recognition using eigenfaces , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[24]  Anthony V. Robins,et al.  Consolidation in Neural Networks and in the Sleeping Brain , 1996, Connect. Sci..

[25]  Song Ying,et al.  Face recognition based on multi-class SVM , 2009, 2009 Chinese Control and Decision Conference.

[26]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[27]  Haitao Zhao,et al.  A novel incremental principal component analysis and its application for face recognition , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[28]  Kunihiko Fukushima,et al.  Neocognitron trained with winner-kill-loser rule , 2010, Neural Networks.

[29]  Anthony V. Robins,et al.  Catastrophic Forgetting, Rehearsal and Pseudorehearsal , 1995, Connect. Sci..

[30]  Ilkay Ulusoy,et al.  Generative versus discriminative methods for object recognition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[31]  Shigeo Abe,et al.  Incremental learning of feature space and classifier for face recognition , 2005, Neural Networks.