Improving pose manifold and virtual images using bidirectional neural networks in face recognition using single image per person

In this article, for the purpose of improving neural network models applied in face recognition using single image per person, a bidirectional neural network inspired of neocortex functional model is presented. In the proposed model, recognition is not performed in a single stage, but via two bottom-up and top-down phases and the recognition results of first stage is used for model adaptation. We have applied this novel adapting model in combination with clustering person and pose information technique to separate person and pose information and to estimate corresponding manifolds. To increase the number of training samples in the classifier neural network, virtual views of frontal images in the test dataset are synthesized using estimated manifolds. Training classifier network via virtual images obtained from bidirectional network, gives an accuracy rate of 86.36% on the test dataset which shows 15.46% improvement in accuracy of face recognition compared to training classifier with only frontal view images.

[1]  Sun-Yuan Kung,et al.  Face recognition/detection by probabilistic decision-based neural network , 1997, IEEE Trans. Neural Networks.

[2]  Seyyed Ali Seyyedsalehi,et al.  Nonlinear normalization of input patterns to speaker variability in speech recognition neural networks , 2009, Neural Computing and Applications.

[3]  Yongsheng Gao,et al.  Face recognition across pose: A review , 2009, Pattern Recognit..

[4]  M. Mesulam,et al.  From sensation to cognition. , 1998, Brain : a journal of neurology.

[5]  Seyyed Ali Seyyed Salehi,et al.  Modeling phones coarticulation effects in a neural network based speech recognition system , 2004, INTERSPEECH.

[6]  Hiroshi Tsujino,et al.  A Cortical-type Modular Neural Network for Hypothetical Reasoning , 1997, Neural Networks.

[7]  T. J. Stonham,et al.  Practical Face Recognition and Verification with Wisard , 1986 .

[8]  Ah Chung Tsoi,et al.  Face recognition: a convolutional neural-network approach , 1997, IEEE Trans. Neural Networks.

[9]  E. Korner,et al.  Cortical architecture and self-referential control for brain-like computation , 2002, IEEE Engineering in Medicine and Biology Magazine.

[10]  Simon Prince,et al.  Face Pose Estimation in Uncontrolled Environments , 2009, BMVC.

[11]  Seyyed Ali Seyyedsalehi,et al.  Improving face recognition from a single image per person via virtual images produced by imagination using neural networks , 2011 .

[12]  Yoshua Bengio,et al.  Bias learning, knowledge sharing , 2003, IEEE Trans. Neural Networks.

[13]  Marc-Oliver Gewaltig,et al.  A model of computation in neocortical architecture , 1999, Neural Networks.