Developmental Network: An Internal Emergent Object Feature Learning

Face recognition has great theory research and application value. It is a very complicated problem which often suffers from variations in lighting condition, facial expression, head pose, glasses, background, and so on. This paper realizes an effective recognition for 108 face images of 27 individuals in complex background, through a biological inspired emergent developmental network (DN). To decrease the influence of complex background on the recognition of the foreground object, another biological inspired mechanism—synapse maintenance, which can dynamically determine which synapse should be removed, weaken or strengthened, is introduced to enhance the image recognition rate. To prevent the quick decay of the learning rate with the increasement of the neuron age, simulating the learning principle of the human brain, a new learning rate is proposed to determine the neuron learning process. Moreover, to exploit the network resource efficiently, neuron regenesis mechanism is designed to regulate the neuron resource dynamically. First, we design two kinds of neuron states to depict the neuron action, then, simulating the work mechanism of the human brain to produce new neurons continuously to learn new knowledge, we design the neuron regenesis mechanism to activate the suppressed old neurons in the developmental network to regenerate and learn new feature, thus to enhance the network usage efficiency. In order to demonstrate the effect of DN on face recognition, we compare and analyze the performances of DN with/without synapse maintenance mechanism, with the neuron regenesis mechanism. Experiment results in semi-constrained dataset and unconstrained dataset illustrate that DN with the synapse maintenance and neuron regenesis mechanism can effectively improve the face recognition rate in complex background. Further, comparing the performance of DN with some state-of-the-art algorithms, experimental results demonstrate the superior performance of the proposed method.

[1]  James Philbin,et al.  FaceNet: A unified embedding for face recognition and clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Juyang Weng,et al.  Synapse maintenance in the Where-What Networks , 2011, The 2011 International Joint Conference on Neural Networks.

[3]  J. Mazloum,et al.  A novel bidirectional neural network for face recognition , 2012, 2012 2nd International eConference on Computer and Knowledge Engineering (ICCKE).

[4]  K. Mehta,et al.  Face Recognition Using PCA and LDA Algorithm , 2012, 2012 Second International Conference on Advanced Computing & Communication Technologies.

[5]  Dacheng Tao,et al.  Multi-Task Pose-Invariant Face Recognition , 2015, IEEE Transactions on Image Processing.

[6]  Shih-Fu Chang,et al.  A highly efficient system for automatic face region detection in MPEG video , 1997, IEEE Trans. Circuits Syst. Video Technol..

[7]  Marian Stewart Bartlett,et al.  Face recognition by independent component analysis , 2002, IEEE Trans. Neural Networks.

[8]  Zihan Zhou,et al.  Towards a practical face recognition system: Robust registration and illumination by sparse representation , 2009, CVPR.

[9]  Dacheng Tao,et al.  Packing Convolutional Neural Networks in the Frequency Domain , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Dacheng Tao,et al.  Biologically Inspired Feature Manifold for Scene Classification , 2010, IEEE Transactions on Image Processing.

[11]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[12]  Anil K. Jain,et al.  Face Search at Scale: 80 Million Gallery , 2015, ArXiv.

[13]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Jun Wang,et al.  A Bayesian Hashing approach and its application to face recognition , 2016, Neurocomputing.

[15]  Anil K. Jain,et al.  Pushing the frontiers of unconstrained face detection and recognition: IARPA Janus Benchmark A , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Binbin Pan,et al.  Supervised kernel nonnegative matrix factorization for face recognition , 2016, Neurocomputing.

[18]  Wei Liu,et al.  Fast Structural Binary Coding , 2016, IJCAI.

[19]  Tao Zhang,et al.  A real-time face detection and recognition system for a mobile robot in a complex background , 2010, Artificial Life and Robotics.

[20]  Ashok Samal,et al.  Automatic recognition and analysis of human faces and facial expressions: a survey , 1992, Pattern Recognit..

[21]  Dongshu Wang,et al.  Natural Language Acquisition: State Inferring and Thinking , 2016, Int. J. Artif. Intell. Tools.

[22]  Dacheng Tao,et al.  A Comprehensive Survey on Pose-Invariant Face Recognition , 2015, ACM Trans. Intell. Syst. Technol..

[23]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[24]  Martin Renqiang Min,et al.  Fast Nonnegative Matrix Factorization with Rank-one ADMM , 2014 .

[25]  Sanjay N. Talbar,et al.  A Novel Illumination Invariant Face Recognition Method Based on PCA and WPD Using YCbCr Color Space , 2016 .

[26]  Na Lu,et al.  Structure constrained nonnegative matrix factorization for pattern clustering and classification , 2016, Neurocomputing.

[27]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[28]  Liu Hong-bo.  Simulation of face recognition algorithm based on WTPCA and 3-neighbor classification , 2009 .

[29]  Aiming Huang.  NMF Face Recognition Method Based on Alpha Divergence , 2013 .

[30]  Rongrong Ji,et al.  Top Rank Supervised Binary Coding for Visual Search , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[31]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[32]  Jonghyun Choi,et al.  Multi-Directional Multi-Level Dual-Cross Patterns for Robust Face Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.