A neural network facial expression recognition system using unsupervised local processing

A local unsupervised processing stage is inserted within a neural network constructed to recognize facial expressions. The stage is applied in order to reduce the dimensionality of the input data while preserving some topological structure. The receptive fields of the neurons in the first hidden layer self-organize according to a local energy function, taking into account the variance of the input pixels. There is just one synapse going out from every input pixel and these weights, connecting the first two layers, are trained with a Hebbian algorithm. The structure of the network is completed with specialised modules, trained with backpropagation, that classify the data into the different expression categories. Thus, the neural net architecture includes 4 layers of neurons, that we train and test with images from the Yale Faces Database. We obtain a generalization rate of 84.5% on unseen faces, similar to the 83.2% rate obtained when using a similar system but implementing PCA processing at the initial stage.

[1]  Robert A. Jacobs,et al.  Nature, nurture, and the development of functional specializations: A computational approach , 1997 .

[2]  Leonardo Franco,et al.  Generalization properties of modular networks: implementing the parity function , 2001, IEEE Trans. Neural Networks.

[3]  G. Cottrell,et al.  A Simple Neural Network Models Categorical Perception of Facial Expressions , 1998 .

[4]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[5]  Garrison W. Cottrell,et al.  Organization of face and object recognition in modular neural network models , 1999, Neural Networks.

[6]  Christine L. Lisetti,et al.  Facial Expression Recognition Using a Neural Network , 1998, FLAIRS.

[7]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[8]  Frank A. Monforte,et al.  Predictive Modular Neural Networks - Applications to Time Series , 2002 .

[9]  E. Rolls,et al.  Neural networks and brain function , 1998 .

[10]  Erkki Oja,et al.  Neural Networks, Principal Components, and Subspaces , 1989, Int. J. Neural Syst..

[11]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[12]  Y Bennani Multi-Expert and Hybrid Connectionist Approach for Pattern Recognition: Speaker Identification Task , 1994, Int. J. Neural Syst..

[13]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[14]  Sidney R. Lehky Fine Discrimination of Faces can be Performed Rapidly , 2000, Journal of Cognitive Neuroscience.

[15]  David J. Kriegman,et al.  The yale face database , 1997 .

[16]  Garrison W. Cottrell,et al.  A Six-Unit Network is All You Need to Discover Happiness , 2000 .

[17]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[18]  R. Desimone Face-Selective Cells in the Temporal Cortex of Monkeys , 1991, Journal of Cognitive Neuroscience.