Is All Face Processing Holistic? The View from UCSD

There has been a great deal of progress, as well as controversy, in understanding how complex objects, in particular, human faces, are processed by the cortex. At the same time, sophisticated neural network models have been developed that do many of the same tasks required by these cortical areas. Such simplifying models allow us to explore hypotheses concerning relatively complex domains such as face processing. In this chapter, we give a somewhat idiosyncratic history of the development of neural network models of face processing, concentrating on work at UCSD, and show how these models have led to a novel hypothesis concerning processing of facial expression. While our models have suggested a role for holistic representations of faces in identification, general local features appear to be important in recognition of expression. Is all face processing holistic? 3

[1]  Garrison W. Cottrell,et al.  Extracting features from faces using compression networks: Face , 1990 .

[2]  Joachim M. Buhmann,et al.  Distortion Invariant Object Recognition in the Dynamic Link Architecture , 1993, IEEE Trans. Computers.

[3]  Alice J. O'Toole,et al.  Assessing Algorithms as Computational Models for Human Face Recognition , 1999 .

[4]  S. Harnad Categorical Perception: The Groundwork of Cognition , 1990 .

[5]  Alex Pentland,et al.  Coding, Analysis, Interpretation, and Recognition of Facial Expressions , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Harry Wechsler,et al.  The FERET database and evaluation procedure for face-recognition algorithms , 1998, Image Vis. Comput..

[7]  M. Farah,et al.  What is "special" about face perception? , 1998, Psychological review.

[8]  A. Yuille Deformable Templates for Face Recognition , 1991, Journal of Cognitive Neuroscience.

[9]  F. Gregory Ashby,et al.  Categorization response time with multidimensional stimuli , 1994, Perception & psychophysics.

[10]  I. Biederman,et al.  Neural and psychophysical analysis of object and face recognition , 1998 .

[11]  James L. McClelland,et al.  A distributed, developmental model of word recognition and naming. , 1989, Psychological review.

[12]  W R Uttal,et al.  Combining image degradations in a recognition task , 1995, Perception & psychophysics.

[13]  W R Uttal,et al.  The effect of combinations of image degradations in a discrimination task , 1995, Perception & psychophysics.

[14]  Javier R. Movellan,et al.  Learning Continuous Probability Distributions with Symmetric Diffusion Networks , 1993, Cogn. Sci..

[15]  Larry S. Davis,et al.  Recognizing Human Facial Expressions From Long Image Sequences Using Optical Flow , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Norbert Krüger,et al.  Face recognition by elastic bunch graph matching , 1997, Proceedings of International Conference on Image Processing.

[17]  R. Baddeley,et al.  A statistical analysis of natural images matches psychophysically derived orientation tuning curves , 1991, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[18]  T J Sejnowski,et al.  Learning viewpoint-invariant face representations from visual experience in an attractor network. , 1998, Network.

[19]  M. Bartlett,et al.  Face image analysis by unsupervised learning and redundancy reduction , 1998 .

[20]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[21]  J. Daugman Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[22]  Garrison W. Cottrell,et al.  Representing Face Images for Emotion Classification , 1996, NIPS.

[23]  David C. Plaut,et al.  Connectionist neuropsychology: the breakdown and recovery of behavior in lesioned attractor networks , 1992 .

[24]  D. Perrett,et al.  Categorical Perception of Morphed Facial Expressions , 1996 .

[25]  A. Damasio,et al.  Intact recognition of facial expression, gender, and age in patients with impaired recognition of face identity , 1988, Neurology.

[26]  J. Russell A circumplex model of affect. , 1980 .

[27]  R. Adolphs,et al.  Fear and the human amygdala , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[28]  William R. Uttal,et al.  On seeing forms , 1988 .

[29]  Joachim M. Buhmann,et al.  Size and distortion invariant object recognition by hierarchical graph matching , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[30]  J. Cohn,et al.  Automated face analysis by feature point tracking has high concurrent validity with manual FACS coding. , 1999, Psychophysiology.

[31]  Alex Pentland,et al.  View-based and modular eigenspaces for face recognition , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[32]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[33]  A neural network model for facial affect classification , 1998 .

[34]  T. Busey Physical and Psychological Representations of Faces: Evidence From Morphing , 1998 .

[35]  John J. Magee,et al.  Categorical perception of facial expressions , 1992, Cognition.

[36]  D. Perrett,et al.  Facial expression megamix: Tests of dimensional and category accounts of emotion recognition , 1997, Cognition.

[37]  F. Keil,et al.  Categorical effects in the perception of faces , 1995, Cognition.

[38]  Garrison W. Cottrell,et al.  PCA = Gabor for Expression Recognition , 1999 .

[39]  M. K. Fleming,et al.  Categorization of faces using unsupervised feature extraction , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[40]  Hyeonjoon Moon,et al.  The FERET evaluation methodology for face-recognition algorithms , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[41]  P. Ekman Pictures of Facial Affect , 1976 .

[42]  Hartmut Neven,et al.  The Bochum/USC Face Recognition System And How it Fared in the FERET Phase III Test , 1998 .

[43]  Kurt Hornik,et al.  Neural networks and principal component analysis: Learning from examples without local minima , 1989, Neural Networks.

[44]  D. Massaro,et al.  Featural evaluation, integration, and judgment of facial affect. , 1997, Journal of experimental psychology. Human perception and performance.

[45]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[46]  R. Adolphs,et al.  Impaired recognition of emotion in facial expressions following bilateral damage to the human amygdala , 1994, Nature.

[47]  Alex Pentland,et al.  Bayesian face recognition using deformable intensity surfaces , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[48]  F. Keil,et al.  Categorical Perception as an Acquired Phenomenon: What are the Implications? , 1995 .

[49]  Marian Stewart Bartlett,et al.  Classifying Facial Action , 1995, NIPS.

[50]  Paul W. Munro,et al.  Principal Components Analysis Of Images Via Back Propagation , 1988, Other Conferences.

[51]  Alex Pentland,et al.  Matching and recognition using deformable intensity surfaces , 1995, Proceedings of International Symposium on Computer Vision - ISCV.

[52]  Geoffrey E. Hinton,et al.  A Learning Algorithm for Boltzmann Machines , 1985, Cogn. Sci..

[53]  James A. Anderson,et al.  Neurocomputing: Foundations of Research , 1988 .

[54]  D. Massaro Speech Perception By Ear and Eye: A Paradigm for Psychological Inquiry , 1989 .