Matching expression variant faces

Several models have been proposed that attempt to explain how the brain identifies people by looking at their faces. However, to date, it is still not clear by which mechanism the brain successfully accomplishes the matching of two or more face images when differences in facial expression make the (local and global) appearance of these images different from one another. There seems to be a consensus that faces are processed holistically rather than locally, but there is not yet consensus on whether information on facial expression is passed to the identification process to aid recognition of individuals or not. Models have been proposed that exploit each of these two views, and psychophysical data exist in favor of and against each view. In this article, we show how the experimental data of these two opposite views can be explained by incorporating a key process of motion estimation in the classical feedforward model of face processing. This new model will then lead us to hypothesize that to successfully match expression variant faces, it is convenient to use the information supplied by this motion estimation process within the matching task. We will show experimental results in favor of this hypothesis. Finally, we will show how we can also use the same motion estimator to recognize facial expressions. 2003 Elsevier Science Ltd. All rights reserved.

[1]  Michael J. Black,et al.  The Robust Estimation of Multiple Motions: Parametric and Piecewise-Smooth Flow Fields , 1996, Comput. Vis. Image Underst..

[2]  P. E. Morris,et al.  Practical aspects of memory : current research and issues , 1988 .

[3]  T. Allison,et al.  Social perception from visual cues: role of the STS region , 2000, Trends in Cognitive Sciences.

[4]  Joachim M. Buhmann,et al.  Distortion Invariant Object Recognition in the Dynamic Link Architecture , 1993, IEEE Trans. Computers.

[5]  Leslie G. Ungerleider,et al.  The functional organization of human extrastriate cortex: a PET-rCBF study of selective attention to faces and locations , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[6]  T. Allison,et al.  Temporal Cortex Activation in Humans Viewing Eye and Mouth Movements , 1998, The Journal of Neuroscience.

[7]  S. Schweinberger,et al.  Asymmetric relationships among perceptions of facial identity, emotion, and facial speech. , 1998, Journal of experimental psychology. Human perception and performance.

[8]  H. Bülthoff,et al.  Effects of temporal association on recognition memory , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[9]  C. Darwin The Expression of the Emotions in Man and Animals , .

[10]  John J. Magee,et al.  Categorical perception of facial expressions , 1992, Cognition.

[11]  F. Keil,et al.  Categorical effects in the perception of faces , 1995, Cognition.

[12]  A. O'Toole,et al.  Prototype-referenced shape encoding revealed by high-level aftereffects , 2001, Nature Neuroscience.

[13]  K. Maruyama,et al.  The Effects of Expression on Face Recognition , 1993 .

[14]  Jules Davidoff,et al.  Language and perceptual categorisation , 2001, Trends in Cognitive Sciences.

[15]  Roberto Brunelli,et al.  Face Recognition: Features Versus Templates , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  J. Haxby,et al.  The distributed human neural system for face perception , 2000, Trends in Cognitive Sciences.

[17]  D. Perrett,et al.  Facial expression megamix: Tests of dimensional and category accounts of emotion recognition , 1997, Cognition.

[18]  J Kurucz,et al.  Prosopo‐Affective Agnosia as a Symptom of Cerebral Organic Disease , 1979, Journal of the American Geriatrics Society.

[19]  Larry S. Davis,et al.  Recognizing Human Facial Expressions From Long Image Sequences Using Optical Flow , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  R. Blake,et al.  Brain Areas Involved in Perception of Biological Motion , 2000, Journal of Cognitive Neuroscience.

[21]  Deborah J. Hellawell,et al.  Facial expression processing after amygdalotomy , 1996, Neuropsychologia.

[22]  Leslie G. Ungerleider Functional Brain Imaging Studies of Cortical Mechanisms for Memory , 1995, Science.

[23]  J. Sergent,et al.  Functional neuroanatomy of face and object processing. A positron emission tomography study. , 1992, Brain : a journal of neurology.

[24]  P. Feyereisen,et al.  A case of prosopagnosia with some preserved covert remembrance of familiar faces , 1983, Brain and Cognition.

[25]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[26]  D H HUBEL,et al.  RECEPTIVE FIELDS AND FUNCTIONAL ARCHITECTURE IN TWO NONSTRIATE VISUAL AREAS (18 AND 19) OF THE CAT. , 1965, Journal of neurophysiology.

[27]  Marian Stewart Bartlett,et al.  Classifying Facial Actions , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  P. E. Morris,et al.  Practical aspects of memory , 1980 .

[29]  David Beymer,et al.  Face recognition from one example view , 1995, Proceedings of IEEE International Conference on Computer Vision.

[30]  Avinash C. Kak,et al.  PCA versus LDA , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  J. Decety,et al.  Brain Regions Involved in the Perception of Gaze: A PET Study , 1998, NeuroImage.

[32]  T. Sejnowski,et al.  Measuring facial expressions by computer image analysis. , 1999, Psychophysiology.

[33]  A W Ellis,et al.  Routes through the Face Recognition System , 1991, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[34]  A. Young,et al.  In the Eye of the Beholder: The Science of Face Perception , 1998 .

[35]  V. Bruce,et al.  The role of movement in the recognition of famous faces , 1999, Memory & cognition.

[36]  R. Campbell,et al.  Gesture, Speech and Sign , 1999 .

[37]  N. Etcoff,et al.  Selective attention to facial identity and facial emotion , 1984, Neuropsychologia.

[38]  A. Johnston,et al.  Categorizing sex and identity from the biological motion of faces , 2001, Current Biology.

[39]  Glyn W. Humphreys,et al.  Expression is computed separately from facial identity, and it is computed separately for moving and static faces: Neuropsychological evidence , 1993, Neuropsychologia.

[40]  R. Fisher THE STATISTICAL UTILIZATION OF MULTIPLE MEASUREMENTS , 1938 .

[41]  Jean-Yves Baudouin,et al.  When the smile is a cue to familiarity , 2000, Memory.

[42]  J. Gillis,et al.  Matrix Iterative Analysis , 1961 .

[43]  Michael J. Lyons,et al.  Automatic Classification of Single Facial Images , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[44]  D. Perrett,et al.  Categorical Perception of Morphed Facial Expressions , 1996 .

[45]  J. N. Bassili Facial motion in the perception of faces and of emotional expression. , 1978, Journal of experimental psychology. Human perception and performance.

[46]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[47]  A. Young,et al.  Understanding face recognition. , 1986, British journal of psychology.

[48]  B Woll,et al.  Categorical Perception of Face Actions: Their Role in Sign Language and in Communicative Facial Displays , 1999, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[49]  Maja Pantic,et al.  Automatic Analysis of Facial Expressions: The State of the Art , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[50]  Rieko Osu,et al.  The Neural Substrates of Biological Motion Perception: an fMRI Study , 2022 .

[51]  M. Farah Visual Agnosia: Disorders of Object Recognition and What They Tell Us about Normal Vision , 1990 .

[52]  Aleix M. Martínez,et al.  Recognizing Imprecisely Localized, Partially Occluded, and Expression Variant Faces from a Single Sample per Class , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[53]  Naoya Yokoyama,et al.  Neural Coding of Color , 2004 .

[54]  S. Ullman High-Level Vision: Object Recognition and Visual Cognition , 1996 .

[55]  Andrew Blake,et al.  Visual Reconstruction , 1987, Deep Learning for EEG-Based Brain–Computer Interfaces.

[56]  F. Pirozzolo,et al.  Task relevant effects on the assessment of cerebral specialization for facial emotion , 1980, Brain and Language.

[57]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .