Illumination effects in face recognition

How do observers recognize faces despite dramatic image variations that arise from changes in illu­ mination? This paper examines (1) whether face recognition is sensitive to illumination direction and (2) whether cast shadows improve performance by providing information about illumination or hinder performance by introducing spurious edges. In Experiment 1, observers judged whether two sequen­ tially presented faces, illuminated from the same direction or different directions, were the same indi­ vidual or not. Cast shadows were present for half of the observers. Performance was impaired by a change in the illumination direction and by the presence of shadows. In Experiment 2, observers learned to name eight faces under one illumination direction Oeft/right) and one cast-shadow condition (present/absent); they were later tested under novel illumination and shadow conditions. Performance declined for unfamiliar illumination directions, but not for unfamiliar shadow conditions. The rmding that face recognition is illumination dependent is consistent with the use of image-based representa­ tions. The results indicate that face recognition processes are sensitive to either the direction of light­ ing or the resultant pattern of shading, and that cast shadows can hinder recognition, possibly by mask­ ing informative features or leading to spurious contours.

[1]  J. Beck Surface color perception , 1972 .

[2]  D. Marr,et al.  Representation and recognition of the spatial organization of three-dimensional shapes , 1978, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[3]  E. Warrington Neuropsychological studies of object recognition. , 1982, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[4]  K. Berbaum,et al.  Light Source Position in the Perception of Object Shape , 1983, Perception.

[5]  R. Desimone,et al.  Stimulus-selective properties of inferior temporal neurons in the macaque , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[6]  E. Rolls,et al.  Role of low and high spatial frequencies in the face-selective responses of neurons in the cortex in the superior temporal sulcus in the monkey , 1985, Vision Research.

[7]  M C Morrone,et al.  Recognition of Positive and Negative Bandpass-Filtered Images , 1986, Perception.

[8]  I. Biederman Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[9]  Rob Ellis,et al.  Multiple levels of representation for visual objects: a behavioural study , 1987 .

[10]  J. A. Anderson,et al.  Associative learning of scene parameters from images. , 1987, Applied optics.

[11]  I. Biederman,et al.  Surface versus edge-based determinants of visual recognition , 1988, Cognitive Psychology.

[12]  T. Poggio,et al.  A network that learns to recognize three-dimensional objects , 1990, Nature.

[13]  Richard G. Kurial,et al.  Representation and recognition , 1990 .

[14]  Neil A. Macmillan,et al.  Detection Theory: A User's Guide , 1991 .

[15]  Amnon Shashua,et al.  Illumination and View Position in 3D Visual Recognition , 1991, NIPS.

[16]  I. Biederman,et al.  Evidence for Complete Translational and Reflectional Invariance in Visual Object Priming , 1991, Perception.

[17]  Patrick Cavanagh,et al.  What's up in top-down processing? , 1991 .

[18]  E T Rolls,et al.  Neurophysiological mechanisms underlying face processing within and beyond the temporal cortical visual areas. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[19]  I Biederman,et al.  Metric invariance in object recognition: a review and further evidence. , 1992, Canadian journal of psychology.

[20]  I. Biederman,et al.  Size invariance in visual object priming , 1992 .

[21]  Peter W. Hallinan A low-dimensional representation of human faces for arbitrary lighting conditions , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[22]  M. Tovée,et al.  Translation invariance in the responses to faces of single neurons in the temporal visual cortical areas of the alert macaque. , 1994, Journal of neurophysiology.

[23]  Shimon Ullman,et al.  Face Recognition: The Problem of Compensating for Changes in Illumination Direction , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  M J Tarr,et al.  Is human object recognition better described by geon structural descriptions or by multiple views? Comment on Biederman and Gerhardstein (1993). , 1995, Journal of experimental psychology. Human perception and performance.

[25]  H H Bülthoff,et al.  How are three-dimensional objects represented in the brain? , 1994, Cerebral cortex.

[26]  I Biederman,et al.  Size Invariance in Visual Object Priming of Gray-Scale Images , 1995, Perception.

[27]  Minami Ito,et al.  Size and position invariance of neuronal responses in monkey inferotemporal cortex. , 1995, Journal of neurophysiology.

[28]  Russell A. Epstein,et al.  5/spl plusmn/2 eigenimages suffice: an empirical investigation of low-dimensional lighting models , 1995, Proceedings of the Workshop on Physics-Based Modeling in Computer Vision.

[29]  S. Ullman,et al.  Generalization to Novel Images in Upright and Inverted Faces , 1993, Perception.

[30]  H. Bülthoff,et al.  Face recognition under varying poses: The role of texture and shape , 1996, Vision Research.

[31]  V. Bruce,et al.  Effects of lighting on the perception of facial surfaces. , 1996, Journal of experimental psychology. Human perception and performance.

[32]  David J. Kriegman,et al.  What is the set of images of an object under all possible lighting conditions? , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[33]  S. Ullman High-Level Vision: Object Recognition and Visual Cognition , 1996 .

[34]  V. Bruce,et al.  Effects of lighting on the perception of facial surfaces. , 1996, Journal of experimental psychology. Human perception and performance.

[35]  Shimon Ullman,et al.  Face Recognition: The Problem of Compensating for Changes in Illumination Direction , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  M. Tarr,et al.  Becoming a “Greeble” Expert: Exploring Mechanisms for Face Recognition , 1997, Vision Research.

[37]  David J. Kriegman,et al.  The Bas-Relief Ambiguity , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[38]  Patrick Cavanagh,et al.  Recovery of 3D volume from 2-tone images of novel objects , 1998, Cognition.

[39]  Heinrich H Bülthoff,et al.  Why the visual recognition system might encode the effects of illumination , 1998, Vision Research.

[40]  Nikolaus F. Troje,et al.  How is bilateral symmetry of human faces used for recognition of novel views? , 1998, Vision Research.

[41]  Wendy L. Braje,et al.  Invariant Recognition of Natural Objects in the Presence of Shadows , 2000, Perception.