Effects of illumination intensity and direction on object coding in macaque inferior temporal cortex.

Single unit activity in area TE was recorded from two macaques as they viewed 3D appearing rendered objects that were illuminated from different directions (without cast shadows) and intensities of illumination. The average modulation produced by changes in illumination intensity or direction was rather moderate, with the majority of the neurons responding invariantly to these lighting variables. When neural activity was affected by illumination direction, it was not manifested as a preference for a particular direction of illumination by a given neuron. Instead, the tuning appeared to be to the relative brightness of a given shaped surface at a given orientation. The modulation to changes in illumination direction was considerably smaller than that produced by changes in object shape. Most of the neurons that were unaffected by changes in illumination direction responded much less to silhouettes of these objects, indicating that these neurons were also sensitive to an object's inner features. The neuronal invariance for shading variations may provide the basis for the invariance of object recognition under changes in illumination.

[1]  S. W. Kuffler.  Discharge patterns and functional organization of mammalian retina. , 1953, Journal of neurophysiology.

[2]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[3]  Berthold K. P. Horn.  Obtaining shape from shading information , 1989 .

[4]  R. Desimone,et al.  Shape recognition and inferior temporal neurons. , 1983, Proceedings of the National Academy of Sciences of the United States of America.

[5]  L. Weiskrantz,et al.  Impairments of visual object transforms in monkeys. , 1984, Brain : a journal of neurology.

[6]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  I. Biederman,et al.  Evidence for Complete Translational and Reflectional Invariance in Visual Object Priming , 1991, Perception.

[8]  I. Biederman,et al.  Priming contour-deleted images: Evidence for intermediate representations in visual object recognition , 1991, Cognitive Psychology.

[9]  I. Biederman,et al.  Size invariance in visual object priming , 1992 .

[10]  Shimon Ullman,et al.  Limitations of Non Model-Based Recognition Schemes , 1992, ECCV.

[11]  G. Orban,et al.  Cue-invariant shape selectivity of macaque inferior temporal neurons. , 1993, Science.

[12]  M. Ito,et al.  Processing of contrast polarity of visual images in inferotemporal cortex of the macaque monkey. , 1994, Cerebral cortex.

[13]  Minami Ito,et al.  Size and position invariance of neuronal responses in monkey inferotemporal cortex. , 1995, Journal of neurophysiology.

[14]  N. Logothetis,et al.  Shape representation in the inferior temporal cortex of monkeys , 1995, Current Biology.

[15]  G. Orban,et al.  Selectivity of macaque inferior temporal neurons for partially occluded shapes , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[16]  R Vogels,et al.  Coding of stimulus invariances by inferior temporal neurons. , 1996, Progress in brain research.

[17]  G. Orban,et al.  Responses of macaque inferior temporal neurons to overlapping shapes. , 1997, Cerebral cortex.

[18]  Wendy L. Braje,et al.  Illumination effects in face recognition , 1998, Psychobiology.

[19]  Heinrich H Bülthoff,et al.  Why the visual recognition system might encode the effects of illumination , 1998, Vision Research.

[20]  Makoto Kato,et al.  Processing of shape defined by disparity in monkey inferior temporal cortex , 1998, Neuroscience Research.

[21]  C. Liu,et al.  Lighting direction affects recognition of untextured faces in photographic positive and negative , 1999, Vision Research.

[22]  Irving Biederman,et al.  One-shot viewpoint invariance in matching novel objects , 1999, Vision Research.

[23]  G. Orban,et al.  Selectivity for 3D shape that reveals distinct areas within macaque inferior temporal cortex. , 2000, Science.

[24]  Wendy L. Braje,et al.  Invariant Recognition of Natural Objects in the Presence of Shadows , 2000, Perception.

[25]  R. Vogels,et al.  Spatial sensitivity of macaque inferior temporal neurons , 2000, The Journal of comparative neurology.

[26]  David W. Jacobs,et al.  In search of illumination invariants , 2001, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[27]  Tomaso Poggio,et al.  Models of object recognition , 2000, Nature Neuroscience.

[28]  G. Orban,et al.  Three-Dimensional Shape Coding in Inferior Temporal Cortex , 2000, Neuron.

[29]  I. Biederman,et al.  Inferior Temporal Neurons Show Greater Sensitivity to Nonaccidental than to Metric Shape Differences , 2001, Journal of Cognitive Neuroscience.

[30]  E. Iwai,et al.  Responsiveness of inferotemporal single units to visual pattern stimuli in monkeys performing discrimination , 1980, Experimental Brain Research.

[31]  E. Rolls,et al.  Size and contrast have only small effects on the responses to faces of neurons in the cortex of the superior temporal sulcus of the monkey , 2004, Experimental Brain Research.

[32]  David J. Kriegman,et al.  What Is the Set of Images of an Object Under All Possible Illumination Conditions? , 1998, International Journal of Computer Vision.

[33]  J. K. Hietanen,et al.  The effects of lighting conditions on responses of cells selective for face views in the macaque temporal cortex , 2004, Experimental Brain Research.