Natural textures classification in area V4 of the macaque monkey

Natural texture of an object is an important cue for recognition. In real conditions, the incidence angle of light on natural textures leads to a complex pattern of micro-shading that modifies 3D rendering of surfaces. Little is known about visual processing of material properties. The present work aims to study the coding of natural textures by the neurons of area V4 of the awake macaque monkey. We used patches of natural textures issued from the CURET database and illuminated with two or three different angles with their corresponding controls (scrambled Fourier phase). We recorded the responses of V4 neurons to stimuli flashed in their receptive fields (RFs) while the macaques performed a simple fixation task. We show that a large majority of V4 neurons responded to texture patches with a strong modulation across stimuli. The analysis of those responses indicate that V4 neurons integrate first and second order parameters in the image (mean luminance, SNR, and energy), which may be used to achieve texture clustering in a multidimensional space. This clustering was comparable to that of a pyramid of Gabor filters and was not affected by illumination angles. Altogether, these results suggest that the V4 neuronal population acts as a set of filters able to classify textures independently of illumination angle. We conclude that area V4 contains mechanisms that are sensitive to the aspect of textured surfaces, even in an environment where illumination changes continuously.

[1]  D. V. van Essen,et al.  Selectivity for polar, hyperbolic, and Cartesian gratings in macaque visual cortex. , 1993, Science.

[2]  Leslie G. Ungerleider,et al.  Cue-dependent deficits in grating orientation discrimination after V4 lesions in macaques , 1996, Visual Neuroscience.

[3]  D. V. van Essen,et al.  The Processing of Visual Shape in the Cerebral Cortex of Human and Nonhuman Primates: A Functional Magnetic Resonance Imaging Study , 2004, The Journal of Neuroscience.

[4]  I. Biederman,et al.  Effects of illumination intensity and direction on object coding in macaque inferior temporal cortex. , 2002, Cerebral cortex.

[5]  Keiji Tanaka,et al.  Neuronal selectivities to complex object features in the ventral visual pathway of the macaque cerebral cortex. , 1994, Journal of neurophysiology.

[6]  D. Tolhurst,et al.  Both the phase and the amplitude spectrum may determine the appearance of natural images , 1993, Vision Research.

[7]  H. Komatsu,et al.  Influence of the Direction of Elemental Luminance Gradients on the Responses of V4 Cells to Textured Surfaces , 2001, The Journal of Neuroscience.

[8]  R. von der Heydt,et al.  Illusory contours and cortical neuron responses. , 1984, Science.

[9]  Shimon Ullman,et al.  Aligning pictorial descriptions , 1991 .

[10]  T. Poggio,et al.  A network that learns to recognize three-dimensional objects , 1990, Nature.

[11]  Victor A. F. Lamme The neurophysiology of figure-ground segregation in primary visual cortex , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[12]  Jean Bullier,et al.  Shape discrimination deficits during reversible deactivation of area V4 in the macaque monkey. , 2002, Cerebral cortex.

[13]  T. Allison,et al.  Differential Sensitivity of Human Visual Cortex to Faces, Letterstrings, and Textures: A Functional Magnetic Resonance Imaging Study , 1996, The Journal of Neuroscience.

[14]  Andrew Zisserman,et al.  Texture classification: are filter banks necessary? , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[15]  B. Julesz,et al.  Early visual perception. , 1981, Annual review of psychology.

[16]  C. Gross,et al.  Visuotopic organization and extent of V3 and V4 of the macaque , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[17]  Andrew Zisserman,et al.  Statistical Approaches to Material Classification , 2002, ICVGIP.

[18]  I. Biederman Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[19]  R. Desimone,et al.  Spectral properties of V4 neurons in the macaque , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[20]  D. Pollen,et al.  Spatial receptive field organization of macaque V4 neurons. , 2002, Cerebral cortex.

[21]  G K Humphrey,et al.  The Role of Surface Information in Object Recognition: Studies of a Visual Form Agnosic and Normal Subjects , 1994, Perception.

[22]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[23]  C. Connor,et al.  Shape representation in area V4: position-specific tuning for boundary conformation. , 2001, Journal of neurophysiology.

[24]  J. P. Jones,et al.  The two-dimensional spatial structure of simple receptive fields in cat striate cortex. , 1987, Journal of neurophysiology.

[25]  J D Victor,et al.  Striate cortex extracts higher-order spatial correlations from visual textures. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[26]  J. Hegdé,et al.  A comparative study of shape representation in macaque visual areas v2 and v4. , 2007, Cerebral cortex.

[27]  M. Young,et al.  Sparse population coding of faces in the inferotemporal cortex. , 1992, Science.

[28]  Jitendra Malik,et al.  Representing and Recognizing the Visual Appearance of Materials using Three-dimensional Textons , 2001, International Journal of Computer Vision.

[29]  Donald A. Jackson PROTEST: A PROcrustean Randomization TEST of community environment concordance , 1995 .

[30]  Rufin Vogels,et al.  Convergence of Depth from Texture and Depth from Disparity in Macaque Inferior Temporal Cortex , 2004, The Journal of Neuroscience.

[31]  G W Humphreys,et al.  The Effects of Surface Detail on Object Categorization and Naming , 1989, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[32]  S. Ullman Aligning pictorial descriptions: An approach to object recognition , 1989, Cognition.

[33]  W. L. Braje Illumination encoding in face recognition: effect of position shift. , 2003, Journal of vision.

[34]  Nikolaus F. Troje,et al.  How is bilateral symmetry of human faces used for recognition of novel views? , 1998, Vision Research.

[35]  A. Ravishankar Rao,et al.  The Texture Lexicon: Understanding the Categorization of Visual Texture Terms and Their Relationship to Texture Images , 1997, Cogn. Sci..

[36]  Gerald L. Lohse,et al.  Towards a texture naming system: Identifying relevant dimensions of texture , 1993, Vision Research.

[37]  R. Desimone,et al.  Visual properties of neurons in area V4 of the macaque: sensitivity to stimulus form. , 1987, Journal of neurophysiology.

[38]  B. Rossion,et al.  Revisiting Snodgrass and Vanderwart's Object Pictorial Set: The Role of Surface Detail in Basic-Level Object Recognition , 2004, Perception.

[39]  D. Marr,et al.  Representation and recognition of the spatial organization of three-dimensional shapes , 1978, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[40]  Mario Fritz,et al.  On the Significance of Real-World Conditions for Material Classification , 2004, ECCV.

[41]  D. Valentin,et al.  Perceptual dimensions of tactile textures. , 2003, Acta psychologica.

[42]  N. Logothetis,et al.  The Effect of Learning on the Function of Monkey Extrastriate Visual Cortex , 2004, PLoS biology.

[43]  W. Merigan,et al.  Basic visual capacities and shape discrimination after lesions of extrastriate area V4 in macaques , 1996, Visual Neuroscience.

[44]  E T Rolls,et al.  Sparseness of the neuronal representation of stimuli in the primate temporal visual cortex. , 1995, Journal of neurophysiology.

[45]  M. Tarr,et al.  Orientation Priming of Novel Shapes in the Context of Viewpoint-Dependent Recognition , 1997, Perception.

[46]  G. Sáry,et al.  Relationship between stimulus complexity and neuronal activity in the inferotemporal cortex of the macaque monkey. , 2004, Brain research. Cognitive brain research.

[47]  C. Connor,et al.  Responses to contour features in macaque area V4. , 1999, Journal of neurophysiology.

[48]  P. H. Schiller,et al.  The effects of V4 and middle temporal (MT) area lesions on visual performance in the rhesus monkey , 1993, Visual Neuroscience.

[49]  D. C. Essen,et al.  Neural responses to polar, hyperbolic, and Cartesian gratings in area V4 of the macaque monkey. , 1996, Journal of neurophysiology.