Properties of artificial networks evolved to contend with natural spectra

Understanding why spectra that are physically the same appear different in different contexts (color contrast), whereas spectra that are physically different appear similar (color constancy) presents a major challenge in vision research. Here, we show that the responses of biologically inspired neural networks evolved on the basis of accumulated experience with spectral stimuli automatically generate contrast and constancy. The results imply that these phenomena are signatures of a strategy that biological vision uses to circumvent the inverse optics problem as it pertains to light spectra, and that double-opponent neurons in early-level vision evolve to serve this purpose. This strategy provides a way of understanding the peculiar relationship between the objective world and subjective color experience, as well as rationalizing the relevant visual circuitry without invoking feature detection or image representation.

[1]  D. Jameson,et al.  Some Quantitative Aspects of an Opponent-Colors Theory. I. Chromatic Responses and Spectral Saturation , 1955 .

[2]  N. Daw,et al.  Goldfish Retina: Organization for Simultaneous Color Contrast , 1967, Science.

[3]  P. Gouras,et al.  Functional properties of ganglion cells of the rhesus monkey retina. , 1975, The Journal of physiology.

[4]  D. Tolhurst,et al.  Concealed colour opponency in ganglion cells of the rhesus monkey retina. , 1975, The Journal of physiology.

[5]  C. R. Michael.  Color vision mechanisms in monkey striate cortex: simple cells with dual opponent-color receptive fields. , 1978, Journal of neurophysiology.

[6]  C. R. Michael.  Color vision mechanisms in monkey striate cortex: dual-opponent cells with concentric receptive fields. , 1978, Journal of neurophysiology.

[7]  D. W. Heeley,et al.  Cardinal directions of color space , 1982, Vision Research.

[8]  D. Hubel,et al.  Anatomy and physiology of a color system in the primate visual cortex , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  P. Lennie,et al.  Spatial and temporal contrast sensitivities of neurones in lateral geniculate nucleus of macaque. , 1984, The Journal of physiology.

[10]  P. Lennie,et al.  Mechanisms of color vision. , 1988, Critical reviews in neurobiology.

[11]  R. Shapley,et al.  Spatial structure of cone inputs to receptive fields in primate lateral geniculate nucleus , 1992, Nature.

[12]  D. Macleod,et al.  Spectral sensitivities of the human cones. , 1993, Journal of the Optical Society of America. A, Optics, image science, and vision.

[13]  D. Ruderman,et al.  Statistics of cone responses to natural images: implications for visual coding , 1998 .

[14]  Bevil R. Conway,et al.  Spatial Structure of Cone Inputs to Color Cells in Alert Macaque Primary Visual Cortex (V-1) , 2001, The Journal of Neuroscience.

[15]  R. Shapley,et al.  The spatial transformation of color in the primary visual cortex of the macaque monkey , 2001, Nature Neuroscience.

[16]  Ione Fine,et al.  Surface segmentation based on the luminance and color statistics of natural scenes. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[17]  D. Purves,et al.  Why we see what we do : an empirical theory of vision , 2003 .

[18]  Dale Purves,et al.  The statistical structure of natural light patterns determines perceived light intensity. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[19]  R. Shapley,et al.  Cone inputs in macaque primary visual cortex. , 2004, Journal of Neurophysiology.

[20]  Bevil R. Conway,et al.  Spatial and Temporal Properties of Cone Signals in Alert Macaque Primary Visual Cortex , 2006, The Journal of Neuroscience.

[21]  G. H. Jacobs.  Primate color vision: A comparative perspective , 2008, Visual Neuroscience.

[22]  R. Shapley,et al.  The Orientation Selectivity of Color-Responsive Neurons in Macaque V1 , 2008, The Journal of Neuroscience.

[23]  Wilson S Geisler,et al.  Region grouping in natural foliage scenes: image statistics and human performance. , 2010, Journal of vision.

[24]  D. Alais,et al.  Orientation tuning of contrast masking caused by motion streaks. , 2010, Journal of vision.

[25]  David C Knill,et al.  Adapting internal statistical models for interpreting visual cues to depth. , 2010, Journal of vision.

[26]  Donald D Hoffman,et al.  Natural selection and veridical perceptions. , 2010, Journal of theoretical biology.

[27]  David H Brainard,et al.  Surface color perception and equivalent illumination models. , 2011, Journal of vision.

[28]  Paul M Bays,et al.  Temporal dynamics of encoding, storage, and reallocation of visual working memory. , 2011, Journal of vision.

[29]  Jeffrey S. Perry,et al.  Statistics for optimal point prediction in natural images. , 2011, Journal of vision.

[30]  D. Purves,et al.  Why we see what we do redux : a wholly empirical theory of vision , 2011 .

[31]  B. Sheth,et al.  Phantom flashes caused by interactions across visual space. , 2010, Journal of vision.

[32]  Richard F Murray,et al.  Classification images: A review. , 2011, Journal of vision.

[33]  Dale Purves,et al.  Understanding vision in wholly empirical terms , 2011, Proceedings of the National Academy of Sciences.

[34]  R. Shapley,et al.  Color in the Cortex: single- and double-opponent cells , 2011, Vision Research.

[35]  Arno Koning,et al.  Multiple object tracking: anticipatory attention doesn't "bounce". , 2012, Journal of vision.

[36]  Christopher DiMattina,et al.  Detecting natural occlusion boundaries using local cues. , 2012, Journal of vision.

[37]  J. Badler,et al.  Divergence between oculomotor and perceptual causality. , 2012, Journal of vision.

[38]  Cherlyn J. Ng,et al.  Network Connections That Evolve to Circumvent the Inverse Optics Problem , 2013, PloS one.

[39]  D. Purves,et al.  How biological vision succeeds in the physical world , 2014, Proceedings of the National Academy of Sciences.