Spatial dependencies between local luminance and contrast in natural images.

Previous research has suggested only weak statistical dependencies between local luminance and contrast in natural images. Here we study luminance and contrast in natural images using established measures and show that when multiple measurements of these two local quantities are taken in different spatial locations across the visual field, strong dependencies are revealed that were not apparent in previous pointwise (single-site) analyses. We present a few simple experiments demonstrating this spatial dependency of luminance and contrast and show that the luminance measurements can be used to approximate the contrast measurements. We also show that relying on higher-order statistics, independent component analysis learns paired spatial features for luminance and contrast. These features are shown to share orientation and localization, with the filters corresponding to the features dependent in their outputs. Finally, we demonstrate that the found dependencies also exist in artificial images generated from a dead leaves model, implying that simple image phenomena may suffice to account for the dependencies. Our results indicate that local luminance and contrast computations do not recover independent information sources from the visual signal. Subsequently, our results predict spatial processing of local luminance and contrast to be non-separable in visual systems.

[1]  Leslie G. Ungerleider.  Two cortical visual systems , 1982 .

[2]  John G. Proakis,et al.  Probability, random variables and stochastic processes , 1985, IEEE Trans. Acoust. Speech Signal Process..

[3]  D. C. Van Essen,et al.  Concurrent processing streams in monkey visual cortex , 1988, Trends in Neurosciences.

[4]  E. Peli.  Contrast in complex images. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[5]  B. Moulden,et al.  The Standard Deviation of Luminance as a Metric for Contrast in Random-Dot Images , 1990, Perception.

[6]  D. J. Felleman,et al.  Distributed hierarchical processing in the primate cerebral cortex. , 1991, Cerebral cortex.

[7]  C L Baker,et al.  A processing stream in mammalian visual cortex neurons for non-Fourier responses. , 1993, Science.

[8]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[9]  Daniel L. Ruderman,et al.  Origins of scaling in natural images , 1996, Vision Research.

[10]  Terrence J. Sejnowski,et al.  The “independent components” of natural scenes are edge filters , 1997, Vision Research.

[11]  J. H. Hateren,et al.  Independent component filters of natural images compared with simple cells in primary visual cortex , 1998 .

[12]  Wilfrid S. Kendall,et al.  Perfect simulation in stochastic geometry , 1999, Pattern Recognit..

[13]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[14]  D J Field,et al.  Local Contrast in Natural Images: Normalisation and Coding Efficiency , 2000, Perception.

[15]  A B Watson,et al.  Visual detection of spatial contrast patterns: evaluation of five simple models. , 2000, Optics express.

[16]  D. Tolhurst,et al.  Calculating the contrasts that retinal ganglion cells and LGN neurones encounter in natural scenes , 2000, Vision Research.

[17]  Eero P. Simoncelli,et al.  Natural image statistics and neural representation. , 2001, Annual review of neuroscience.

[18]  Ann B. Lee.  Occlusion Models for Natural Images : A Statistical Study of a Scale-Invariant Dead Leaves Model , 2001 .

[19]  Erkki Oja,et al.  Independent Component Analysis , 2001 .

[20]  P. Bex,et al.  Spatial frequency, phase, and the contrast of natural images. , 2002, Journal of the Optical Society of America. A, Optics, image science, and vision.

[21]  Michael S. Landy,et al.  Visual perception of texture , 2002 .

[22]  C. Baker,et al.  First- and second-order information in natural images: a filter-based approach to image statistics. , 2004, Journal of the Optical Society of America. A, Optics, image science, and vision.

[23]  L. Chalupa,et al.  The visual neurosciences , 2004 .

[24]  Robert A. Frazor,et al.  Independence of luminance and contrast in natural scenes and in the early visual system , 2005, Nature Neuroscience.

[25]  David R. Badcock,et al.  Interactions between luminance and contrast signals in global form detection , 2005, Vision Research.

[26]  Robert A. Frazor,et al.  Local luminance and contrast in natural images , 2006, Vision Research.

[27]  T. Vladusich,et al.  Do cortical neurons process luminance or contrast to encode surface properties? , 2006, Journal of neurophysiology.

[28]  D. G. Albrecht,et al.  Responses of Neurons in Primary Visual Cortex to Transient Changes in Local Contrast and Luminance , 2007, The Journal of Neuroscience.

[29]  R. Allard,et al.  Double dissociation between first- and second-order processing , 2007, Vision Research.

[30]  S. Sukumar,et al.  Separate first- and second-order processing is supported by spatial summation estimates at the fovea and eccentrically , 2007, Vision Research.

[31]  C. Gilbert,et al.  Brain States: Top-Down Influences in Sensory Processing , 2007, Neuron.

[32]  Daniel A. Gajewski,et al.  Differential detection of global luminance and contrast changes across saccades and flickers during active scene perception , 2008, Vision Research.