Occlusions contribute to scaling in natural images

Spatial power spectra from natural images fall approximately as the square of spatial frequency, a property also called scale invariance (scaling). Various theories for visual receptive fields consider scale invariance key. Two hypotheses have been advanced in the literature for why natural images obey scale invariance. The first is that these images have luminance edges, whose spectra fall as frequency squared. The second is that scale invariance follows from natural images being essentially a collage of independent, constant-intensity regions, whose sizes follow a power-law distribution. Recently, an argument by example was made against the first hypothesis. Here we refute that argument and show that the first hypothesis is consistent with the scaling under a wide variety of distributions of sizes. There are two reasons for this: first, for every frequency, the log-log slope of the rotationally averaged power spectrum of an image is the weighted mean of the log-log slopes from the independent regions of the image formed by objects occluding one another. Second, the log-log slopes of the spectrum envelope for a constant-intensity region are 0 and -3 for frequencies corresponding to periods much larger and much smaller than the region's size, respectively. Therefore, it is not surprising that natural images have log-log slopes between -1.5 and -3, with a mean near -2.

[1]  Daniel L. Ruderman,et al.  Origins of scaling in natural images , 1996, Vision Research.

[2]  Joseph J. Atick,et al.  Towards a Theory of Early Visual Processing , 1990, Neural Computation.

[3]  William Bialek,et al.  Statistics of Natural Images: Scaling in the Woods , 1993, NIPS.

[4]  S. Sinclair How Animals See: Other Visions of Our World , 1985 .

[5]  O. L. Zangwill,et al.  Current problems in animal behaviour , 1962 .

[6]  R C Reid,et al.  Efficient Coding of Natural Scenes in the Lateral Geniculate Nucleus: Experimental Test of a Computational Theory , 1996, The Journal of Neuroscience.

[7]  María Rosario,et al.  Teorías para la inhibición lateral en la retina basadas en autocorrelación, curtosis y aspereza local de las imágenes naturales , 1997 .

[8]  D. Tolhurst,et al.  Band-limited contrast in natural images explains the detectability of changes in the amplitude spectra , 1997, Vision Research.

[9]  Joseph J. Atick,et al.  What Does the Retina Know about Natural Scenes? , 1992, Neural Computation.

[10]  Norberto M. Grzywacz,et al.  The Minimal Local-Asperity Hypothesis of Early Retinal Lateral Inhibition , 2000, Neural Computation.

[11]  M. Fuortes,et al.  Probability of Occurrence of Discrete Potential Waves in the Eye of Limulus , 1964, The Journal of general physiology.

[12]  P. Liardet Regularities of distribution , 1987 .

[13]  N M Grzywacz,et al.  The role of early retinal lateral inhibition: More than maximizing luminance information , 2000, Visual Neuroscience.

[14]  D. Field,et al.  Visual sensitivity, blur and the sources of variability in the amplitude spectra of natural scenes , 1997, Vision Research.

[15]  Michael Bass,et al.  Handbook of optics , 1995 .

[16]  Richard Grossman,et al.  The animals , 1983 .

[17]  D. Baylor,et al.  Responses of retinal rods to single photons. , 1979, The Journal of physiology.

[18]  H. Montgomery Ten lectures on the interface between analytic number theory and harmonic analysis , 1994 .

[19]  G. J. Burton,et al.  Color and spatial structure in natural scenes. , 1987, Applied optics.

[20]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[21]  I. Good,et al.  Fractals: Form, Chance and Dimension , 1978 .

[22]  S. Laughlin,et al.  Predictive coding: a fresh view of inhibition in the retina , 1982, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[23]  Norberto M. Grzywacz,et al.  Occlusions and their relationship with the distribution of contrasts in natural images , 2000, Vision Research.

[24]  D. Tolhurst,et al.  Amplitude spectra of natural images. , 1992, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[25]  David J. Field,et al.  What Is the Goal of Sensory Coding? , 1994, Neural Computation.

[26]  Terrence J. Sejnowski,et al.  Unsupervised Learning , 2018, Encyclopedia of GIS.

[27]  N. Bohr Light and Life , 1933, Nature.