Beats, kurtosis and visual coding

Techniques adapted from standard higher-order statistical methods are applied to natural-image data in an attempt to discover exactly what makes `wavelet' representations of natural scenes sparse. Specifically, this paper describes a measure known as the phase-only second spectrum, a fourth-order statistic which quantifies harmonic beat interactions in data, and uses it to show that there are statistical consistencies in the phase spectra of natural scenes. The orientation-averaged phase-only second spectra of natural images appear to show power-law behaviour rather like image power spectra, but with a spectral exponent of approximately -1 instead of -2. They also appear to display a similar form of scale-invariance. Further experimental results indicate that the form of these spectra can account for the observed sparseness of bandpass-filtered natural scenes. This implies an intimate relationship between the merits of sparse neural coding and the exploitation of non-Gaussian `beats' structures by the visual system.

[1]  B Julesz,et al.  Inability of Humans to Discriminate between Visual Textures That Agree in Second-Order Statistics—Revisited , 1973, Perception.

[2]  G. Matheron Random Sets and Integral Geometry , 1976 .

[3]  Jeffrey A. Sloan,et al.  Spatial frequency analysis of the visual environment: Anisotropy and the carpentered environment hypothesis , 1978, Vision Research.

[4]  A.V. Oppenheim,et al.  The importance of phase in signals , 1980, Proceedings of the IEEE.

[5]  L N Piotrowski,et al.  A Demonstration of the Visual Importance and Flexibility of Spatial-Frequency Amplitude and Phase , 1982, Perception.

[6]  C W Tyler,et al.  Phase discrimination of compound gratings: generalized autocorrelation analysis. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[7]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[8]  D. Burr,et al.  Feature detection in human vision: a phase-dependent energy model , 1988, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[9]  M. Weissman 1/f noise and other slow, nonexponential kinetics in condensed matter. , 1988 .

[10]  J.G. Daugman,et al.  Entropy reduction and decorrelation in visual coding by oriented neural receptive fields , 1989, IEEE Transactions on Biomedical Engineering.

[11]  Joseph J. Atick,et al.  What Does the Retina Know about Natural Scenes? , 1992, Neural Computation.

[12]  William Bialek,et al.  Statistics of Natural Images: Scaling in the Woods , 1993, NIPS.

[13]  David J. Field,et al.  What Is the Goal of Sensory Coding? , 1994, Neural Computation.

[14]  J G Daugman,et al.  Demodulation, predictive coding, and spatial vision. , 1995, Journal of the Optical Society of America. A, Optics, image science, and vision.

[15]  R. Baddeley,et al.  Searching for filters with 'interesting' output distributions: an uninteresting direction to explore? , 1996, Network.

[16]  Seidler,et al.  Non-Gaussian 1/f noise: Experimental optimization and separation of high-order amplitude and phase correlations. , 1996, Physical review. B, Condensed matter.

[17]  Seidler Gt,et al.  Non-Gaussian 1/f noise: Experimental optimization and separation of high-order amplitude and phase correlations. , 1996 .

[18]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[19]  J. H. van Hateren,et al.  Modelling the Power Spectra of Natural Images: Statistics and Information , 1996, Vision Research.

[20]  Roland Baddeley,et al.  An efficient code in V1? , 1996, Nature.

[21]  David H. Foster,et al.  Role of second- and third-order statistics in the discriminability of natural images , 1997 .

[22]  Terrence J. Sejnowski,et al.  The “independent components” of natural scenes are edge filters , 1997, Vision Research.

[23]  Mitchell G. A. Thomson,et al.  Higher-order structure in natural scenes , 1999 .

[24]  D H Foster,et al.  Human Sensitivity to Phase Perturbations in Natural Images: A Statistical Framework , 2000, Perception.

[25]  A J Schofield,et al.  What Does Second-Order Vision See in an Image? , 2000, Perception.

[26]  M. Thomson,et al.  Sensory coding and the second spectra of natural signals. , 2001, Physical review letters.