Statistical model of natural stimuli predicts edge-like pooling of spatial frequency channels in V2

BackgroundIt has been shown that the classical receptive fields of simple and complex cells in the primary visual cortex emerge from the statistical properties of natural images by forcing the cell responses to be maximally sparse or independent. We investigate how to learn features beyond the primary visual cortex from the statistical properties of modelled complex-cell outputs. In previous work, we showed that a new model, non-negative sparse coding, led to the emergence of features which code for contours of a given spatial frequency band.ResultsWe applied ordinary independent component analysis to modelled outputs of complex cells that span different frequency bands. The analysis led to the emergence of features which pool spatially coherent across-frequency activity in the modelled primary visual cortex. Thus, the statistically optimal way of processing complex-cell outputs abandons separate frequency channels, while preserving and even enhancing orientation tuning and spatial localization. As a technical aside, we found that the non-negativity constraint is not necessary: ordinary independent component analysis produces essentially the same results as our previous work.ConclusionWe propose that the pooling that emerges allows the features to code for realistic low-level image features related to step edges. Further, the results prove the viability of statistical modelling of natural images as a framework that produces quantitative predictions of visual processing.

[1]  C. Gilbert,et al.  On a common circle: natural scenes and Gestalt rules. , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[2]  David J Tolhurst,et al.  Independent components of color natural scenes resemble V1 neurons in their spatial and color tuning. , 2004, Journal of neurophysiology.

[3]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[4]  Gerhard Krieger,et al.  Nonlinear neurons and higher-order statistics: new approaches to human vision and digital image processing , 1999, Electronic Imaging.

[5]  J. V. van Hateren,et al.  Independent component filters of natural images compared with simple cells in primary visual cortex , 1998, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[6]  P. Paatero,et al.  Positive matrix factorization: A non-negative factor model with optimal utilization of error estimates of data values† , 1994 .

[7]  David J. Field,et al.  What Is the Goal of Sensory Coding? , 1994, Neural Computation.

[8]  Aapo Hyvärinen,et al.  Simple-Cell-Like Receptive Fields Maximize Temporal Coherence in Natural Video , 2003, Neural Computation.

[9]  C. Zetzsche,et al.  Nonlinear and extra-classical receptive field properties and the statistics of natural scenes , 2001, Network.

[10]  T. Wiesel,et al.  Intrinsic connectivity and receptive field properties in visual cortex , 1985, Vision Research.

[11]  Aapo Hyvärinen,et al.  Bubbles: a unifying framework for low-level statistical properties of natural image sequences. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[12]  Frances S. Chance,et al.  Complex cells as cortically amplified simple cells , 1999, Nature Neuroscience.

[13]  Aapo Hyvärinen,et al.  Emergence of Phase- and Shift-Invariant Features by Decomposition of Natural Images into Independent Feature Subspaces , 2000, Neural Computation.

[14]  L A Olzak,et al.  Discrimination of Complex Patterns: Orientation Information is Integrated across Spatial Scale; Spatial-Frequency and Contrast Information are Not , 1997, Perception.

[15]  Isabelle Mareschal,et al.  A cortical locus for the processing of contrast-defined contours , 1998, Nature Neuroscience.

[16]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[17]  T. W. Lee,et al.  Chromatic structure of natural scenes. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[18]  D. Ruderman,et al.  Independent component analysis of natural image sequences yields spatio-temporal filters similar to simple cells in primary visual cortex , 1998, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[19]  Lewis D. Griffin,et al.  Natural image profiles are most likely to be step edges , 2004, Vision Research.

[20]  C. Zetzsche,et al.  Nonlinear and extra-classical receptive field properties and the statistics of natural scenes. , 2001 .

[21]  J. Elder,et al.  Ecological statistics of Gestalt laws for the perceptual organization of contours. , 2002, Journal of vision.

[22]  D. Snodderly,et al.  Spatial organization of receptive fields of V1 neurons of alert monkeys: comparison with responses to gratings. , 2002, Journal of neurophysiology.

[23]  D. Ringach,et al.  On the classification of simple and complex cells , 2002, Vision Research.

[24]  E. Oja,et al.  Independent Component Analysis , 2013 .

[25]  A. Hyvärinen,et al.  A multi-layer sparse coding network learns contour coding from natural images , 2002, Vision Research.

[26]  P O Hoyer,et al.  Independent component analysis applied to feature extraction from colour and stereo images , 2000, Network.

[27]  Jeffrey S. Perry,et al.  Edge co-occurrence in natural images predicts contour grouping performance , 2001, Vision Research.

[28]  Terrence J. Sejnowski,et al.  The “independent components” of natural scenes are edge filters , 1997, Vision Research.

[29]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[30]  Eero P. Simoncelli,et al.  Natural signal statistics and sensory gain control , 2001, Nature Neuroscience.

[31]  U. Polat,et al.  What pattern the eye sees best , 1999, Vision Research.

[32]  C. Baker,et al.  Temporal and spatial response to second-order stimuli in cat area 18. , 1998, Journal of neurophysiology.