V1 non-linear properties emerge from local-to-global non-linear ICA

It has been argued that the aim of non-linearities in different visual and auditory mechanisms may be to remove the relations between the coefficients of the signal after global linear ICA-like stages. Specifically, in , it was shown that masking effects are reproduced by fitting the parameters of a particular non-linearity in order to remove the dependencies between the energy of wavelet coefficients. In this work, we present a different result that supports the same efficient encoding hypothesis. However, this result is more general because, instead of assuming any specific functional form for the non-linearity, we show that by using an unconstrained approach, masking-like behavior emerges directly from natural images. This result is an additional indication that Barlow's efficient encoding hypothesis may explain not only the shape of receptive fields of V1 sensors but also their non-linear behavior.

[1]  D. A. Dunnett.  Classical Electrodynamics , 2020, Nature.

[2]  J. Daugman.  Two-dimensional spectral analysis of cortical receptive field profiles , 1980, Vision Research.

[3]  J. M. Foley,et al.  Contrast masking in human vision. , 1980, Journal of the Optical Society of America.

[4]  G. Legge.  A power law for contrast discrimination , 1981, Vision Research.

[5]  Andrew B. Watson,et al.  Detection and Recognition of Simple Spatial Forms , 1983 .

[6]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[7]  F. A. Seiler,et al.  Numerical Recipes in C: The Art of Scientific Computing , 1989 .

[8]  L O Harvey,et al.  Visual masking at different polar angles in the two-dimensional Fourier plane. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[9]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[10]  William H. Press,et al.  The Art of Scientific Computing Second Edition , 1998 .

[11]  D. Heeger.  Normalization of cell responses in cat striate cortex , 1992, Visual Neuroscience.

[12]  J. M. Foley,et al.  Human luminance pattern-vision mechanisms: masking experiments require a new model. , 1994, Journal of the Optical Society of America. A, Optics, image science, and vision.

[13]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[14]  J A Solomon,et al.  Model of visual contrast gain control and pattern masking. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[15]  Nanda Kambhatla,et al.  Dimension Reduction by Local Principal Component Analysis , 1997, Neural Computation.

[16]  J. V. van Hateren,et al.  Independent component filters of natural images compared with simple cells in primary visual cortex , 1998, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[17]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[18]  Juha Karhunen,et al.  Local Linear Independent Component Analysis Based on Clustering , 2000, Int. J. Neural Syst..

[19]  Eero P. Simoncelli,et al.  Natural signal statistics and sensory gain control , 2001, Nature Neuroscience.

[20]  H Barlow,et al.  Redundancy reduction revisited , 2001, Network.

[21]  Eero P. Simoncelli,et al.  Natural image statistics and neural representation. , 2001, Annual review of neuroscience.

[22]  Eero P. Simoncelli.  Vision and the statistics of the visual environment , 2003, Current Opinion in Neurobiology.

[23]  J. Karhunen,et al.  Advances in Nonlinear Blind Source Separation , 2003 .

[24]  Konrad P. Körding,et al.  Learning the Nonlinearity of Neurons from Natural Visual Stimuli , 2003, Neural Computation.

[25]  Aapo Hyvärinen,et al.  Bubbles: a unifying framework for low-level statistical properties of natural image sequences. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[26]  Eero P. Simoncelli,et al.  Nonlinear image representation for efficient perceptual coding , 2006, IEEE Transactions on Image Processing.