Sign-changing filters similar to cells in primary visual cortex emerge by independent component analysis of temporally convolved natural image sequences

Abstract It has been reported that independent component analysis (ICA) of natural image sequences yields spatio-temporal filters of non-separable spatio-temporal properties. On the contrary, sign changing filters with separable spatio-temporal properties have not been found via ICA. We show that extending the ICA to temporally convolved inputs develops such receptive fields (RFs). We argue that temporal convolution may arise from the response function of lagged and non-lagged cells of the LGN. The properties of the emerging RFs as a function of convolution time and the dimension of compression are studied.

[1]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.

[2]  H B Barlow,et al.  Single units and sensation: a neuron doctrine for perceptual psychology? , 1972, Perception.

[3]  I. Ohzawa,et al.  Functional Micro-Organization of Primary Visual Cortex: Receptive Field Analysis of Nearby Neurons , 1999, The Journal of Neuroscience.

[4]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[5]  G. DeAngelis,et al.  Spatiotemporal receptive field organization in the lateral geniculate nucleus of cats and kittens. , 1997, Journal of neurophysiology.

[6]  I. Ohzawa,et al.  Spatiotemporal organization of simple-cell receptive fields in the cat's striate cortex. I. General characteristics and postnatal development. , 1993, Journal of neurophysiology.

[7]  D. Ruderman,et al.  Independent component analysis of natural image sequences yields spatio-temporal filters similar to simple cells in primary visual cortex , 1998, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[8]  Aapo Hyvärinen,et al.  A Fast Fixed-Point Algorithm for Independent Component Analysis , 1997, Neural Computation.

[9]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[10]  J. Leo van Hemmen,et al.  Development of spatiotemporal receptive fields of simple cells: I. Model formulation , 1997, Biological Cybernetics.

[11]  F. Attneave.  Some informational aspects of visual perception. , 1954, Psychological review.

[12]  D. Ruderman,et al.  Independent component analysis of natural image sequences yields spatio-temporal filters similar to simple cells in primary visual cortex , 1998, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[13]  Terrence J. Sejnowski,et al.  The “independent components” of natural scenes are edge filters , 1997, Vision Research.