Independent component analysis of natural image sequences yields spatio-temporal filters similar to simple cells in primary visual cortex

Simple cells in the primary visual cortex process incoming visual information with receptive ¢elds localized in space and time, bandpass in spatial and temporal frequency, tuned in orientation, and commonly selective for the direction of movement. It is shown that performing independent component analysis (ICA) on video sequences of natural scenes produces results with qualitatively similar spatio-temporal properties. Whereas the independent components of video resemble moving edges or bars, the independent component ¢lters, i.e. the analogues of receptive ¢elds, resemble moving sinusoids windowed by steady Gaussian envelopes. Contrary to earlier ICA results on static images, which gave only ¢lters at the ¢nest possible spatial scale, the spatio-temporal analysis yields ¢lters at a range of spatial and temporal scales. Filters centred at low spatial frequencies are generally tuned to faster movement than those at high spatial frequencies.

[1]  H B Barlow,et al.  Single units and sensation: a neuron doctrine for perceptual psychology? , 1972, Perception.

[2]  H. B. Barlow,et al.  What does the eye see best? , 1983, Nature.

[3]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[4]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[5]  C L Baker,et al.  Spatial- and temporal-frequency selectivity as a basis for velocity preference in cat striate cortex neurons , 1990, Visual Neuroscience.

[6]  K. D. De Valois,et al.  Vernier acuity with stationary moving Gabors. , 1991, Vision research.

[7]  J. V. van Hateren,et al.  Spatiotemporal contrast sensitivity of early vision , 1993, Vision Research.

[8]  I. Ohzawa,et al.  Spatiotemporal organization of simple-cell receptive fields in the cat's striate cortex. I. General characteristics and postnatal development. , 1993, Journal of neurophysiology.

[9]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[10]  David J. Field,et al.  What Is the Goal of Sensory Coding? , 1994, Neural Computation.

[11]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[12]  A. Watson,et al.  The optimal motion stimulus , 1995, Vision Research.

[13]  J. Atick,et al.  Temporal decorrelation: a theory of lagged and nonlagged responses in the lateral geniculate nucleus , 1995 .

[14]  Terrence J. Sejnowski,et al.  Edges are the Independent Components of Natural Scenes , 1996, NIPS.

[15]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[16]  Dawei W. Dong.  Spatiotemporal Coupling and Scaling of Natural Images and Human Visual Sensitivities , 1996, NIPS.

[17]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.

[18]  Daniel L. Ruderman,et al.  Origins of scaling in natural images , 1996, Vision Research.

[19]  George Francis Harpur,et al.  Low Entropy Coding with Unsupervised Neural Networks , 1997 .

[20]  Terrence J. Sejnowski,et al.  The “independent components” of natural scenes are edge filters , 1997, Vision Research.

[21]  Eero P. Simoncelli,et al.  A model of neuronal responses in visual area MT , 1998, Vision Research.

[22]  Terrence J. Sejnowski,et al.  Unsupervised Learning , 2018, Encyclopedia of GIS.

[23]  RussLL L. Ds Vnlos,et al.  SPATIAL FREQUENCY SELECTIVITY OF CELLS IN MACAQUE VISUAL CORTEX , 2022 .