Independent component analysis of natural image sequences yields spatio-temporal filters similar to simple cells in primary visual cortex

Simple cells in the primary visual cortex process incoming visual information with receptive ¢elds localized in space and time, bandpass in spatial and temporal frequency, tuned in orientation, and commonly selective for the direction of movement. It is shown that performing independent component analysis (ICA) on video sequences of natural scenes produces results with qualitatively similar spatio-temporal properties. Whereas the independent components of video resemble moving edges or bars, the independent component ¢lters, i.e. the analogues of receptive ¢elds, resemble moving sinusoids windowed by steady Gaussian envelopes. Contrary to earlier ICA results on static images, which gave only ¢lters at the ¢nest possible spatial scale, the spatio-temporal analysis yields ¢lters at a range of spatial and temporal scales. Filters centred at low spatial frequencies are generally tuned to faster movement than those at high spatial frequencies.

[1]  Terrence J. Sejnowski,et al.  Unsupervised Learning , 2018, Encyclopedia of GIS.

[2]  Eero P. Simoncelli,et al.  A model of neuronal responses in visual area MT , 1998, Vision Research.

[3]  Terrence J. Sejnowski,et al.  The “independent components” of natural scenes are edge filters , 1997, Vision Research.

[4]  Daniel L. Ruderman,et al.  Origins of scaling in natural images , 1996, Vision Research.

[5]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.

[6]  George Francis Harpur,et al.  Low Entropy Coding with Unsupervised Neural Networks , 1997 .

[7]  Terrence J. Sejnowski,et al.  Edges are the Independent Components of Natural Scenes , 1996, NIPS.

[8]  Dawei W. Dong Spatiotemporal Coupling and Scaling of Natural Images and Human Visual Sensitivities , 1996, NIPS.

[9]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[10]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[11]  A. Watson,et al.  The optimal motion stimulus , 1995, Vision Research.

[12]  J. Atick,et al.  Temporal decorrelation: a theory of lagged and nonlagged responses in the lateral geniculate nucleus , 1995 .

[13]  David J. Field,et al.  What Is the Goal of Sensory Coding? , 1994, Neural Computation.

[14]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[15]  I. Ohzawa,et al.  Spatiotemporal organization of simple-cell receptive fields in the cat's striate cortex. I. General characteristics and postnatal development. , 1993, Journal of neurophysiology.

[16]  J. V. van Hateren,et al.  Spatiotemporal contrast sensitivity of early vision , 1993, Vision Research.

[17]  K. D. De Valois,et al.  Vernier acuity with stationary moving Gabors. , 1991, Vision research.

[18]  C L Baker,et al.  Spatial- and temporal-frequency selectivity as a basis for velocity preference in cat striate cortex neurons , 1990, Visual Neuroscience.

[19]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[20]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[21]  H. B. Barlow,et al.  What does the eye see best? , 1983, Nature.

[22]  H B Barlow,et al.  Single units and sensation: a neuron doctrine for perceptual psychology? , 1972, Perception.

[23]  RussLL L. Ds Vnlos,et al.  SPATIAL FREQUENCY SELECTIVITY OF CELLS IN MACAQUE VISUAL CORTEX , 2022 .