Is slowness a learning principle of the visual cortex?

Slow feature analysis is an algorithm for extracting slowly varying features from a quickly varying signal. It has been shown in network simulations on one-dimensional stimuli that visual invariances to shift and other transformations can be learned in an unsupervised fashion based on slow feature analysis. More recently, we have shown that slow feature analysis applied to image sequences generated from natural images using a range of spatial transformations results in units that share many properties with complex and hypercomplex cells of the primary visual cortex. We find cells responsive to Gabor stimuli with phase invariance, sharpened or widened orientation or frequency tuning, secondary response lobes, end-stopping, and cells selective for direction of motion. These results indicate that slowness may be an important principle of self-organization in the visual cortex.

[1]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[2]  A. Sillito.  The contribution of inhibitory mechanisms to the receptive field properties of neurones in the striate cortex of the cat. , 1975, The Journal of physiology.

[3]  R. L. Valois,et al.  The orientation and direction selectivity of cells in macaque visual cortex , 1982, Vision Research.

[4]  Takayuki Ito,et al.  Neocognitron: A neural network model for a mechanism of visual pattern recognition , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[5]  S. Zucker,et al.  Endstopped neurons in the visual cortex as a substrate for calculating curvature , 1987, Nature.

[6]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[7]  G. Orban,et al.  Responses of visual cortical neurons to curved stimuli and chevrons , 1990, Vision Research.

[8]  Peter Földiák,et al.  Learning Invariance from Transformation Sequences , 1991, Neural Comput..

[9]  Graeme Mitchison,et al.  Removing Time Variation with the Anti-Hebbian Differential Synapse , 1991, Neural Computation.

[10]  D. V. van Essen,et al.  A neurobiological model of visual attention and invariant pattern recognition based on dynamic routing of information , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[11]  I. Ohzawa,et al.  Length and width tuning of neurons in the cat's primary visual cortex. , 1994, Journal of neurophysiology.

[12]  Wolfgang Konen,et al.  A fast dynamic link matching algorithm for invariant pattern recognition , 1994, Neural Networks.

[13]  Geoffrey E. Hinton,et al.  Spatial coherence as an internal teacher for a neural network , 1995 .

[14]  N. Swindale.  The development of topography in the visual cortex: a review of models. , 1996 .

[15]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[16]  James V. Stone.  Learning Perceptually Salient Visual Parameters Using Spatiotemporal Smoothness Constraints , 1996, Neural Computation.

[17]  Laurenz Wiskott,et al.  Face recognition by dynamic link matching , 1996 .

[18]  E. Rolls,et al.  INVARIANT FACE AND OBJECT RECOGNITION IN THE VISUAL SYSTEM , 1997, Progress in Neurobiology.

[19]  Terrence J. Sejnowski,et al.  The “independent components” of natural scenes are edge filters , 1997, Vision Research.

[20]  I. Shevelev.  Second-order features extraction in the cat visual cortex: selective and invariant sensitivity of neurons to the shape and orientation of crosses and corners. , 1998, Bio Systems.

[21]  Aapo Hyvärinen,et al.  Emergence of Phase- and Shift-Invariant Features by Decomposition of Natural Images into Independent Feature Subspaces , 2000, Neural Computation.

[22]  Konrad P. Körding,et al.  Extracting Slow Subspaces from Natural Videos Leads to Complex Cells , 2001, ICANN.

[23]  R VanRullen,et al.  Is it a Bird? Is it a Plane? Ultra-Rapid Visual Categorisation of Natural and Artifactual Objects , 2001, Perception.

[24]  Laurenz Wiskott,et al.  Applying Slow Feature Analysis to Image Sequences Yields a Rich Repertoire of Complex Cell Properties , 2002, ICANN.

[25]  Terrence J. Sejnowski,et al.  Slow Feature Analysis: Unsupervised Learning of Invariances , 2002, Neural Computation.

[26]  Christoph von der Malsburg,et al.  Synapto-synaptic interactions speed up dynamic link matching , 2002, Neurocomputing.

[27]  Laurenz Wiskott,et al.  Slow Feature Analysis: A Theoretical Analysis of Optimal Free Responses , 2003, Neural Computation.

[28]  Laurenz Wiskott,et al.  Slow feature analysis yields a rich repertoire of complex cell properties. , 2005, Journal of vision.